canSAS - User contributions [en]

Data Formats Working Group

2016-10-16T21:04:50Z

Tobias Richter: /* Members */

= Latest News =

[[User:Tobias Rchter|Tobias Richter]] December 2015 : Multidim moved to github a while ago

[[User:Ajj|Ajj]] July 31st 2012 : [[2012 Data Discussion| canSAS 2012 Data Formats discussion page]]

= Links =

===1D===

* '''Documentation''': [http://www.cansas.org/formats/canSAS1d/1.1/doc/ http://www.cansas.org/formats/canSAS1d/1.1/doc/]
* '''TRAC''': [http://www.cansas.org/trac http://www.cansas.org/trac]
* '''Subversion''': [http://www.cansas.org/svn/1dwg http://www.cansas.org/svn/1dwg]

===Multi-dimensional===

* '''Documentation''': [http://cansas-org.github.io/canSAS2012/ http://cansas-org.github.io/canSAS2012/]
* '''Issues''': [https://github.com/canSAS-org/canSAS2012/issues https://github.com/canSAS-org/canSAS2012/issues]
* '''Github''': [https://github.com/canSAS-org/canSAS2012 https://github.com/canSAS-org/canSAS2012]

= Members =
* Andrew Jackson (ESS)
* Pete Jemian (APS)
* Steve King (ISIS)
* Ken Littrell (ORNL)
* Andrew Nelson (ANSTO)
* Ron Ghosh (ILL)
* Jan Ilavsky (APS)

= Timeline =
* 2007-12-31 agree on v1.0 format
* 2008-01-01 start implementing v1 at facilities
* 2008-06 representative sampling of data available for inter-facility comparison
* 2008-11-3 presentation of results at NOBUGS2008 meeting ([http://www.nbi.ansto.gov.au/nobugs2008 http://www.nbi.ansto.gov.au/nobugs2008])
* 2009-05-12 tagged SVN changeset 67 as v1.0 since it has been unmodified since January
* 2009-09-17 Agreed that v1.1 revision should be forthcoming with corrections/additions to be identified in TRAC tickets

= Status =
[[User:Jemian|Jemian]] 11:10, 06 September 2008 (CDT) IgorPro GUI tool included in Irena [http://usaxs.xor.aps.anl.gov/staff/ilavsky/irena.html Irena] analysis suite 
[[User:Jemian|Jemian]] 13:08, 14 March 2008 (EDT) IgorPro tool to read cansas1d/1.0 XML files available 
[[User:Jemian|Jemian]] 13:38, 25 February 2008 (EST) starting to add case studies 
[[User:Jemian|Jemian]] 00:39, 21 December 2007 (EST) complete first draft (v0.1a) ready for comments from 1DWG 
[[User:Jemian|Jemian]] 12:00, 14 December 2007 (EST) draft status updated 
[[User:Jemian|Jemian]] 17:07, 12 May 2009 (EDT) changeset 67 tagged as v1.0

= Examples and Usage =
The following are example v1.1 compliant 1D data files containing [besides essential metadata] - right-click & save as to view, stylesheet is on the TRAC site: 
SANS data only [[media:ISIS_SASXML_v1_1_SANS_Example.XML | ISIS_SASXML_v1_1_SANS_Example.XML]] 
Wavelength-dependent transmission [[media:ISIS_SASXML_v1_1_Transmission_Example.XML | ISIS_SASXML_v1_1_Transmission_Example.XML]] 
Wavelength-dependent monitor spectrum [[media:ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML | ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML]] 
Wavelength-dependent detector efficiency ratio [[media:ISIS_SASXML_v1_1_Det_Efficiency_Example.XML | ISIS_SASXML_v1_1_Det_Efficency_Example.XML]] 

The files can be usefully displayed in many web browsers: [[Rendering_canSAS1D_in_Web_Browsers]]

[[Category:Working Groups]]

Data Formats Working Group

2015-12-07T16:44:40Z

Tobias Richter: /* Latest News */

= Latest News =

[[User:Tobias Rchter|Tobias Richter]] December 2015 : Multidim moved to github a while ago

[[User:Ajj|Ajj]] July 31st 2012 : [[2012 Data Discussion| canSAS 2012 Data Formats discussion page]]

= Links =

===1D===

* '''Documentation''': [http://www.cansas.org/formats/canSAS1d/1.1/doc/ http://www.cansas.org/formats/canSAS1d/1.1/doc/]
* '''TRAC''': [http://www.cansas.org/trac http://www.cansas.org/trac]
* '''Subversion''': [http://www.cansas.org/svn/1dwg http://www.cansas.org/svn/1dwg]

===Multi-dimensional===

* '''Documentation''': [http://cansas-org.github.io/canSAS2012/ http://cansas-org.github.io/canSAS2012/]
* '''Issues''': [https://github.com/canSAS-org/canSAS2012/issues https://github.com/canSAS-org/canSAS2012/issues]
* '''Github''': [https://github.com/canSAS-org/canSAS2012 https://github.com/canSAS-org/canSAS2012]

= Members =
* Andrew Jackson (ESS)
* Pete Jemian (APS)
* Steve King (ISIS)
* Ken Littrell (ORNL)
* Andrew Nelson (ANSTO)
* Ron Ghosh (ILL)
* Jan Ilavsky (APS)
* Tobias Richter (ESS)

= Timeline =
* 2007-12-31 agree on v1.0 format
* 2008-01-01 start implementing v1 at facilities
* 2008-06 representative sampling of data available for inter-facility comparison
* 2008-11-3 presentation of results at NOBUGS2008 meeting ([http://www.nbi.ansto.gov.au/nobugs2008 http://www.nbi.ansto.gov.au/nobugs2008])
* 2009-05-12 tagged SVN changeset 67 as v1.0 since it has been unmodified since January
* 2009-09-17 Agreed that v1.1 revision should be forthcoming with corrections/additions to be identified in TRAC tickets

= Status =
[[User:Jemian|Jemian]] 11:10, 06 September 2008 (CDT) IgorPro GUI tool included in Irena [http://usaxs.xor.aps.anl.gov/staff/ilavsky/irena.html Irena] analysis suite 
[[User:Jemian|Jemian]] 13:08, 14 March 2008 (EDT) IgorPro tool to read cansas1d/1.0 XML files available 
[[User:Jemian|Jemian]] 13:38, 25 February 2008 (EST) starting to add case studies 
[[User:Jemian|Jemian]] 00:39, 21 December 2007 (EST) complete first draft (v0.1a) ready for comments from 1DWG 
[[User:Jemian|Jemian]] 12:00, 14 December 2007 (EST) draft status updated 
[[User:Jemian|Jemian]] 17:07, 12 May 2009 (EDT) changeset 67 tagged as v1.0

= Examples and Usage =
The following are example v1.1 compliant 1D data files containing [besides essential metadata] - right-click & save as to view, stylesheet is on the TRAC site: 
SANS data only [[media:ISIS_SASXML_v1_1_SANS_Example.XML | ISIS_SASXML_v1_1_SANS_Example.XML]] 
Wavelength-dependent transmission [[media:ISIS_SASXML_v1_1_Transmission_Example.XML | ISIS_SASXML_v1_1_Transmission_Example.XML]] 
Wavelength-dependent monitor spectrum [[media:ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML | ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML]] 
Wavelength-dependent detector efficiency ratio [[media:ISIS_SASXML_v1_1_Det_Efficiency_Example.XML | ISIS_SASXML_v1_1_Det_Efficency_Example.XML]] 

The files can be usefully displayed in many web browsers: [[Rendering_canSAS1D_in_Web_Browsers]]

[[Category:Working Groups]]

Data Formats Working Group

2015-12-07T16:44:22Z

Tobias Richter: /* Latest News */

= Latest News =

[[User:Tobias Rchter|Tobias Richter]] December 2015 : Multidim moved to github a while ago
[[User:Ajj|Ajj]] July 31st 2012 : [[2012 Data Discussion| canSAS 2012 Data Formats discussion page]]

= Links =

===1D===

* '''Documentation''': [http://www.cansas.org/formats/canSAS1d/1.1/doc/ http://www.cansas.org/formats/canSAS1d/1.1/doc/]
* '''TRAC''': [http://www.cansas.org/trac http://www.cansas.org/trac]
* '''Subversion''': [http://www.cansas.org/svn/1dwg http://www.cansas.org/svn/1dwg]

===Multi-dimensional===

* '''Documentation''': [http://cansas-org.github.io/canSAS2012/ http://cansas-org.github.io/canSAS2012/]
* '''Issues''': [https://github.com/canSAS-org/canSAS2012/issues https://github.com/canSAS-org/canSAS2012/issues]
* '''Github''': [https://github.com/canSAS-org/canSAS2012 https://github.com/canSAS-org/canSAS2012]

= Members =
* Andrew Jackson (ESS)
* Pete Jemian (APS)
* Steve King (ISIS)
* Ken Littrell (ORNL)
* Andrew Nelson (ANSTO)
* Ron Ghosh (ILL)
* Jan Ilavsky (APS)
* Tobias Richter (ESS)

= Timeline =
* 2007-12-31 agree on v1.0 format
* 2008-01-01 start implementing v1 at facilities
* 2008-06 representative sampling of data available for inter-facility comparison
* 2008-11-3 presentation of results at NOBUGS2008 meeting ([http://www.nbi.ansto.gov.au/nobugs2008 http://www.nbi.ansto.gov.au/nobugs2008])
* 2009-05-12 tagged SVN changeset 67 as v1.0 since it has been unmodified since January
* 2009-09-17 Agreed that v1.1 revision should be forthcoming with corrections/additions to be identified in TRAC tickets

= Status =
[[User:Jemian|Jemian]] 11:10, 06 September 2008 (CDT) IgorPro GUI tool included in Irena [http://usaxs.xor.aps.anl.gov/staff/ilavsky/irena.html Irena] analysis suite 
[[User:Jemian|Jemian]] 13:08, 14 March 2008 (EDT) IgorPro tool to read cansas1d/1.0 XML files available 
[[User:Jemian|Jemian]] 13:38, 25 February 2008 (EST) starting to add case studies 
[[User:Jemian|Jemian]] 00:39, 21 December 2007 (EST) complete first draft (v0.1a) ready for comments from 1DWG 
[[User:Jemian|Jemian]] 12:00, 14 December 2007 (EST) draft status updated 
[[User:Jemian|Jemian]] 17:07, 12 May 2009 (EDT) changeset 67 tagged as v1.0

= Examples and Usage =
The following are example v1.1 compliant 1D data files containing [besides essential metadata] - right-click & save as to view, stylesheet is on the TRAC site: 
SANS data only [[media:ISIS_SASXML_v1_1_SANS_Example.XML | ISIS_SASXML_v1_1_SANS_Example.XML]] 
Wavelength-dependent transmission [[media:ISIS_SASXML_v1_1_Transmission_Example.XML | ISIS_SASXML_v1_1_Transmission_Example.XML]] 
Wavelength-dependent monitor spectrum [[media:ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML | ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML]] 
Wavelength-dependent detector efficiency ratio [[media:ISIS_SASXML_v1_1_Det_Efficiency_Example.XML | ISIS_SASXML_v1_1_Det_Efficency_Example.XML]] 

The files can be usefully displayed in many web browsers: [[Rendering_canSAS1D_in_Web_Browsers]]

[[Category:Working Groups]]

Data Formats Working Group

2015-12-07T16:42:58Z

Tobias Richter: /* Multi-dimensional */

= Latest News =

[[User:Ajj|Ajj]] July 31st 2012 : [[2012 Data Discussion| canSAS 2012 Data Formats discussion page]]

= Links =

===1D===

* '''Documentation''': [http://www.cansas.org/formats/canSAS1d/1.1/doc/ http://www.cansas.org/formats/canSAS1d/1.1/doc/]
* '''TRAC''': [http://www.cansas.org/trac http://www.cansas.org/trac]
* '''Subversion''': [http://www.cansas.org/svn/1dwg http://www.cansas.org/svn/1dwg]

===Multi-dimensional===

* '''Documentation''': [http://cansas-org.github.io/canSAS2012/ http://cansas-org.github.io/canSAS2012/]
* '''Issues''': [https://github.com/canSAS-org/canSAS2012/issues https://github.com/canSAS-org/canSAS2012/issues]
* '''Github''': [https://github.com/canSAS-org/canSAS2012 https://github.com/canSAS-org/canSAS2012]

= Members =
* Andrew Jackson (ESS)
* Pete Jemian (APS)
* Steve King (ISIS)
* Ken Littrell (ORNL)
* Andrew Nelson (ANSTO)
* Ron Ghosh (ILL)
* Jan Ilavsky (APS)
* Tobias Richter (ESS)

= Timeline =
* 2007-12-31 agree on v1.0 format
* 2008-01-01 start implementing v1 at facilities
* 2008-06 representative sampling of data available for inter-facility comparison
* 2008-11-3 presentation of results at NOBUGS2008 meeting ([http://www.nbi.ansto.gov.au/nobugs2008 http://www.nbi.ansto.gov.au/nobugs2008])
* 2009-05-12 tagged SVN changeset 67 as v1.0 since it has been unmodified since January
* 2009-09-17 Agreed that v1.1 revision should be forthcoming with corrections/additions to be identified in TRAC tickets

= Status =
[[User:Jemian|Jemian]] 11:10, 06 September 2008 (CDT) IgorPro GUI tool included in Irena [http://usaxs.xor.aps.anl.gov/staff/ilavsky/irena.html Irena] analysis suite 
[[User:Jemian|Jemian]] 13:08, 14 March 2008 (EDT) IgorPro tool to read cansas1d/1.0 XML files available 
[[User:Jemian|Jemian]] 13:38, 25 February 2008 (EST) starting to add case studies 
[[User:Jemian|Jemian]] 00:39, 21 December 2007 (EST) complete first draft (v0.1a) ready for comments from 1DWG 
[[User:Jemian|Jemian]] 12:00, 14 December 2007 (EST) draft status updated 
[[User:Jemian|Jemian]] 17:07, 12 May 2009 (EDT) changeset 67 tagged as v1.0

= Examples and Usage =
The following are example v1.1 compliant 1D data files containing [besides essential metadata] - right-click & save as to view, stylesheet is on the TRAC site: 
SANS data only [[media:ISIS_SASXML_v1_1_SANS_Example.XML | ISIS_SASXML_v1_1_SANS_Example.XML]] 
Wavelength-dependent transmission [[media:ISIS_SASXML_v1_1_Transmission_Example.XML | ISIS_SASXML_v1_1_Transmission_Example.XML]] 
Wavelength-dependent monitor spectrum [[media:ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML | ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML]] 
Wavelength-dependent detector efficiency ratio [[media:ISIS_SASXML_v1_1_Det_Efficiency_Example.XML | ISIS_SASXML_v1_1_Det_Efficency_Example.XML]] 

The files can be usefully displayed in many web browsers: [[Rendering_canSAS1D_in_Web_Browsers]]

[[Category:Working Groups]]

Data Formats Working Group

2012-10-16T13:39:23Z

Tobias Richter: /* Members */

= Latest News =

[[User:Ajj|Ajj]] July 31st 2012 : [[2012 Data Discussion| canSAS 2012 Data Formats discussion page]]

= Links =

* '''mailing list''': [http://smallangles.net/pipermail/cansas-1dwg_smallangles.net/ http://smallangles.net/pipermail/cansas-1dwg_smallangles.net/]

===1D===

* '''Documentation''': [http://www.cansas.org/formats/canSAS1d/v1.1/doc http://www.cansas.org/formats/canSAS1d/v1.1/doc]
* '''TRAC''': [http://www.cansas.org/trac http://www.cansas.org/trac]
* '''Subversion''': [http://www.cansas.org/svn/1dwg http://www.cansas.org/svn/1dwg]

===Multi-dimensional===

* '''Documentation''': [http://www.cansas.org/formats/canSAS2012/v1.0/doc http://www.cansas.org/formats/canSAS2012/v1.0/doc]
* '''TRAC''': [http://www.cansas.org/trac http://www.cansas.org/trac]
* '''Subversion''': [http://www.cansas.org/svn/1dwg http://www.cansas.org/svn/canSAS2012]

= Members =
* Andrew Jackson (ESS)
* Pete Jemian (APS)
* Steve King (ISIS)
* Ken Littrell (ORNL)
* Andy Nelson (ANSTO)
* Ron Ghosh (ILL)
* Jan Ilavsky (APS)
* Tobias Richter (DLS)

= Timeline =
* 2007-12-31 agree on v1.0 format
* 2008-01-01 start implementing v1 at facilities
* 2008-06 representative sampling of data available for inter-facility comparison
* 2008-11-3 presentation of results at NOBUGS2008 meeting ([http://www.nbi.ansto.gov.au/nobugs2008 http://www.nbi.ansto.gov.au/nobugs2008])
* 2009-05-12 tagged SVN changeset 67 as v1.0 since it has been unmodified since January
* 2009-09-17 Agreed that v1.1 revision should be forthcoming with corrections/additions to be identified in TRAC tickets

= Status =
[[User:Jemian|Jemian]] 11:10, 06 September 2008 (CDT) IgorPro GUI tool included in Irena [http://usaxs.xor.aps.anl.gov/staff/ilavsky/irena.html Irena] analysis suite 
[[User:Jemian|Jemian]] 13:08, 14 March 2008 (EDT) IgorPro tool to read cansas1d/1.0 XML files available 
[[User:Jemian|Jemian]] 13:38, 25 February 2008 (EST) starting to add case studies 
[[User:Jemian|Jemian]] 00:39, 21 December 2007 (EST) complete first draft (v0.1a) ready for comments from 1DWG 
[[User:Jemian|Jemian]] 12:00, 14 December 2007 (EST) draft status updated 
[[User:Jemian|Jemian]] 17:07, 12 May 2009 (EDT) changeset 67 tagged as v1.0

= Examples and Usage =
The following are example v1.1 compliant 1D data files containing [besides essential metadata] - right-click & save as to view, stylesheet is on the TRAC site: 
SANS data only [[media:ISIS_SASXML_v1_1_SANS_Example.XML | ISIS_SASXML_v1_1_SANS_Example.XML]] 
Wavelength-dependent transmission [[media:ISIS_SASXML_v1_1_Transmission_Example.XML | ISIS_SASXML_v1_1_Transmission_Example.XML]] 
Wavelength-dependent monitor spectrum [[media:ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML | ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML]] 
Wavelength-dependent detector efficiency ratio [[media:ISIS_SASXML_v1_1_Det_Efficiency_Example.XML | ISIS_SASXML_v1_1_Det_Efficency_Example.XML]] 

The files can be usefully displayed in many web browsers: [[Rendering_canSAS1D_in_Web_Browsers]]

[[Category:Working Groups]]

2012 Data Discussion Examples

2012-08-10T16:00:16Z

Tobias Richter: add missing _indices for time and other parameters

= Key examples =

see these for a quick overview:

* generic
* pathological

= 1D =

== example of simple 1D SAS data, I(Q) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=0
@I_axes="Q"
I: float[100]
Q: float[100]
</pre>
(see the Discussion page for an XML representation with the recommended minimum content)

== example of simple 1D SAS data in a time series, I(Q, t) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=1
@I_axes="Time,Q"
@Time_indices=0
I: float[nTime,100]
Q: float[100]
Time: float[nTime]
</pre>

== example of generic 1D SAS data in a time series, I(Q(t), t) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=0,1
@I_axes="Time,Q"
@Time_indices=0
I: float[nTime,100]
Q: float[nTime,100]
Time: float[nTime]
</pre>

<hr/>

= 2D =

== example of simple 2D (image) SAS data, I(Q) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=0,1
@I_axes="Q,Q"
I: float[100, 512]
Qx: float[100, 512]
Qy: float[100, 512]
</pre>

== example of a simple masked 2D (image) SAS data, I(Q) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=0,1
@I_axes="Q,Q"
@Mask_indices=0,1
I: float[100, 512]
Qx: float[100, 512]
Qy: float[100, 512]
Mask: int[100, 512]
</pre>

== example of generic 2D SAS data, I(Q) ==

Could use this model, for example, to describe data from multiple detectors (by listing individual pixels off all detectors). Or, could describe data from one detector of any geometry. This is the most flexible.

<pre>
SASroot
SASentry
SASdata
@Q_indices=0
@I_axes="Q"
I: float[100*512]
Qx: float[100*512]
Qy: float[100*512]
Qz: float[100*512]
</pre>

== example of simple 2D SAS/WAS data, Isas(Q) & Iwas(Q) ==

Consider the multi-technique experiment that produces
small-angle and wide-angle scattering data images.
The reduced data results in images as well.
Each image might be described separately (see
[[2012_Data_Discussion_Examples#example_of_SAS_data_with_several_detectors.2C_I.28Q.29
| example of SAS data with several detectors]] for an alternative).
Here the SAS data image is 100 x 512 pixels.
The WAS data (not covered by this canSAS standard) is 256 x 256 pixels.

<pre>
SASroot
SASentry
SASdata
@name="sasdata"
@Q_indices=0,1
@I_axes="Q,Q"
I: float[100, 512]
Qx: float[100, 512]
Qy: float[100, 512]
SASdata
@name="wasdata"
@Q_indices=0,1
@I_axes="Q,Q"
I: float[256, 256]
Qx: float[256, 256]
Qy: float[256, 256]
</pre>

== example of 2D SANS and 2D SAXS, In(Q) & Ix(Q) ==

Consider the multi-technique experiment that produces
small-angle neutron and X-ray scattering data.
Here the SANS data image is 100 x 512 pixels and
the SAXS data is 256 x 256 pixels.

<pre>
SASroot
SASentry
SASdata
@name="sans"
@Q_indices=0
@I_axes="Q"
I: float[100*512]
Qx: float[100*512]
Qy: float[100*512]
SASdata
@name="saxs"
@Q_indices=0
@I_axes="Q"
I: float[256*256]
Qx: float[256*256]
Qy: float[256*256]
</pre>

= 2D with additional varied parameters =

== example of generic 2D SAS data in a time series, I(Q(t),t) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=0,1
@I_axes="Time,Q"
@Time_indices=0
I: float[nTime,100*512]
Qx: float[nTime,100*512]
Qy: float[nTime,100*512]
Qz: float[nTime,100*512]
Time: float[nTime]
</pre>

== example of 2D SAS data as images in a time series with a time-independent mask, I(Q(t),t) ==

This example explores a bit of complexity added to the previous example.

<pre>
SASroot
SASentry
SASdata
@Q_indices=0,1,2
@I_axes="Time,Q,Q"
@Mask_indices=1,2
@Time_indices=0
I: float[nTime,100,512]
Qx: float[nTime,100,512]
Qy: float[nTime,100,512]
Qz: float[nTime,100,512]
Time: float[nTime]
Mask: int[100,512]
</pre>

== example of generic 2D SAS data in a time, T, & P series, I(t,T,P,Q(t,T,P)) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=0,1,2,3
@I_axes="Time,Temperature,Pressure,Q"
@Time_indices=0
@Temperature_indices=1
@Pressure_indices=2
I: float[nTime,nTemperature,nPressure,100*512]
Qx: float[nTime,nTemperature,nPressure,100*512]
Qy: float[nTime,nTemperature,nPressure,100*512]
Qz: float[nTime,nTemperature,nPressure,100*512]
Time: float[nTime]
Temperature: float[nTemperature]
Pressure: float[nPressure]
</pre>

== example of generic 2D SAS data (images) in a time, T, & P series, I(T,t,P,Q(t)) ==

<pre>
SASroot
SASentry
SASdata
@Q_indices=1,3,4
@I_axes="Temperature,Time,Pressure,Q,Q"
@Time_indices=1
@Temperature_indices=0
@Pressure_indices=2
I: float[nTemperature,nTime,nPressure,100,512]
Qx: float[nTime,100,512]
Qy: float[nTime,100,512]
Qz: float[nTime,100,512]
Time: float[nTime]
Temperature: float[nTemperature]
Pressure: float[nPressure]
</pre>

== example of SAS data with several detectors, I(Q) ==

Here, the data are appended to common data objects.
This hypothetical case has reduced data derived from
three detectors, Ia(Q), Ib(Q), and Ic(Q):
* Ia(Q) is derived from a 2D detector (100 x 512 pixels)
* Ib(Q) is derived from a 1D detector (2000 pixels)
* Ic(Q) is derived from a 2D detector (256 x 256 pixels)

Data from a SAXS/MAXS/WAXS instrument might be represented thus.

<pre>
SASroot
SASentry
SASdata
@Q_indices=0
@I_axes="Q"
I: float[100*512 + 2000 + 256*256]
Qx: float[100*512 + 2000 + 256*256]
Qy: float[100*512 + 2000 + 256*256]
Qz: float[100*512 + 2000 + 256*256]
</pre>

<hr/>

= invalid case =

== example of **over-simple** 2D (image) SAS data, I(Q) ==

Invalid because the method of addressing the Q values
is different from all the above.

<pre>
SASroot
SASentry
SASdata
@Q_indices="*,*"
@I_axes=" ??? "
I: float[100, 512]
Qx: float[100]
Qy: float[512]
</pre>

= terms =

== SASroot ==
same use as original 1D format
== SASentry ==
some changes from the original 1D format

needs a ''version'' attribute that describes the version of the canSAS definition of SASentry (use version="1.0")

== SASdata ==
different use from original 1D format, refers to a single reduced data set that can be represented thus (such as from one detector)

SASdata has some possible attributes, as shown in this example:

<pre>
@Q_indices=1,3,4
@I_axes="Temperature,Time,Pressure,Q,Q"
@Mask_indices=3,4
</pre>

To indicate the dependency relationships of other varied parameters, use attributes similar to ''@Mask_indices'' (such as ''@Temperature_indices'' or ''@Pressure_indices'').

=== @Q_indices ===
Array attribute that describes which indices (of the I data object) are used to reference Q.
The items in this array use zero-based indexing.

=== @I_axes ===
Comma-separated list that describes the names of the data objects that correspond to the indices of the I object.

=== @Mask_indices ===
Array attribute that describes which indices (of the I data object) are used to reference Mask.
The items in this array use zero-based indexing.

= Algorithm for Readers =

User:Tobias Richter

2012-07-28T15:53:43Z

Tobias Richter: Created page with "Diamond Light Source Small Angle Scattering Data Acquitision Scientist (I22 and B21) NeXus respresentative"

Diamond Light Source

Small Angle Scattering Data Acquitision Scientist (I22 and B21)

NeXus respresentative

2012 Data Discussion

2012-07-28T13:01:49Z

Tobias Richter: /* Suggest format framework */ add Jerome's comments

*The following is the agenda of work posted under business for [[canSAS-2012]]. Please add comments in the appropriate section below:

= Agenda with Discussion =

== 1D Format ==
=== Agree a proposed extension of the current 1D standard ===
* This is an extension proposed by Steve King (ISIS) that is required to enable, for example, t-o-f instruments to store auxillary wavelength-dependent non-I(Q) data in the same output files
** see Section 1.6.5 in [http://svn.smallangles.net/trac/canSAS/browser/1dwg/tags/v1.0/doc/cansas-1d-1_0-manual.pdf?format=raw here]
** and look at this [http://svn.smallangles.net/trac/canSAS/browser/1dwg/data/Glassy%20Carbon/ISIS/GLASSYC_C4G8G9_withTL.xml example]
** or [http://www.smallangles.net/wgwiki/images/f/f5/ISIS_SASXML_v1_1_Monitor_Spectrum_Example.XML this] one
=== Agree resultant changes to the "official" schema/stylesheet ===
{{Comment|SMK|For clarity, this extension was proposed ''after'' adoption of the existing version of the standard. Ratification of this extension at CanSAS-2012 would give facilities/software developers the necessary confidence to implement it.}}

{{Comment | SMK | This proposed extension would allow more-or-less any non-I(Q) data to be included in a CanSAS-1D data file under a suitable foreign namespace. That is remarkable flexibility, and it does not require any significant revision of the existing standard. However, it could be argued that certain types of non-I(Q) data are so integral to a SAS experiment that they should instead be given explicit SASXML tags within the standard? Transmission data is a good example of this: the existing standard explicitly includes a tag for the transmission value from a ''monochromatic'' measurement (SASsample\transmission) but makes no provision for transmission values from ''white beam'' measurements. The proposed foreign namespace extension will make such provision possible ''but only'' as an extension, not as a formal part of the standard. Is that acceptable? The downside of explicitly adding new SASXML tags to the existing standard is that it would require issuing a new version of the standard.
}}
{{Comment | ARJN | I would recommend that during this meeting that the current format then be 'parked', the new 2D format should be flexible enough to handle 1D and 2D data.
}}
{{Comment | SMK | Agreed.
}}
{{Comment | ARR | Perhaps we should be cautious about suggesting no further development for the existing 1-D format. Unless there is scope for adapting to future needs, it will be seen as not suitable for new uses. This, of course, does not imply that there have to be active plans for further changes at present.
}}
{{Comment | AJJ | As to this particular case, I suggest that since SMK and I have it done, that we accept the additional tags, call it v1.1 and move on. If other extensions arise later and become "widely" used, then we can incorporate them as they arise. This is the key benefit of using an extensible format.
}}
{{Comment | ARJN | Just as a matter of interest, why is it necessary to include transmission measurements for TOF instruments? Does the analysis depend on these values? Not saying it's not necessary, just wondering about why it is useful.
}}

== 2D Format ==
=== Define minimum information necessary for reduced data ===
* definition of what '''reduced''' data is and hence the problems we should address.
* review previous discussions on 2D
* considerations specific to 2D reduced data
* consider forward looking issues such as
** grazing incidence
** event mode analysis

=== Suggest format framework ===
* NeXus extension, canSAS 1D extension, other, with brief discussion of the reason for the choice (including options considered, pros and cons of each, and final weighing)
** compare with NeXus definitions for:
*** [http://download.nexusformat.org/doc/html/ClassDefinitions-Application.html#NXsas '''NXsas''']
*** [http://download.nexusformat.org/doc/html/ClassDefinitions-Application.html#NXiqproc '''NXiqproc''']

----
* A proposal for a 2D version of the canSAS 1D data format has been posted for discussion: [[2D Data Format Proposal]]
* NeXus has a definition for multi-dimensional data:
** http://download.nexusformat.org/doc/html/ClassDefinitions-Application.html#NXsas
** http://svn.nexusformat.org/definitions/trunk/applications/NXsas.nxdl.xml

{{Comment | ARJN | Having looked at both those Nexus definitions it is not clear to me how:
** multiple detectors are handled.
** What happens if the detector pixels are not grid shaped?
** how does one stuff multiple datasets (e.g. from event mode acquisition)?
Remember, all we need is instrument independent information in this file, nothing else.
:[[User:Andyfaff|Andyfaff]] 12:45, 27 July 2012 (CDT)
}}

----
* James Hester (an expert in the CIF format) has compelling ideas on the subject of common data files. [[CIF format notes Hester]]

* Andrew Nelson has commented via email exchange with Adrian Rennie : [[Email ARJN ARR | Notes on Reduced Data formats with examples from reflectometry]]

----

* Ron Ghosh has laid out details of a proposal to use HDF5/Nexus : [[HDF5 Notes Ghosh]]

----

* Peter Boesecke misses definitions of parameters that are needed to describe small-angle and wide-angle scattering experiments. Parameters like "Distance", "Center", "Rotation" have only a meaning when they are part of a geometrical model, otherwise they are useless. He has collected parameters that are required for SAS/WAS experiments with position sensitive detectors (1D and 2D). When saving experimental data it should be checked that these parameters are either implicitly or explicitly described by the supplied metadata: [[User:Boesecke | SX_parametrization]].

----

* Jerome Kieffer sent the following to consider: [[Jerome Kieffer Mail]]

=== Guide to how to make implementation easy. ===
=== Create straw format suitable for test/demonstration use and convert some test data for such a demonstration.===
=== Provide a plan for presentation at SAS 2012 ===

[[Category: canSAS 2012]]

Jerome Kieffer Mail

2012-07-28T13:01:23Z

Tobias Richter: Created page with "<pre> >Dear Adrian, > >As I explained to Claudio, I do not have time to >attend to your meeting in Upsala, this week-end and I apologies. >Nevertheless here are a couple of i..."

<pre>
>Dear Adrian,
>
>As I explained to Claudio, I do not have time to
>attend to your meeting in Upsala, this week-end and I apologies.
>Nevertheless here are a couple of information
>about what I am doing in SAXS, and especially
>for BioSaxs (Beamline BM29 fromerly ID14-3 at ESRF).
>
>* 2D storage of data: we use FabIO which has
>been re-written for the "ESRF Data Format" to
>accommodate multiple frames per file to keep
>together intensity and pixel variance
>(uncertainties). Please have a look at the draft
>of "fabio.pdf". Curated 2D data could probably
>benefit from HDF5 storage using the NeXus convention.
>
>* Data reduction can be made by various ways ...
>in pyFAI (see attached submitted publication) we
>aim at best performances for all ... SAXS being
>very simple in this aspect (no tilt, no problem)
>this library can nevertheless be used for SAXS
>and will be put in production on the BioSaxs
>beamline this fall. A 40x improvement in the data-reduction speed is expected.
>
>* 1D storage: I have very little ideas about
>that as some program (ATSAS) enforces 3 column
>ascii (q/I/sigma) with 1 line header. Unless my
>scientists accept to change _OR_ Dmitri changes
>his interface, I see little chance to see
>another format emerging; especially not the
>over-vebose XML cansas tries to promote. Once
>again HDF5 could be an option but we are not using it here (because of ATSAS).
>
>I attached as well some slides presenting what
>is ongoing on the BioSaxs beamline on the data analysis side.
>
>With my best regards,
>
>--
>Jérôme Kieffer
</pre>