A SAX NFI FOT is a set of individual files - either stored on tape or in a directory on a magnetic disk - which represent all the data acquired by all the NFIs during a FOT Observing Period (FOP). This is defined to be a period during which the satellite was kept pointing at the same position in the sky. In addition to the instrument-specific data a NFI FOT contains files detailing the time evolution of general satellite data (position, velocity, attitude, etc.) during the FOP and other auxiliary information. For more details on the types of files on SAX FOTs, please consult [3].
Please note: In case of lacking information about the satellite's attitude during the FOT observing period (for instance due to the non presence of an ATTITUDE file on the FOT) the calculation of the auxiliary ephemeris quantities (AEQs) cannot be carried out. Since these quantities are utilized for event selection purposes during pipeline processing (see for instance stage III of lecspipe) their lack may result in an undesired loss of "scientifically" senseful source photons. In order to avoid this scenario foting will in case of missing attitude information calculate the AEQs on the basis of an assumed constant satellite attitude. The constant attitude values shall be derived from the "Alpha/Delta/Roll" fields in the INSTDIR file on the FOT. (see also description of parameter fakeauxqts below).
| type of FOT file | type of FITS file | Bintable ext. | comment |
|---|---|---|---|
| EPHEMERIS | SAXLEDAS HK [2]
Multi-Bintable | 3th | fully implemented |
| ATTITUDE | SAXLEDAS HK [2]
Multi-Bintable | 4th | fully implemented |
| LEHKD001 LECS Response Bus HK | SAXLEDAS HK [2] Multi-Bintable | 2nd | fully implemented |
| LEENG001 LECS Engineering HK | - | - | not implemented |
| LEDIR001 LECS Direct Mode | SAXLEDAS Event list [2] Multi-Bintable | 2nd | fully implemented |
| LEIND001 LECS Indirect Mode | OGIP Spectrum [4] Multi-Bintable | 1st | not yet implemented |
| LEIMA001 LECS Image Mode | Standard Image [5] | 0th | not yet implemented |
Warning: This is an old-style attitude file - no
information on star tracker configuration is available.
The STR_CONF column of the ATTITUDE extensions of all HK
files will be filled with NULL values.
Attitude files created before January 1997 do not contain information
about the star tracker configuration that was used during the observation.
Since this information is currently (01/97) not being used for data
analysis purposes it is not fatal and can be ignored.
Warning: gap of XXXX s in attitude data between records #x and #yA gap larger than the nominal data granularity of 0.5 s has been found between two consecutive attitude records. This is an unforeseen condition which could be problematic if the gap is significantly larger than a few seconds. As described above, the calculation of the auxiliary ephemeris quantities (AEQ) depends on the attitude data and, consequently, the AEQs will be incomplete in case of data gaps. Since the AEQs are used for event screening purposes in the data analysis pipeline, missing attitude data might result in the partial loss of "scientifically" useful event data. Please contact the SAX SDC and request a re-processed FOT with corrected attitude data or consider re-ingesting the FOT with the parameter fakeauxqts set to "yes".
ReadAndDecodeAttitudeFile: Attitude record X (starting at byte position x)
has unexpected structure."
It has been found that attitude record X has not the
nominal structure with respect to the number and/or type of expected
data fields. This might cause the reading process to get
"out of synchronization" and, in this case, lead to the loss of all
attitude data after the reported record X with the potential
consequences as outlined above.
Warning: time tag of record #x is identical to previous one - ignoring this
record.
This indicates a repeated record in the attitude file which is not fatal.
ReadAndDecodeAttitudeFile: Warning: Unexpected EOF or read error encountered "
while reading record #X of attitude file.
In most cases, this message will indicate an inconsistency between the actual
number of records found in the attitude file and the size of this file as
specified in the tape directory. This condition is not fatal unless the lack
of attitude data will lead to the loss of event data as described in the
above scenario.
Error: DoPolyFit: Routine `DPOLFIT' failed to find a polynomial of maximum
degree X - return code is Y
It has not been possible to find a polynomial fit to the OBT-UTC data
with a maximum degree X which satisfies the specified RMS
criterion. This is a serious condition and execution cannot continue after
this point. Please refer to the above hints
about the OBT-UTC data treatment in order to proceed from here.
Error: ReadCheckSumValidationFlag: Error reading checksum validation flag
of packet X
Error: ReadPrimaryHeader: Error reading primary header of packet X
Error: ReadSecondaryHeader: Error reading secondary header of packet X
Error: Read_DM_TertiaryHeader: Error reading tertiary header of packet X
Error: Read_DM_DataPacket: Error reading Direct Mode data packet X
Error: ReadRBHK_DataPacket: Error reading HK packet XThese set of errors indicate that an attempt to read a data packet from a HK or Direct Mode file has failed for either of the following reasons:
Warning: null/corrupted HK packet X/Y at byte position ZSubpacket Y of HK packet X (see [3] for structure of HK data on FOT) starting at byte position Z in the FOT file was found to either consist of null or any other non-plausible data items. This condition is not fatal - the erroneous packet will be ignored and execution will continue normally.
Warning: All HK packets X/Y-Z are invalid and have been skippedAn entire, consecutive group of subpackets, viz. Y - Z, within the HK packet with sequence number X was found to be corrupted, i.e., filled with null or non-plausible data. As in the above case, this condition is not fatal. Execution will normally continue after the erroneous packets have been discarded from the packet stream.
Error: IngestDirModeFile: No observation interval has yet been defined -
cannot proceed
A HK or science file is to be decoded but no observation directory file
has been read so far. This is a fatal condition and execution cannot continue
after this point. Presumably, the FOT does not contain the required FOT
file OBSDIR - please contact the SDC about this problem.
Warning: change in AE discriminator parameter XXX from packet #A to #B -
old/new value: X/Y
Between the two consecutive Direct Mode packets #A and #B, an Analogue
Electronic discriminator parameter has changed its value from X
to Y. This warning message is insignificant and can be ignored.
Warning: Packets X and Y have identical sequence numbers -
ignoring the first one
The current Direct Mode packet and the following one have identical
sequence numbers. This indicates that a bus conflict has occured and the
second packet is the re-transmitted version of the first one. The first
packet will be discarded from the packet stream and execution will continue
normally.
Warning: X packet(s) missing - sequence counters increases from
#A to #B between packets #Y and #Z
A jump in the sequence counters between two consecutive Direct Mode data
packets was detected, i.e., a certain number of packets is missing.
This can be the result of telemetry drop-outs or, in case of bright sources,
loss of packets due to telemetry bandwidth limitations. In any case, the
condition is insignificant for the decoding process. Please note that
foting will create a Good Time Interval (GTI) extension in the
event list FITS file corresponding to the Direct Mode file which is being
decoded. In this GTI extensions, all phases of lacking data packets
will be properly considered. This is necessary to enable downstream software
to compute correct count rates.
Warning: Sequence counter of packet #X is completely out of bounds -
should be: #A, is: #B - ignoring this packet
A packet with an apparently incorrect sequence counter has been found.
The cause of this problem is unknown. The packet is ignored and execution
will continue normally.
Warning: Packet X is invalid and has been ignoredThe Direct Mode packet X has been found to contain non-sensible data and is ignored - execution will continue normally.
Warning: time between events (A/B) and (C/D) has increased by about 64s
(actual difference: Xs, change in OBT: 0x........ -> 0x........) -
all subsequent time tags will be corrected
and later
Warning: time between events (E/F) and (G/H) has decreased by about 64s
(actual difference: Ys, change in OBT: 0x........ -> 0x........) -
this is the counterpart of a +64s jump that has occured earlier
It is likely that a large number of these pairs of messages will be issued
(only on verbosity level 3) during execution. The cause of the reported
"+/-64s effect" is complex but understood. In brevity, it due to a combination
of errors in the LECS's Electronic Unit and the FOT production software which
causes the time tags of a range of events within a single or even over
multiple packets to be too high by 64 seconds.
foting fully corrects for this effect and the issued warning
messages can be ignored.
Warning: The absolute time difference is larger than 64s - this must not
happen - ignoring the rest of the packet
The program had detected a +64s time jump earlier and now found the time
between
two consecutive events to decrease. However, the absolute difference is
larger than the anticipated 64s which is an illegal condition. The rest
of the packet will be ignored.
Warning: time between events (A/B) and (C/D) has decreased by Xs (change in
OBT: 0x........ -> 0x........) - ignoring the rest of the packet
This is an illegal condition which should not occur. In any case, execution
will continue normally after the rest of the packet has been ignored.
Warning: time between events (A/B) and (C/D) has increased by more than 5s
(actual difference Xs, change in OBT: 0x........ -> 0x........)
A time jump of more than 5s between two consecutive events within a packet or
across a packet boundary has been found. This is an unforeseen condition
and will result in the creation of a new GTI entry in the GTI extension.
Apart from this, execution will continue normally.
Warning: event (X/Y) is corruptedThe data corresponding to event X in packet Y were found to be invalid, i.e., null or out of bounds. The affected event will simply be ignored and execution will continue normally. It is likely that many of these messages will be generated with event numbers close to 130, i.e., at the end of a data packet (one Direct Mode packet contains originally 133 events). This is due to an error in the FOT production software which does not properly update the event counter in the secondary header after having removed the so-called "dummy time events" from the original packet as generated by the instrument. For more detailed information about this problem see [3] and [6].
WriteAttitudeExt: Warning: No attitude data is available - will create
empty attitude extension
or
WriteEphemerisExt: Warning: No ephemeris data is available - will create
empty ephemeris extension
This warning message is issued when foting tries to create the
ASPECT/EPHEMERIS extension of a HK FITS file, but no
attitude/ephemeris data have
previously been read. This situation can arise if the FOT does not contain
complete attitude/ephemeris data or no attitude/ephemeris data at all
(no file ATTITUDE/EPHEMERIS).
This is not a fatal condition
for the foting run but will cause problems later on since the
pipeline process will need to access this data. Please contact the
SDC to obtain a FOT with complete attitude/ephemeris data.
LE_IngestExpconfFile: Warning: Unexpected EOF or read error encountered "
while reading record #X of experiment configuration file
An experiment configuration file contains information about the LECS's
nominal configuration during a particular observation period.
The above message indicates that this information is not complete or
not present at all on the FOT. Please contact the SDC to get a complete
FOT with proper experiment configuration files.
The above list represents only a subset of possible error/warning messages issued by foting. All other messages that might appear should be self-explanatory. If this is not the case or additional information is required, please contact the SDC.
[ID]type[tape]_XXXXXX_YY_Z.dat
The various fields have the following meaning:
| ID | - the instrument ID (e.g. le); empty (i.e. "") for non-instrument specific files |
| type | - file type field from tape directory, e.g. ephemeris, ledir001, ... |
| tape | - the word tape for "directory" files, e.g. tapedir, instdir, obsdir |
| XXXXXX | - the zero-padded, six-digit FOT sequence number |
| YY | - the observation number |
| Z | - i, f, n or 0 depending on type of observing period ('inital slew', 'final slew', 'normal', 'common') |
In order to avoid undesired effects due to erroneous source coordinates it is recommended to provide the right values through ranom and decnom in case the FOT does not contain this information.
A corresponding warning message is issued by foting if the true source coordinates have not been read from the tape directory.foting instrument=LE+ME tapedev=/dev/rst1 nohk=yes
foting disk=yes indir=/fot outdir=$HOME instrument=LE
foting instrument=ALL