A SAX NFI FOT is a set of individual files - either stored on tape or in a directory on a magnetic disk - which represent all the data acquired by all the NFIs during a FOT Observing Period (FOP). This is defined to be a period during which the satellite was kept pointing at the same position in the sky. In addition to the instrument-specific data a NFI FOT contains files detailing the time evolution of general satellite data (position, velocity, attitude, etc.) during the FOP and other auxiliary information. For more details on the types of files on SAX FOTs, please consult [3].
Please note: In case of lacking information about the satellite's attitude during the FOT observing period (for instance due to the non presence of an ATTITUDE file on the FOT) the calculation of the auxiliary ephemeris quantities (AEQs) cannot be carried out. Since these quantities are utilized for event selection purposes during pipeline processing (see for instance stage III of lecspipe) their lack may result in an undesired loss of "scientifically" senseful source photons. In order to avoid this scenario foting will in case of missing attitude information calculate the AEQs on the basis of an assumed constant satellite attitude. The constant attitude values shall be derived from the "Alpha/Delta/Roll" fields in the INSTDIR file on the FOT. (see also description of parameter fakeauxqts below).
type of FOT file | type of FITS file | Bintable ext. | comment |
---|---|---|---|
EPHEMERIS | SAXLEDAS HK [2]
Multi-Bintable | 3th | fully implemented |
ATTITUDE | SAXLEDAS HK [2]
Multi-Bintable | 4th | fully implemented |
LEHKD001 LECS Response Bus HK | SAXLEDAS HK [2] Multi-Bintable | 2nd | fully implemented |
LEENG001 LECS Engineering HK | - | - | not implemented |
LEDIR001 LECS Direct Mode | SAXLEDAS Event list [2] Multi-Bintable | 2nd | fully implemented |
LEIND001 LECS Indirect Mode | OGIP Spectrum [4] Multi-Bintable | 1st | not yet implemented |
LEIMA001 LECS Image Mode | Standard Image [5] | 0th | not yet implemented |
Warning: This is an old-style attitude file - no information on star tracker configuration is available. The STR_CONF column of the ATTITUDE extensions of all HK files will be filled with NULL values.Attitude files created before January 1997 do not contain information about the star tracker configuration that was used during the observation. Since this information is currently (01/97) not being used for data analysis purposes it is not fatal and can be ignored.
Warning: gap of XXXX s in attitude data between records #x and #yA gap larger than the nominal data granularity of 0.5 s has been found between two consecutive attitude records. This is an unforeseen condition which could be problematic if the gap is significantly larger than a few seconds. As described above, the calculation of the auxiliary ephemeris quantities (AEQ) depends on the attitude data and, consequently, the AEQs will be incomplete in case of data gaps. Since the AEQs are used for event screening purposes in the data analysis pipeline, missing attitude data might result in the partial loss of "scientifically" useful event data. Please contact the SAX SDC and request a re-processed FOT with corrected attitude data or consider re-ingesting the FOT with the parameter fakeauxqts set to "yes".
ReadAndDecodeAttitudeFile: Attitude record X (starting at byte position x) has unexpected structure."It has been found that attitude record X has not the nominal structure with respect to the number and/or type of expected data fields. This might cause the reading process to get "out of synchronization" and, in this case, lead to the loss of all attitude data after the reported record X with the potential consequences as outlined above.
Warning: time tag of record #x is identical to previous one - ignoring this record.This indicates a repeated record in the attitude file which is not fatal.
ReadAndDecodeAttitudeFile: Warning: Unexpected EOF or read error encountered " while reading record #X of attitude file.In most cases, this message will indicate an inconsistency between the actual number of records found in the attitude file and the size of this file as specified in the tape directory. This condition is not fatal unless the lack of attitude data will lead to the loss of event data as described in the above scenario.
Error: DoPolyFit: Routine `DPOLFIT' failed to find a polynomial of maximum degree X - return code is YIt has not been possible to find a polynomial fit to the OBT-UTC data with a maximum degree X which satisfies the specified RMS criterion. This is a serious condition and execution cannot continue after this point. Please refer to the above hints about the OBT-UTC data treatment in order to proceed from here.
Error: ReadCheckSumValidationFlag: Error reading checksum validation flag of packet X
Error: ReadPrimaryHeader: Error reading primary header of packet X
Error: ReadSecondaryHeader: Error reading secondary header of packet X
Error: Read_DM_TertiaryHeader: Error reading tertiary header of packet X
Error: Read_DM_DataPacket: Error reading Direct Mode data packet X
Error: ReadRBHK_DataPacket: Error reading HK packet XThese set of errors indicate that an attempt to read a data packet from a HK or Direct Mode file has failed for either of the following reasons:
Warning: null/corrupted HK packet X/Y at byte position ZSubpacket Y of HK packet X (see [3] for structure of HK data on FOT) starting at byte position Z in the FOT file was found to either consist of null or any other non-plausible data items. This condition is not fatal - the erroneous packet will be ignored and execution will continue normally.
Warning: All HK packets X/Y-Z are invalid and have been skippedAn entire, consecutive group of subpackets, viz. Y - Z, within the HK packet with sequence number X was found to be corrupted, i.e., filled with null or non-plausible data. As in the above case, this condition is not fatal. Execution will normally continue after the erroneous packets have been discarded from the packet stream.
Error: IngestDirModeFile: No observation interval has yet been defined - cannot proceedA HK or science file is to be decoded but no observation directory file has been read so far. This is a fatal condition and execution cannot continue after this point. Presumably, the FOT does not contain the required FOT file OBSDIR - please contact the SDC about this problem.
Warning: change in AE discriminator parameter XXX from packet #A to #B - old/new value: X/YBetween the two consecutive Direct Mode packets #A and #B, an Analogue Electronic discriminator parameter has changed its value from X to Y. This warning message is insignificant and can be ignored.
Warning: Packets X and Y have identical sequence numbers - ignoring the first oneThe current Direct Mode packet and the following one have identical sequence numbers. This indicates that a bus conflict has occured and the second packet is the re-transmitted version of the first one. The first packet will be discarded from the packet stream and execution will continue normally.
Warning: X packet(s) missing - sequence counters increases from #A to #B between packets #Y and #ZA jump in the sequence counters between two consecutive Direct Mode data packets was detected, i.e., a certain number of packets is missing. This can be the result of telemetry drop-outs or, in case of bright sources, loss of packets due to telemetry bandwidth limitations. In any case, the condition is insignificant for the decoding process. Please note that foting will create a Good Time Interval (GTI) extension in the event list FITS file corresponding to the Direct Mode file which is being decoded. In this GTI extensions, all phases of lacking data packets will be properly considered. This is necessary to enable downstream software to compute correct count rates.
Warning: Sequence counter of packet #X is completely out of bounds - should be: #A, is: #B - ignoring this packetA packet with an apparently incorrect sequence counter has been found. The cause of this problem is unknown. The packet is ignored and execution will continue normally.
Warning: Packet X is invalid and has been ignoredThe Direct Mode packet X has been found to contain non-sensible data and is ignored - execution will continue normally.
Warning: time between events (A/B) and (C/D) has increased by about 64s (actual difference: Xs, change in OBT: 0x........ -> 0x........) - all subsequent time tags will be correctedand later
Warning: time between events (E/F) and (G/H) has decreased by about 64s (actual difference: Ys, change in OBT: 0x........ -> 0x........) - this is the counterpart of a +64s jump that has occured earlierIt is likely that a large number of these pairs of messages will be issued (only on verbosity level 3) during execution. The cause of the reported "+/-64s effect" is complex but understood. In brevity, it due to a combination of errors in the LECS's Electronic Unit and the FOT production software which causes the time tags of a range of events within a single or even over multiple packets to be too high by 64 seconds. foting fully corrects for this effect and the issued warning messages can be ignored.
Warning: The absolute time difference is larger than 64s - this must not happen - ignoring the rest of the packetThe program had detected a +64s time jump earlier and now found the time between two consecutive events to decrease. However, the absolute difference is larger than the anticipated 64s which is an illegal condition. The rest of the packet will be ignored.
Warning: time between events (A/B) and (C/D) has decreased by Xs (change in OBT: 0x........ -> 0x........) - ignoring the rest of the packetThis is an illegal condition which should not occur. In any case, execution will continue normally after the rest of the packet has been ignored.
Warning: time between events (A/B) and (C/D) has increased by more than 5s (actual difference Xs, change in OBT: 0x........ -> 0x........)A time jump of more than 5s between two consecutive events within a packet or across a packet boundary has been found. This is an unforeseen condition and will result in the creation of a new GTI entry in the GTI extension. Apart from this, execution will continue normally.
Warning: event (X/Y) is corruptedThe data corresponding to event X in packet Y were found to be invalid, i.e., null or out of bounds. The affected event will simply be ignored and execution will continue normally. It is likely that many of these messages will be generated with event numbers close to 130, i.e., at the end of a data packet (one Direct Mode packet contains originally 133 events). This is due to an error in the FOT production software which does not properly update the event counter in the secondary header after having removed the so-called "dummy time events" from the original packet as generated by the instrument. For more detailed information about this problem see [3] and [6].
WriteAttitudeExt: Warning: No attitude data is available - will create empty attitude extensionor
WriteEphemerisExt: Warning: No ephemeris data is available - will create empty ephemeris extensionThis warning message is issued when foting tries to create the ASPECT/EPHEMERIS extension of a HK FITS file, but no attitude/ephemeris data have previously been read. This situation can arise if the FOT does not contain complete attitude/ephemeris data or no attitude/ephemeris data at all (no file ATTITUDE/EPHEMERIS). This is not a fatal condition for the foting run but will cause problems later on since the pipeline process will need to access this data. Please contact the SDC to obtain a FOT with complete attitude/ephemeris data.
LE_IngestExpconfFile: Warning: Unexpected EOF or read error encountered " while reading record #X of experiment configuration fileAn experiment configuration file contains information about the LECS's nominal configuration during a particular observation period. The above message indicates that this information is not complete or not present at all on the FOT. Please contact the SDC to get a complete FOT with proper experiment configuration files.
The above list represents only a subset of possible error/warning messages issued by foting. All other messages that might appear should be self-explanatory. If this is not the case or additional information is required, please contact the SDC.
[ID]type[tape]_XXXXXX_YY_Z.datThe various fields have the following meaning:
ID | - the instrument ID (e.g. le); empty (i.e. "") for non-instrument specific files |
type | - file type field from tape directory, e.g. ephemeris, ledir001, ... |
tape | - the word tape for "directory" files, e.g. tapedir, instdir, obsdir |
XXXXXX | - the zero-padded, six-digit FOT sequence number |
YY | - the observation number |
Z | - i, f, n or 0 depending on type of observing period ('inital slew', 'final slew', 'normal', 'common') |
In order to avoid undesired effects due to erroneous source coordinates it is recommended to provide the right values through ranom and decnom in case the FOT does not contain this information.
A corresponding warning message is issued by foting if the true source coordinates have not been read from the tape directory.foting instrument=LE+ME tapedev=/dev/rst1 nohk=yes
foting disk=yes indir=/fot outdir=$HOME instrument=LE
foting instrument=ALL