User's Guide

NOAAFTP

Automatically transfer pending scenes from NOAA

Function:

Automatically transfer pending scenes from NOAA

Parameters:

TIME_ACQUIRE(60)
Acquire time. Time (in minutes from current acquisition time) to wait before attempting an ftp acquisition. This will usually be set to 60 minutes when getting DOMSAT scenes via ftp, and set to at least 180 minutes when getting DOMSAT scenes via the satellite dish (extend the time when using the dish to keep NOAAFTP from getting them before the dish does). When the DOMSAT dish is being used, NOAAFTP should only be downloading MISSED scenes.

LOGFILE(--)
Log file. Name of the log file to write all processing messages to. If defaulted, "noaaftp" within the ADAPSLOG directory will be used. LOGFILE will have a ;log extension.

Example:

    LAS> NOAAFTP LOGFILE="[somedir]noaaftp"

    NOAAFTP will identify and download any pending scenes from the NOAA server. Processing messages and errors will be written to "[somedir]noaaftp;log".

Description/Algorithm:

NOAAFTP makes a copy of the master schedule listing. This schedule is searched for scenes identified as "pending" scenes. For "pending" scenes which are TIME_ACQUIRE minutes past their local acquisition time, an attempt is made to download them from the NOAA server and move them into the "acquire" directory for processing. A schedule "modify-by-scene-id" directive file is generated to change the status of the scene from "Pend" to "Disk" in the schedule. Processing messages and error messages are written to LOGFILE.

Nonfatal Error Messages:

  1. [noaaftp-tran] Failed to transfer pending scene

    The specified scene was not successfully transferred from the NOAA server. This failure is most likely caused by the image not existing on the NOAA server (see User Note).

Fatal Error Messages:

  1. [noaaftp-cwd] Error determining current working directory

    An error occurred while attempting to determine the current working directory. Contact the system administrator if this error persists.

  2. [noaaftp-prd] Error determining processing directory

    The directory to process in could not be determined. Verify that the ADAPSACQ directory exists, and that the "noaaftp" subdirectory exists.

  3. [noaaftp-lis] Error generating master schedule copy

    A copy of the master schedule could not be made. Ensure that the master schedule exists with the proper file permissions.

  4. [noaaftp-pasw] Error retrieving NOAA password from file

    The NOAA server password could not be read from the appropriate file. Make certain that your user id has been validated for this password.

  5. [noaaftp-pend] Error determining pending scene

    An error occurred while reading the schedule to determine a pending scene. Ensure that the master schedule has not been corrupted.

  6. [noaaftp-schd] Error generating schedule update file

    An error occurred while trying to generate a "modify-by-scene-id" schedule update file. Contact the system administrator if this error persists.

  7. [noaaftp-ceos] Error determining CEOS id of image

    The CEOS id of the downloaded image could not be determined. Examine the filename syntax of the downloaded image to determine its origin, and rename it accordingly. See User Note for more details.

  8. [noaaftp-move] Error moving downloaded scenes

    The downloaded scene could not be moved and renamed for processing. Contact the system administrator if this error persists.

  9. [noaaftp-org] Error returning to original working directory

    NOAAFTP was unable to return to the users original working directory. Ensure that this directory still exists.

  10. [noaaftp-sysm] Must be on edcsgs20 to execute NOAAFTP

    This module must be executed on edcsgs20 for the acquisition process to complete properly. Restart this module from edcsgs20.

  11. [noaaftp-dels] Error deleting copy of master schedule

    The copy of the master schedule could not be deleted. Contact the system administrator if this error persists.

  12. [noaaftp-fatal] Fatal error encountered

    A fatal error was encountered, refer to the message preceding this message for more details.

User Notes:

  1. The file naming convention on the NOAA server is as follows:

       NSS.tttt.Nl.Dyyddd.Shhmm.Ehhmm.Bnnnnnnn.xx
    
       where:
         NSS        Standard header
         tttt	LHRR  LAC scenes
    		HRPT  HRPT scenes
         Nl         NOAA satellite letter (J for 14, K for 15)
         Dyyddd     Acquisition date, 2 digit year, 3 digit julian
         Shhmm      Acquisition starting time (hour and minute)
         Ehhmm      Acquisition ending time (hour and minute)
         Bnnnnnnn   No explanation
         xx         GC Gilmore Creek receiving station
                    WI Wallops Island receiving station
    
    
  2. NOAAFTP will try to match the desired scene on the NOAA server within 3 minutes until it is successful. This strategy may result in multiple unsuccessful transfer attempts.

    
        Example: first try "'NSS.LHRR.NJ.D97003.S2358.E*'", if failure
                  then try "'NSS.LHRR.NJ.D97003.S2359.E*'", if failure
                  then try "'NSS.LHRR.NJ.D97003.S2357.E*'", if failure
                  then try "'NSS.LHRR.NJ.D97003.S2360.E*'", if failure
                  then try "'NSS.LHRR.NJ.D97003.S2356.E*'", if failure
                  then try "'NSS.LHRR.NJ.D97003.S2361.E*'", if failure
                  then try "'NSS.LHRR.NJ.D97003.S2355.E*'", if failure
                  give up!
    
  3. The EROS 16-character scene id will be given the following suffix:

          no2   Wallops Island receiving station, NOAA-14 scene
          ng2   Gilmore Creek receiving station, NOAA-14 scene
          no3   Wallops Island receiving station, NOAA-15 scene
          ng3   Gilmore Creek receiving station, NOAA-15 scene
          000   Unknown
    
    
  4. Toggling between DOMSAT acquisition systems:

    Using the local DOMSAT dish:

       - Must have the two INHALE processes running on VAXH.
       - Run AUDITSCH with CEOSIDS=SFL,NGC,NOA.
         This will enable the software on edcsgs20 to look in the ingest logs
         to determine when live and DOMSAT scenes have been acquired on VAXH
         (and generate schedule directive files to update the master schedule
         to signify the scenes have been acquired).
       - Run NOAAFTP with TIME_ACQ=180 minutes or more.  Extending this time
         will prevent NOAAFTP from downloading scenes before they get
         transmitted to the DOMSAT dish (NOAAFTP should only be downloading
         MISSED acquisitions when utilizing the DOMSAT dish).
       - When scheduling run XSCHED with the domsat flag as follows:
       	xsched printer1 printer2 domsat
         This allows the schedule to be pushed to vaxh.
    

    Using the ftp link to the NOAA server:

       - Must NOT have the two INHALE processes running on VAXH.
       - Run AUDITSCH with CEOSIDS=SFL.  When NOAAFTP downloads a scene from
         the server, it will generate a schedule directive file (to update
         the master schedule to signify the scene has been acquired).
         AUDITSCH only needs to look in the log files for SFL scenes to
         determine when they have been acquired.
       - Run NOAAFTP with TIME_ACQ=60 minutes (start looking for NGC scenes,
         NOA scenes, missed SFL scenes on the NOAA server 1 hour after their
         acquistion time).
       - When scheduling run XSCHED without the domsat flag:
       	xsched printer1 printer2
         This prevents the schedule from being pushed to vaxh.