Overview

The Thermodynamic Profiling Software System is a software package that processes raw AERI data and meteorological surface observations in order to produce thermodynamic profiles and uncertainties using an optimal estimation method.  The principal components of TPSS are

  • rsync data transfer
  • Ingest of AERI and MET data
  • Quality control of data
  • Noise filtering of AERI data
  • Application of optimal estimation algorithm
  • Output of results and quicklooks

 

Setup and Customization

Prior to running TPSS, the retrieval configuration file (vip.txt), climatology and data transfer need to be configured.  Refer to ‘TPSS Customization Options’ guide.

 

TPSS File Structure

The files related to TPSS are in the directory:  c:/users/aeri/docker

  • Configuration files (see TPSS Customization Options)
    • /config
  • Input files
    • /raw: raw AERI data, directories of the form AEYYMMDD e.g. AE170601
    • /ceil: (optional) ceilometer data for cloud base height determination
    • /met: (optional) ground-based met data (temperature, pressure, relative humidity)
  • Executable scripts
    • /run: tpss.bat & tpss_stop.bat
  • Intermediary files
    • /ch1: ingested AERI ch1 data
    • /ch2: ingested AERI ch2 data
    • /nfch1: noise filtered AERI ch1 data
    • /sum: ingested AERI summary data
  • Diagnositic files
    • /logs: log files
    • /runflags: flags indicating running processes
  • Output files
    • /aerioe: output files and quicklooks

 

Running TPSS in Real-time Mode

In real-time mode, TPSS is run continuously in order to output results and quicklooks of the latest available AERI data.  It is recommended to select an appropriate temporal resolution (tres in vip.txt) to match the processing speed of the hardware being used.  To run TPSS in real-time mode:

  • Run Docker for Windows.  Note:  This is configured to start automatically at startup
  • Click on the tpss icon on the desktop

Or

  • Open Windows PowerShell and type

cd c:\Users\AERI\docker\run
.\tpss.bat

Note: By default, TPSS will always append to existing output data for the current UTC day.

 

Stopping TPSS in Real-time Mode

  • Click on the tpss_s icon on the desktop

Or

  • Open Windows PowerShell and type

cd c:\Users\AERI\docker\run
.\tpss_stop.bat

 

Running TPSS in Reprocessing Mode

In reprocessing mode, TPSS is run on a given day YYYYMMDD specificied by the user.  The desired temporal resolution and other parameters can be set in vip.txt.  To run TPSS in reprocessing mode:

  • Run Docker for Windows.  Note:  this is configured to start automatically at startup
  • Open Windows PowerShell and type

cd c:\Users\AERI\docker\run
.\tpss.bat YYYYMMDD

Where YYYYMMDD is the specified date to reprocess (e.g. 20170601)

  • By default, TPSS will always append to existing output data for the specified day.  If brand new output is desired, then ensure that previous NetCDF files for the specified day have been deleted.
  • TPSS will stop and shut down automatically when processing is complete
  • If processing needs to be stopped before the process has completed, type <ctrl>+C, <ctrl>+D in Windows PowerShell with the running process.  This may need to be repeated until the process is stopped

 

TPSS Output

When TPSS is run in either real-time or reprocessing mode, output files and quicklooks will be incrementally generated in the output directory: c:/users/aeri/docker/aerioe

  • Output NetCDF files *.cdf are self-describing files that contain the full results fo the retrieval. e.g.
    • height: height above ground level in km
    • temperature: retrieved temperature in Celsius
    • waterVapor: retrieved water vapor mixing ratio in g/kg
    • sigma_temperature: 1-sigma uncertainty in retrieved temperature in Celsius
    • sigma_waterVapor: 1-sigma uncertainty in retrieved water vapor mixing ratio in g/kg
  • Quicklooks
    • /aerioe.skewt.YYYMMDD.HHMM: Skew-T plots at ~3-hour intervals
    • /aerioe.RH.YYYYMMDD.HHMM: Relative humidity time-heigh cross section
    • /aerioe.temperature.YYYYMMDD.HHMM: Temperature time-height cross section
    • /aerioe.theta.YYYYMMDD.HHMM: Potential temperature time-height cross section
    • /aerioe.wvmr.YYYYMMDD.HHMM: Water vapor mixing ratio time-height cross section