Skip to content

Procedure to update time series data from CMG

Ellyn Montgomery edited this page Mar 22, 2019 · 15 revisions
  • Log into geoport and use wget (SCP would also work) to copy files from stellwagen. For example, to add a new experiment Fire Island 14 do the wget below. If the data is already there, don't repeat the wget!
 cd /usgs/data2/emontgomery/stellwagen/Data
wget --continue -A .nc -r -l2 -nd -nc --no-parent http://stellwagen.er.usgs.gov/FIREISLAND14.html 
  • update the CSV file metadata with the git-hub GUI, adding the new experiment info. Choose the SECOND option that says to issue a pull request, then save

  • check that your local conversion script is up to date. Note at this point guidance is NOT to fork the code into individual work areas, just pull.

git pull 
  • make sure you are in the Anaconda python CONVERT_WH environment; NOT ioos!!!! If the program can't find cf_units, activate CONVERT_waves instead.
export PATH="/home/usgs/miniconda/bin:$PATH"
source activate CONVERT-WH 
or
source activate CONVERT-waves

(CONVERT-WH) should be pre-pended to the prompt string if it's been set successfully.

  • before starting, you need .nc files in stellwagen/DATA

  • run collect.py to do the conversion- more info is here