Skip to content

Procedure to update time series data from CMG

Ellyn Montgomery edited this page Apr 6, 2015 · 15 revisions
  • Log into geoport and use wget to copy files from stellwagen. For example, to add a new experiment Fire Island 14:
 cd /usgs/data2/emontgomery/stellwagen/Data
# this works but is very slow and copies a lot of extra material.  Must be a better way- SCP?
 wget --continue -A .nc -r -nH --cut-dirs=1 --no-parent http://stellwagen.er.usgs.gov/FIREISLAND14.html
  • update the CSV file metadata, adding the new experiment info, then push to your fork:
cd /usgs/data2/emontgomery/stellwagen/usgs-cmg-portal/woods_hole_obs_data
vi project_metadata.csv
git add project_metadata.csv
git commit -m 'updated csv'  
git push origin master
  • submit a Pull Request (PR) from your fork to update the upstream repo at USGS-CMG

  • check that your local conversion script is up to date

git pull upstream master
  • make sure you are in the Anaconda python ioos environment
export PATH="/home/usgs/miniconda/bin:$PATH"
source activate ioos
``'
(**(ioos)** should be prepended to the prompt string if it's set)
* modify and run the python conversion script

sh do_convert.sh