Skip to content

Procedure to update time series data from CMG

Ellyn Montgomery edited this page Apr 6, 2015 · 15 revisions
  • Log into geoport and use wget (SCP would also work) to copy files from stellwagen. For example, to add a new experiment Fire Island 14:
 cd /usgs/data2/emontgomery/stellwagen/Data
wget --continue -A .nc -r -nd  -nc  --no-parent http://stellwagen.er.usgs.gov/FIREISLAND14.html 
  • update the CSV file metadata, adding the new experiment info, then push to your fork:
cd /usgs/data2/emontgomery/stellwagen/usgs-cmg-portal/woods_hole_obs_data
vi project_metadata.csv
git add project_metadata.csv
git commit -m 'updated csv'  
git push origin master
  • submit a Pull Request (PR) from your fork to update the upstream repo at USGS-CMG

  • check that your local conversion script is up to date

git pull upstream master
  • make sure you are in the Anaconda python ioos environment
export PATH="/home/usgs/miniconda/bin:$PATH"
source activate ioos

((ioos) should be prepended to the prompt string if it's set)

  • modify and run the python conversion script
sh do_convert.sh