-
Notifications
You must be signed in to change notification settings - Fork 13
Procedure to update time series data from CMG
Ellyn Montgomery edited this page Apr 6, 2015
·
15 revisions
- Log into geoport and use wget to copy files from stellwagen. For example, to add a new experiment Fire Island 14:
cd /usgs/data2/emontgomery/stellwagen/Data
# this works but is very slow and copies a lot of extra material. Must be a better way- SCP?
wget --continue -A .nc -r -nH --cut-dirs=1 --no-parent http://stellwagen.er.usgs.gov/FIREISLAND14.html
- update the CSV file metadata, adding the new experiment info, then push to your fork:
cd /usgs/data2/emontgomery/stellwagen/usgs-cmg-portal/woods_hole_obs_data
vi project_metadata.csv
git add project_metadata.csv
git commit -m 'updated csv'
git push origin master
-
submit a Pull Request (PR) from your fork to update the upstream repo at USGS-CMG
-
check that your local conversion script is up to date
git pull upstream master
- make sure you are in the Anaconda python ioos environment
export PATH="/home/usgs/miniconda/bin:$PATH"
source activate ioos
``'
(**(ioos)** should be prepended to the prompt string if it's set)
* modify and run the python conversion script
sh do_convert.sh