-
Notifications
You must be signed in to change notification settings - Fork 0
/
readMe
59 lines (38 loc) · 2.61 KB
/
readMe
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
The below workflow is tested on PAN only at this time.
1. Set BASEDIR in setenv_fudge and source setenv_fudge
(setenv_fudge is found within the fudge2014 directory/git repo)
###################
source setenv_fudge
###################
2. Prepare experiment XML
sample: /home/a1r/gitlab/tasmax/fudge2014/utils/xml/cew/vanilla.seasonal2.tasmin.xml
3. Run expergen to produce runscripts:
expergen is now found within fudge2014/bin/
Usage:
expergen -i ../utils/xml/vanilla.seasonal2.tasmin.xml
Running the above will out a list of master scripts that can be submitted as a MOAB job. Next steps found below-
Runscripts and R-log files are now placed in [script_root]/scripts/$subproject/$fudgeexperimentname/
The script_root is retrieved from the XML as a user-defined prefix.
4. Script to Submit MOAB Jobs
The submit_job script is found in fudge2014/bin/
Usage:
Please provide 4 arguments: master_script_dir lon_start lon_end timeSuffix.
eg. submit_job /nbhome/a1r/tests/scripts/RR/RRtna1r-CDFt-A38z-mL01K00/master/ 181 370 2014-10-28.17:10:56.771769
5. Monitor Job
showq | grep USERNAME
showq -c |grep Aparna
gfdl.5965056 C 0 p-0 ------ 1.0 wi Aparna.Ra f pp047.princeton. 2 00:01:02 Sat Sep 6 17:45:54
sample output location:
/work/a1r/testing/tn//downscaled/NOAA-GFDL/MPI-ESM-LR/rcp85/day/atmos/day/r1i1p1/v20111014/RRtnp1-CDFt-A38sL01K00/tasmin/RR/OneD/v20140108/
MOAB job logs can be found in : /work/$USER/fudge/stdout/
You can tell how many of the jobs have been successfully completed from the number of output minifiles in the output directory:
ls /work/a1r/testing/tn//downscaled/NOAA-GFDL/MPI-ESM-LR/rcp85/day/atmos/day/r1i1p1/v20111014/RRtnp1-CDFt-A38sL01K00/tasmin/RR/OneD/v20140108/ | wc -l
An empty folder should return 1. A complete job over the entire Red River region should return 191.
If there are fewer minifiles in the output directory than the XMl specifies (via lons and lone), postProc will return a NetCDF file with all
0 values for the variable of interest.
6. After the MOAB jobs complete successfully, you should be post-process the output by using the tool: postProc.
postProc -i ../utils/xml/vanilla.seasonal2.tasmin.xml
If you are re-post-processing a set of minfiles that failed, either remove the previous catted output, or use the -f option to force writing the output:
postProc -fi ../utils/xml/vanilla.seasonal2.tasmin.xml
Sample final output directory structure:
/work/a1r/testing/tn//downscaled/NOAA-GFDL/MPI-ESM-LR/rcp85/day/atmos/day/r1i1p1/v20111014/RRtnp1-CDFt-A38sL01K00/tasmin/RR/v20140108/tasmin_day_RRtnp1-CDFt-A38sL01K00_rcp85_r1i1p1_RR_20060101-20991231.nc