Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactored archiving #2491

Merged

Commits on Mar 7, 2024

  1. Configuration menu
    Copy the full SHA
    de29141 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Configuration menu
    Copy the full SHA
    404a46b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    172dc68 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Create archive task class with initial gdas.yaml.j2

    This also
    - adds a missing COM variable to JGLOBAL_ARCHIVE
    - Creates a test driver script and python program
    DavidHuber-NOAA committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    60b9cd4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    754c196 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. Configuration menu
    Copy the full SHA
    24dddf5 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Configuration menu
    Copy the full SHA
    bdf66df View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    395bd62 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. Configuration menu
    Copy the full SHA
    4d2e64c View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Configuration menu
    Copy the full SHA
    e8cb2c1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4f14da5 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Archive protocol overhaul.

    - Use new hsi/htar classes in wxflow
    - Assign cycle dates/hours in the job to avoid assigning in each template
    - Rename templates to match current/EE2 naming conventions
    - Write function to relative-ize COM paths
    DavidHuber-NOAA committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    7b5a9cc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b51cceb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    cbc815d View commit details
    Browse the repository at this point in the history
  4. Address PEP8 issues.

    DavidHuber-NOAA committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    a53c56a View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    aa204ed View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Configuration menu
    Copy the full SHA
    fa98a28 View commit details
    Browse the repository at this point in the history
  2. Fix PEP8 errors.

    DavidHuber-NOAA committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    406c7a1 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Configuration menu
    Copy the full SHA
    a99ecb5 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Configuration menu
    Copy the full SHA
    1fcccf0 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. Enabled GFS archiving and reworked some features

    - Moved the cycle_YYYYMMDDHH, etc, variable declarations to templates
    - Use COM directories inside of the templates (instead of _dir directories)
    - Add for-looping for tile numbers
    - Added several new templates needed for the GFS
    - Improved ATARDIR archiving logic
    DavidHuber-NOAA committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    bd66212 View commit details
    Browse the repository at this point in the history
  2. Update wxflow hash.

    DavidHuber-NOAA committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    dc9004d View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Add enkf archiving.

    DavidHuber-NOAA committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    a8cbe2b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8611bf8 View commit details
    Browse the repository at this point in the history
  3. Address PEP8 warnings

    DavidHuber-NOAA committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    533cccc View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    05f54dc View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Configuration menu
    Copy the full SHA
    338bdd2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    31a1d9a View commit details
    Browse the repository at this point in the history
  3. Remove unused fhmin.

    DavidHuber-NOAA committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    ec747f7 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    58840c4 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Configuration menu
    Copy the full SHA
    7532aeb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8e5dc8d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    fa870b3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ddd1397 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5733738 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    02bb94e View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Configuration menu
    Copy the full SHA
    a81ee42 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    066ffe2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    07a6537 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1c24f6b View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c8c2670 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    a3318e2 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    6d932ba View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    5e33693 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Configuration menu
    Copy the full SHA
    2458235 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    200b0ef View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7d06b11 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    00c70e1 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    a23ee5e View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    94011b3 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    141249c View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. Configuration menu
    Copy the full SHA
    78b063f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a30a05f View commit details
    Browse the repository at this point in the history
  3. Merge branch 'feature/archive_yaml' of github.com:DavidHuber-NOAA/glo…

    …bal-workflow into feature/archive_yaml
    DavidHuber-NOAA committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    6662db9 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1a3ac04 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c8ede1b View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    fc6f085 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    fa0adb7 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    84a1dd8 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    d76c392 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. Configuration menu
    Copy the full SHA
    546e385 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b412f7f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    668ca3b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5f518db View commit details
    Browse the repository at this point in the history
  5. Fix atardir datasets

    DavidHuber-NOAA committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    3f16f8b View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    912f9e7 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Update wxflow/jinja

    DavidHuber-NOAA committed May 1, 2024
    Configuration menu
    Copy the full SHA
    235830f View commit details
    Browse the repository at this point in the history
  2. Fix iaufhrs typo

    DavidHuber-NOAA committed May 1, 2024
    Configuration menu
    Copy the full SHA
    18c1271 View commit details
    Browse the repository at this point in the history
  3. Fix timedelta typo

    DavidHuber-NOAA committed May 1, 2024
    Configuration menu
    Copy the full SHA
    c99c8f4 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    853167a View commit details
    Browse the repository at this point in the history
  5. Fix dataset parsing

    DavidHuber-NOAA committed May 1, 2024
    Configuration menu
    Copy the full SHA
    f4fc98f View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    f788e6f View commit details
    Browse the repository at this point in the history
  7. Fix whitespace

    DavidHuber-NOAA committed May 1, 2024
    Configuration menu
    Copy the full SHA
    13acc22 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Configuration menu
    Copy the full SHA
    c869649 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4fa45b3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    90a00e7 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    eda06ed View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    51b7838 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Configuration menu
    Copy the full SHA
    95d88a9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    32010d0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    356be5e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    930d013 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d524483 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    cfb73fe View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    b79e481 View commit details
    Browse the repository at this point in the history
  8. Fix gdas_tasks

    DavidHuber-NOAA committed May 3, 2024
    Configuration menu
    Copy the full SHA
    43d1aed View commit details
    Browse the repository at this point in the history
  9. Fix aerosol comment

    DavidHuber-NOAA committed May 3, 2024
    Configuration menu
    Copy the full SHA
    23d6563 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    fa45977 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    ac9128d View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    7fd5b76 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    b483745 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    cc89c16 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Add wave IBP data

    DavidHuber-NOAA committed May 6, 2024
    Configuration menu
    Copy the full SHA
    1ec205c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d471e9e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    196db3e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    96ac442 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Configuration menu
    Copy the full SHA
    cfab211 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c018324 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Configuration menu
    Copy the full SHA
    4969af8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f1b8e88 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8f8ed43 View commit details
    Browse the repository at this point in the history
  4. Clean up archive.py

    DavidHuber-NOAA committed May 9, 2024
    Configuration menu
    Copy the full SHA
    be28de1 View commit details
    Browse the repository at this point in the history
  5. Fix ocean archiving

    DavidHuber-NOAA committed May 9, 2024
    Configuration menu
    Copy the full SHA
    aaa3876 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    48578f7 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    e450662 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    f4cd9aa View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    91b7820 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Configuration menu
    Copy the full SHA
    d72f9b4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2e3b461 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4e9ecc0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c945de4 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    655c197 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Add missing variables

    DavidHuber-NOAA committed May 13, 2024
    Configuration menu
    Copy the full SHA
    af7c968 View commit details
    Browse the repository at this point in the history
  2. Fix VFYARC archiving

    DavidHuber-NOAA committed May 13, 2024
    Configuration menu
    Copy the full SHA
    5543214 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4436a91 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    baf6da7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    990d49b View commit details
    Browse the repository at this point in the history
  6. Use RUN instead of CDUMP for aerosols.

    Co-authored-by: Walter Kolczynski - NOAA <[email protected]>
    DavidHuber-NOAA and WalterKolczynski-NOAA authored May 13, 2024
    Configuration menu
    Copy the full SHA
    fe5d68f View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    9a0704e View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    50305dc View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    dfcf804 View commit details
    Browse the repository at this point in the history
  10. Added missing ;;.

    DavidHuber-NOAA committed May 13, 2024
    Configuration menu
    Copy the full SHA
    0106d25 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Fix IAUFHRS

    DavidHuber-NOAA committed May 14, 2024
    Configuration menu
    Copy the full SHA
    c67c36f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f27839c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6e74ce8 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    0986bc0 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    806ec5d View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    7dd2fd4 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    a9fa4e3 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    4795b67 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Configuration menu
    Copy the full SHA
    c2b981c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    714ab9e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8f2d4af View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1220fac View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f08c2b8 View commit details
    Browse the repository at this point in the history
  6. Move misplaced endif

    DavidHuber-NOAA committed May 16, 2024
    Configuration menu
    Copy the full SHA
    cfd5fbb View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    83b969c View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    629bf6f View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Configuration menu
    Copy the full SHA
    7e205e7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    478a5ba View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3be3bd5 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    4e4c0e2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    ffeaf75 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Configuration menu
    Copy the full SHA
    0c4d92d View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Configuration menu
    Copy the full SHA
    5aeccac View commit details
    Browse the repository at this point in the history
  2. Revert "Separate stmp/ptmp for orion and hercules."

    This reverts commit 5aeccac.
    DavidHuber-NOAA committed May 21, 2024
    Configuration menu
    Copy the full SHA
    5baa7f5 View commit details
    Browse the repository at this point in the history