IDIOMS Update & BULKI v0.1

[zhangwei217245]

Related Issues / Pull Requests

Direct
#151 #169 #206

Indirect
#109 #132

Description

Major changes:

• IDIOMS -> affix-based query benchmark
• IDIOMS -> index persistence mechanism
• IDIOMS -> numeric value query support (exact query and range query)
• IDIOMS -> numeric value query benchmark
• IDIOMS -> simulation test
• BULKI V0.1 -> a data serialization and deserialization mechanism
• Metadata JSON validator
• Metadata JSON Loader for PDC

Minor changes

• Updated Dockerfile for faster docker image build
• Updated pdc_generic.h for full data type support capability and better ordering of PDC data type enums

In-progress changes

• Some code for multi-condition query.

What changes are proposed in this pull request?

• Bug fix (non-breaking change which fixes an issue)
• [ x ] New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality not to work as expected; for instance, examples in this repository must be updated too)
• [ x ] This change requires a documentation update

Checklist:

• My code modifies existing public API, or introduces new public API, and I updated or wrote docstrings
• [ x ] I have commented my code
• My code requires documentation updates, and I have made corresponding changes to the documentation
• [ x ] I have added tests that prove my fix is effective or that my feature works
• [ x ] New and existing unit tests pass locally with my changes

[houjun]

@jeanbez @zhangwei217245, any idea why the clang-format fix is not triggered and the clang-format check keeps failing?

It seems like a python package issue for the clang-format plugin...

[houjun]

@zhangwei217245, some parallel tests on Permlutter CI are failing, see the logs

  Start 139: idioms_ci_mpi
     24/24 Test #139: idioms_ci_mpi ....................***Failed    7.79 sec
     96% tests passed, 1 tests failed out of 24

[jeanbez]

Please remove the src/api/test_bulki.bin file unless there is a need for it to be there.

[zhangwei217245]

@zhangwei217245, some parallel tests on Permlutter CI are failing, see the logs

  Start 139: idioms_ci_mpi
     24/24 Test #139: idioms_ci_mpi ....................***Failed    7.79 sec
     96% tests passed, 1 tests failed out of 24

There should not be parallel test case for now. I just removed it from CMake.

[zhangwei217245]

Please remove the src/api/test_bulki.bin file unless there is a need for it to be there.

Removed. Thank you for reminding.

[zhangwei217245]

Plus: I don't have access to software.nersc.gov