You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am working on an integration test for Arrow, based on the test queries on this repository. The idea is to check Arrow PRs against the test cases built here. The draft PR is almost in a workable state except for packaging requirements in consumer-testing. Do you think it is a wise idea to include a setup.py for this project? The advantage is, it would smooth the usage with other platforms and workflows.
Value added: maybe we can also include entrypoints for a CLI application to run the test cases or benchmarks (future) quite easily.
One challenge that we might encounter is that, right now, substrait-io/consumer-testing contains a bunch of tests. Would these test cases be packaged up as part of the distribution? Does pytest support something like that? Would it be possible for me to import tests from a remote package?
I am not entirely sure about that, my personal experience is I don't package tests with the core library. It just floats outside. Please correct me if there is a better approach.
Hello community,
I am working on an integration test for Arrow, based on the test queries on this repository. The idea is to check Arrow PRs against the test cases built here. The draft PR is almost in a workable state except for packaging requirements in consumer-testing. Do you think it is a wise idea to include a
setup.py
for this project? The advantage is, it would smooth the usage with other platforms and workflows.Value added: maybe we can also include entrypoints for a CLI application to run the test cases or benchmarks (future) quite easily.
Something like,
consumer-testing test --platform arrow --module tpch
consumer-testing benchmark --platform arrow --module tpch --publish <url>
We could use
click
library to do this. This is merely an extension tosetup.py
cc @jacques-n @richtia appreciate your feedback.
The text was updated successfully, but these errors were encountered: