Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(rust): introduce catalog interface for rust module #3300

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

yanghua
Copy link
Contributor

@yanghua yanghua commented Dec 26, 2024

No description provided.

@github-actions github-actions bot added the enhancement New feature or request label Dec 26, 2024
@yanghua yanghua force-pushed the 3290-catalog-rust-interface branch from 6a32543 to f5347b5 Compare December 26, 2024 09:30
@codecov-commenter
Copy link

codecov-commenter commented Dec 26, 2024

Codecov Report

Attention: Patch coverage is 95.60976% with 9 lines in your changes missing coverage. Please review.

Project coverage is 79.06%. Comparing base (c6fcb31) to head (23f34e3).
Report is 1 commits behind head on main.

Files with missing lines Patch % Lines
rust/lance/src/catalog/catalog_trait.rs 0.00% 7 Missing ⚠️
rust/lance/src/catalog/dataset_identifier.rs 98.21% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3300      +/-   ##
==========================================
+ Coverage   79.00%   79.06%   +0.05%     
==========================================
  Files         246      249       +3     
  Lines       87589    87790     +201     
  Branches    87589    87790     +201     
==========================================
+ Hits        69203    69410     +207     
+ Misses      15522    15515       -7     
- Partials     2864     2865       +1     
Flag Coverage Δ
unittests 79.06% <95.60%> (+0.05%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@yanghua yanghua force-pushed the 3290-catalog-rust-interface branch from f5347b5 to 1d308e0 Compare December 26, 2024 09:56
@yanghua
Copy link
Contributor Author

yanghua commented Dec 26, 2024

Hi @westonpace I drafted a PR for discussion.

About naming, some thoughts:

  • xxx_dataset or xxx_table API in Catalog which one do you prefer?
  • xxx_namespace or xxx_database in Catalog which one do you prefer?

fn list_datasets(&self, namespace: &Namespace) -> Vec<DatasetIdentifier>;

/// Create a new dataset in the catalog.
fn create_dataset(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think using register_dataset interface to register an existed lance dataset is also needed.

fn invalidate_dataset(&self, identifier: &DatasetIdentifier) -> Result<(), String>;

/// Register a dataset in the catalog.
fn register_dataset(&self, identifier: &DatasetIdentifier) -> Result<Dataset, String>;
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @SaintBacchus it's here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants