Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[python-package] Allow to pass Arrow table for prediction #6168

Merged
merged 95 commits into from
Dec 14, 2023
Merged

[python-package] Allow to pass Arrow table for prediction #6168

merged 95 commits into from
Dec 14, 2023

Conversation

borchero
Copy link
Collaborator

Motivation

This is the last of a series of PRs towards #6022 and depends on #6167.

For a legible diff, see borchero/LightGBM@arrow-support-init-scores...arrow-support-inference.

@borchero borchero changed the title WIP: [python-package] Allow to pass Arrow table for prediction [python-package] Allow to pass Arrow table for prediction Dec 5, 2023
@borchero borchero marked this pull request as ready for review December 5, 2023 17:12
Copy link
Collaborator

@jameslamb jameslamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes look good to me! Thanks for the attention to detail you took in following the existing patterns in the project.

But before we merge this, I'd like to see the tests cover more of the predict() interface. predict() in LightGBM does a lot of different things and its behavior is dependent on the type of machine learning task. I left a suggestion with specific requests for the types of tests I'd like to see.

tests/python_package_test/test_arrow.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@jameslamb jameslamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great to me, thank you!

@guolinke or @shiyu1994 could you help with one more review on the c_api changes?

Copy link
Collaborator

@guolinke guolinke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jameslamb jameslamb mentioned this pull request Dec 13, 2023
24 tasks
@jameslamb
Copy link
Collaborator

Thank you!

When this builds, I'll merge this. And with that, v4.2.0 will have broad pyarrow support 🙌🏻

Awesome work on this @borchero , thank you so much!!

@borchero
Copy link
Collaborator Author

Awesome! @jameslamb: thanks a lot for waiting with v4.2.0 to include Arrow support and, in particular, for all your help getting Arrow support into this package 🫶🏼

@jameslamb jameslamb merged commit 2dfb9a4 into microsoft:master Dec 14, 2023
41 checks passed
@jameslamb
Copy link
Collaborator

@borchero would you like to join LightGBM as a maintainer?

If that interests you, send me an email or LinkedIn message (see the contact info at https://github.com/jameslamb) and I can give you more details 😁

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants