Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support python 3.12 version #72

Merged
merged 8 commits into from
Jun 14, 2024

Conversation

myouju
Copy link
Contributor

@myouju myouju commented Jun 10, 2024

Description

dbt-core v1.8 supports python 3.12 too.
Let's supported dbt-dry-run with 3.12.

We can also check test on multiple python version.

Checklist:

  • I have run make verify and fixed any linting or test errors
  • I have added appropriate unit tests or if applicable an integration test
  • OPTIONAL: I have run make integration against a Big Query instance
    • I checked python 3.8 to 3.12

@myouju myouju force-pushed the support-python-312-version branch from 9492b6a to df7feb7 Compare June 10, 2024 12:06
@myouju
Copy link
Contributor Author

myouju commented Jun 10, 2024

sorry, not work with python3.12, so I close this.

@myouju myouju closed this Jun 10, 2024
@ccharlesgb
Copy link
Collaborator

What was the error with 3.12?

@myouju
Copy link
Contributor Author

myouju commented Jun 10, 2024

Here are some reasons for error.

  • failed to install numpy
  • failed to run make integration because occured DeprecationWarning

Still trying, but not yet successful.

@myouju
Copy link
Contributor Author

myouju commented Jun 10, 2024

The error has been resolved and I reopen this PR.

@myouju myouju reopened this Jun 10, 2024
Copy link
Collaborator

@ccharlesgb ccharlesgb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One question about dependencies and also why do we need to pin the pandas/numpy version?

pyproject.toml Outdated
agate = ">=1.7.0,<1.10"
google-cloud-bigquery = "^3"
pydantic = "^1.9.0"
tenacity = "^8.2"
networkx = ">=2.3,<4.0"
pyyaml = "~6"
typer = "~0"
numpy = [
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this package has a dependency on numpy or pandas directly. Should this be set in the dev dependencies instead?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was wrong, I'll set it up again in dev dependencies.

numpy 1.24 that has distutils doesn't support python 3.12 because we can't use distutils with python 3.12.

python 3.8 is supported by pandas up to 2.0.3.
We need to build pandas locally, because pandas for python3.12 does not exist in pypi with versions up to 2.1.0.
If we can accept local builds taking longer, no need to specify this. (In my environment it took 9 minutes.)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed 9024a23

@myouju myouju requested a review from ccharlesgb June 12, 2024 02:40
@ccharlesgb ccharlesgb merged commit a87aefc into autotraderuk:main Jun 14, 2024
5 checks passed
@myouju
Copy link
Contributor Author

myouju commented Jun 14, 2024

Thank you for your review and merging.

@myouju myouju deleted the support-python-312-version branch June 14, 2024 13:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants