Metaflow Netflix Extensions v1.2.3

What's Changed

• Upstream20241110 by @romain-intel in #51

Specifically

• Compatibility with Metaflow 2.12.29+
• Better recreation of Metaflow environment when code package is not available
• Additional debug messages when trying to acquire locks
• Clean up some messages
• Compatibility with mamba 2.0+

Full Changelog: 1.2.2...1.2.3

Metaflow Netflix Extensions v1.2.2

What's Changed

• Use bash binary from current environment by @ilian in #39
• Enhance code block for .yml format in README.md by @lamtrinhdev in #40
• Various fixes reported by users by @romain-intel in #42
  • Fix an issue when building cross-platform with GLIBC being injected (showed up as a pydantic error)
  • Fix an issue when building with pypi and conda dependencies with conda
  • Improve building of certain local projects that use pyproject.toml
  • Improve timeout documentation
• Bug fixes by @romain-intel in #44
• Fix wrong assert by @romain-intel in #46
• Added tests by @romain-intel in #43
• Fix issue with running Metaflow with the runner environment by @romain-intel in #45

New Contributors

• @ilian made their first contribution in #39
• @lamtrinhdev made their first contribution in #40

Full Changelog: 1.2.1...1.2.2

Metaflow Netflix Extensions v1.2.1

What's Changed

• fix: pin micromamba:1.5.7 by @majamil16 in #38

New Contributors

• @majamil16 made their first contribution in #38

Full Changelog: 1.2.0...1.2.1

Metaflow Netflix Extensions v1.2.0

What's Changed

• Add extensions to debug flows in isolated notebook instance by @talsperre in #36
• Fix resolution of derived environments in some cases by @romain-intel in #37

New Contributors

• @talsperre made their first contribution in #36

Full Changelog: 1.1.3...1.2.0

Metaflow Netflix Extensions v1.1.3

What's Changed

• Fix a forgotten --yes which could cause things to freeze by @romain-intel in #33
• Various fixes from upstream: by @romain-intel in #35
  • Properly handle sys packages when cross building
  • Add --conda-channel to requirements.txt type of files
  • Fix issue when locally building a package that already had a local identifier
  • Better handling of determining if a newer package needs to be built when pointing to a local directory or file
  • Add support to specify additional packages for builder environments thereby supporting authentication using GOOGLE_APPLICATION_CREDENTIALS
  • Improved support for python 3.7
  • More efficient environment building when building an environment that just adds ipykernel
  • Fix issue with micromamba in some cases (it would "hang" when compiling .pyc files)

Full Changelog: 1.1.2...1.1.3

Metaflow Netflix Extensions v1.1.2

What's Changed

• Add default packages for linux-64 to enable remote resolve from mac by @romain-intel in #32

Full Changelog: 1.1.1...1.1.2

Metaflow Netflix Extensions v1.1.1

Fix small issue with 1.1.0 which caused the sys packages to not always be properly injected.

Full Changelog: 1.1.0...1.1.1

Metaflow Netflix Extensions v1.1.0

What's Changed

• Support pip-repositories in conda-lock 2.4.0+ by @romain-intel in #27
• Fix #28: Properly split URLs on space as well by @romain-intel in #29
• Fixes an issue with resolving multiple mixed environments in parallel
• Allow pypi-indices in environment.yml to specify pip repositories in that format
• Improved parsing of version information in environment.yml
• Distinguish environments based on the glibc version they are built. Note that for mixed environments (using conda-lock), this requires a recent version of conda-lock (not yet released) which integrates everything in main up to December 11th 2023. In other modes, the handling of glibc version is now fixed and should behave as expected.
• Include tomli in dependencies in more cases to build pyproject.toml packages properly
• Optimistically build wheels even cross platform.

Notes

• Environments may be re-resolved once due to a change in the user-hash for the environment due to the inclusion of the glibc version being used. This may increase the resolution time for environments the first time around.

Full Changelog: 1.0.7...1.1.0

Metaflow Netflix Extensions v1.0.7

Bug fix in last release in the micromamba installation procedure.

Full Changelog: 1.0.6...1.0.7

Metaflow Netflix Extensions v1.0.6

What's Changed

• Better parsing of YAML input lines and fix double pip by @romain-intel in #23
• Always install micromamba if needed to create an environment by @romain-intel in #26

@tylerpotts contributed to this release with the inspiration for #23.

Full Changelog: 1.0.5...1.0.6