Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rebuild for aws_sdk_cpp 1.11.242 #23

Conversation

regro-cf-autotick-bot
Copy link
Contributor

This PR has been triggered in an effort to update aws_sdk_cpp111242.

Notes and instructions for merging this PR:

  1. Please merge the PR only after the tests have passed.
  2. Feel free to push to the bot's branch to update this PR if needed.

Please note that if you close this PR we presume that the feedstock has been rebuilt, so if you are going to perform the rebuild yourself don't close this PR until the your rebuild has been merged.


If this PR was opened in error or needs to be updated please add the bot-rerun label to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase @conda-forge-admin, please rerun bot in a PR comment to have the conda-forge-admin add it for you.

This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/7721328636, please use this URL for debugging.

@conda-forge-webservices
Copy link
Contributor

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

@weiji14
Copy link
Member

weiji14 commented Jan 31, 2024

Getting this error on the Linux build's test step at https://dev.azure.com/conda-forge/feedstock-builds/_build/results?buildId=867706&view=logs&j=4f922444-fdfe-5dcf-b824-02f86439ef14&t=937c195f-508d-5135-dc9f-d4b5730df0f7&l=662:

+ make_build_number /home/conda/feedstock_root /home/conda/recipe_root /home/conda/feedstock_root/.ci_support/linux_64_python3.11.____cpython.yaml
##[endgroup]
+ [[ -f /home/conda/feedstock_root/LICENSE.txt ]]
+ cp /home/conda/feedstock_root/LICENSE.txt /home/conda/recipe_root/recipe-scripts-license.txt
+ [[ 0 == 1 ]]
+ conda mambabuild /home/conda/recipe_root -m /home/conda/feedstock_root/.ci_support/linux_64_python3.11.____cpython.yaml --suppress-variables --clobber-file /home/conda/feedstock_root/.ci_support/clobber_linux_64_python3.11.____cpython.yaml --extra-meta flow_run_id=azure_20240131.1.1 remote_url=*** sha=18062ee8eb6c7d95e363f6c767abefc8eaa6598c
Updating build index: /home/conda/feedstock_root/build_artifacts

WARNING: No numpy version specified in conda_build_config.yaml.  Falling back to default numpy value of 1.22
Adding in variants from internal_defaults
Adding in variants from /home/conda/feedstock_root/.ci_support/linux_64_python3.11.____cpython.yaml
Attempting to finalize metadata for torchdata
conda-forge/linux-64                                        Using cache
conda-forge/noarch                                          Using cache
Reloading output folder: /home/conda/feedstock_root/build_artifacts
Reloading output folder: /home/conda/feedstock_root/build_artifacts
Reloading output folder: /home/conda/feedstock_root/build_artifacts
BUILD START: ['torchdata-0.7.1-py311h0463025_2.conda']
Reloading output folder: /home/conda/feedstock_root/build_artifacts

## Package Plan ##

  environment location: /home/conda/feedstock_root/build_artifacts/torchdata_1706678787370/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_p


The following NEW packages will be INSTALLED:

    _libgcc_mutex:      0.1-conda_forge                 conda-forge
    _openmp_mutex:      4.5-2_kmp_llvm                  conda-forge
    aws-c-auth:         0.7.14-h70caa3e_3               conda-forge
    aws-c-cal:          0.6.9-h14ec70c_3                conda-forge
    aws-c-common:       0.9.12-hd590300_0               conda-forge
    aws-c-compression:  0.2.17-h572eabf_8               conda-forge
    aws-c-event-stream: 0.4.1-h17cd1f3_5                conda-forge
    aws-c-http:         0.8.0-hc6da83f_5                conda-forge
    aws-c-io:           0.14.3-hbde70e5_0               conda-forge
    aws-c-mqtt:         0.10.1-h0ef3971_3               conda-forge
    aws-c-s3:           0.5.0-hb337f33_1                conda-forge
    aws-c-sdkutils:     0.1.14-h572eabf_0               conda-forge
    aws-checksums:      0.1.17-h572eabf_7               conda-forge
    aws-crt-cpp:        0.26.1-h0637f07_8               conda-forge
    aws-sdk-cpp:        1.11.242-h65f022c_0             conda-forge
    bzip2:              1.0.8-hd590300_5                conda-forge
    c-ares:             1.26.0-hd590300_0               conda-forge
    ca-certificates:    2023.11.17-hbcca054_0           conda-forge
    filelock:           3.13.1-pyhd8ed1ab_0             conda-forge
    fsspec:             2023.12.2-pyhca7485f_0          conda-forge
    gmp:                6.3.0-h59595ed_0                conda-forge
    gmpy2:              2.1.2-py311h6a5fa03_1           conda-forge
    icu:                73.2-h59595ed_0                 conda-forge
    jinja2:             3.1.3-pyhd8ed1ab_0              conda-forge
    keyutils:           1.6.1-h166bdaf_0                conda-forge
    krb5:               1.21.2-h659d440_0               conda-forge
    ld_impl_linux-64:   2.40-h41732ed_0                 conda-forge
    libabseil:          20230802.1-cxx17_h59595ed_0     conda-forge
    libblas:            3.9.0-21_linux64_openblas       conda-forge
    libcblas:           3.9.0-21_linux64_openblas       conda-forge
    libcurl:            8.5.0-hca28451_0                conda-forge
    libedit:            3.1.20191231-he28a2e2_2         conda-forge
    libev:              4.33-hd590300_2                 conda-forge
    libexpat:           2.5.0-hcb278e6_1                conda-forge
    libffi:             3.4.2-h7f98852_5                conda-forge
    libgcc-ng:          13.2.0-h807b86a_4               conda-forge
    libgfortran-ng:     13.2.0-h69a702a_4               conda-forge
    libgfortran5:       13.2.0-ha4646dd_4               conda-forge
    libhwloc:           2.9.3-default_h554bfaf_1009     conda-forge
    libiconv:           1.17-hd590300_2                 conda-forge
    liblapack:          3.9.0-21_linux64_openblas       conda-forge
    libnghttp2:         1.58.0-h47da74e_1               conda-forge
    libnsl:             2.0.1-hd590300_0                conda-forge
    libopenblas:        0.3.26-pthreads_h413a1c8_0      conda-forge
    libprotobuf:        4.24.4-hf27288f_0               conda-forge
    libsqlite:          3.44.2-h2797004_0               conda-forge
    libssh2:            1.11.0-h0841786_0               conda-forge
    libstdcxx-ng:       13.2.0-h7e041cc_4               conda-forge
    libtorch:           2.1.2-cpu_mkl_hadc400e_100      conda-forge
    libuuid:            2.38.1-h0b41bf4_0               conda-forge
    libuv:              1.46.0-hd590300_0               conda-forge
    libxcrypt:          4.4.36-hd590300_1               conda-forge
    libxml2:            2.12.4-h232c23b_1               conda-forge
    libzlib:            1.2.13-hd590300_5               conda-forge
    llvm-openmp:        17.0.6-h4dfa4b3_0               conda-forge
    markupsafe:         2.1.4-py311h459d7ec_0           conda-forge
    mkl:                2023.2.0-h84fe81f_50496         conda-forge
    mpc:                1.3.1-hfe3b2da_0                conda-forge
    mpfr:               4.2.1-h9458935_0                conda-forge
    mpmath:             1.3.0-pyhd8ed1ab_0              conda-forge
    ncurses:            6.4-h59595ed_2                  conda-forge
    networkx:           3.2.1-pyhd8ed1ab_0              conda-forge
    numpy:              1.26.3-py311h64a7726_0          conda-forge
    openssl:            3.2.1-hd590300_0                conda-forge
    pip:                23.3.2-pyhd8ed1ab_0             conda-forge
    pybind11:           2.11.1-py311h9547e67_2          conda-forge
    pybind11-global:    2.11.1-py311h9547e67_2          conda-forge
    python:             3.11.7-hab00c5b_1_cpython       conda-forge
    python_abi:         3.11-4_cp311                    conda-forge
    pytorch:            2.1.2-cpu_mkl_py311h249faf5_100 conda-forge
    readline:           8.2-h8228510_1                  conda-forge
    s2n:                1.4.2-h06160fa_0                conda-forge
    setuptools:         69.0.3-pyhd8ed1ab_0             conda-forge
    sleef:              3.5.1-h9b69904_2                conda-forge
    sympy:              1.12-pypyh9d50eac_103           conda-forge
    tbb:                2021.11.0-h00ab1b0_1            conda-forge
    tk:                 8.6.13-noxft_h4845f30_101       conda-forge
    typing_extensions:  4.9.0-pyha770c72_0              conda-forge
    tzdata:             2023d-h0c530f3_0                conda-forge
    wheel:              0.42.0-pyhd8ed1ab_0             conda-forge
    xz:                 5.2.6-h166bdaf_0                conda-forge
    zlib:               1.2.13-hd590300_5               conda-forge
    zstd:               1.5.5-hfc55251_0                conda-forge

Preparing transaction: ...working... done
Verifying transaction: ...working... done
Executing transaction: ...working... done
Reloading output folder: /home/conda/feedstock_root/build_artifacts
Reloading output folder: /home/conda/feedstock_root/build_artifacts
Mamba failed to solve:
 - pip
 - numpy *
 - fsspec
 - s3fs
 - awscli
 - portalocker >=2.0.0
 - cryptography >=3.3.2,<40.0.2
 - pytest
 - expecttest
 - adlfs
 - datasets
 - libgcc-ng >=12
 - libstdcxx-ng >=12
 - python >=3.11,<3.12.0a0
 - urllib3 >=1.25
 - python_abi 3.11.* *_cp311
 - pytorch >=2.1.2,<2.2.0a0
 - aws-sdk-cpp >=1.11.242,<1.11.243.0a0
 - requests

with channels:

The reported errors are:
- Encountered problems while solving:
-   - nothing provides __cuda >=11.2 needed by pyarrow-9.0.0-py310h229748a_46_cuda

On macOS, the build is also failing on the test step, but the error is - - package datasets-1.1.3-pyhd3deb0d_0 requires pyarrow >=0.17.1, but none of the providers can be installed. Looks like something about HuggingFace datasets library not having a version of pyarrow that can be installed.

@h-vetinari
Copy link
Member

It's a conflict related to the missing pyarrow builds for the newest awd-cpp-sdk. I triggered rebuilds for all maintenance branches, hopefully we get more useful errors (or none at all)

@h-vetinari
Copy link
Member

Looks like that now the hash of the upstream tag changed? 🤔

@weiji14
Copy link
Member

weiji14 commented Jan 31, 2024

Looks like that now the hash of the upstream tag changed? 🤔

Oh what? Did they modify torchdata=0.7.1? We bumped to v0.7.1 in #18 around Nov 2023, but the tar.gz files under Assets in https://github.com/pytorch/data/releases/tag/v0.7.1 now says it is from 2 weeks ago (16 Jan 2024)?! Doesn't make sense though, since the build was just ran yesterday without the RuntimeError: SHA256 mismatch: 'ef9bbdcee759b53c3c9d99e76eb0a66da33d36bfb7f859a25a9b5e737a51fa23' != '1b6589336776ccba19fd3bf435588416105d372f6b85d58a9f2b008286f483bf' error.

@weiji14
Copy link
Member

weiji14 commented Jan 31, 2024

Yeah, it looks like they retagged v0.7.1 to commit pytorch/data@5e6f7b7. @huydhn, did you set this new tag for v0.7.1 after pytorch/data#1217?

@huydhn
Copy link

huydhn commented Jan 31, 2024

Yeah, it looks like they retagged v0.7.1 to commit pytorch/data@5e6f7b7. @huydhn, did you set this new tag for v0.7.1 after pytorch/data#1217?

Sorry for the confusion. I confess that I did that because we have freeze new release for TorchData after 0.7.1, but that CI change and pytorch/data#1217 were needed to keep the build from completely broken due to a security-related change we need to do on all PyTorch repos.

@weiji14
Copy link
Member

weiji14 commented Jan 31, 2024

Yeah, it looks like they retagged v0.7.1 to commit pytorch/data@5e6f7b7. @huydhn, did you set this new tag for v0.7.1 after pytorch/data#1217?

Sorry for the confusion. I confess that I did that because we have freeze new release for TorchData after 0.7.1, but that CI change and pytorch/data#1217 were needed to keep the build from completely broken due to a security-related change we need to do on all PyTorch repos.

Cool, thanks for clarifying. Would it be possible for torchdata to upload the tar.gz sdist to https://pypi.org/project/torchdata/0.7.1/#files? It would be best to have a stable 'official' source for conda-forge to build from.

@h-vetinari
Copy link
Member

It would be best to have a stable 'official' source for conda-forge to build from.

I tend to prefer GitHub tags actually :)

But doesn't really matter

recipe/meta.yaml Outdated Show resolved Hide resolved
@weiji14
Copy link
Member

weiji14 commented Feb 1, 2024

It would be best to have a stable 'official' source for conda-forge to build from.

I tend to prefer GitHub tags actually :)

But doesn't really matter

I was going for 'immutable', but yeah, I'm a little more paranoid on security/hashes. Let's stay with the GitHub tags for now 🙂

The build is failing on osx_64_python3.11 on the pip check step with s3fs 2023.10.0 has requirement fsspec==2023.10.0, but you have fsspec 2023.12.2.. Should be an easy fix, gimme a few mins hours (got some meetings).

Try to workaround `s3fs 2023.10.0 has requirement fsspec==2023.10.0, but you have fsspec 2023.12.2` error.
@weiji14 weiji14 merged commit f967b84 into conda-forge:main Feb 2, 2024
10 checks passed
@regro-cf-autotick-bot regro-cf-autotick-bot deleted the rebuild-aws_sdk_cpp111242-0-1_ha1a8f9 branch February 2, 2024 03:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants