Use rasterio AWS session in RasterioSource
when reading files on S3
#2197
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overview
This PR makes
RasterioSource
use rasterio'sAWSSession
when reading from a raster file on S3, which makes it easier to read from requester-pays buckets (e.g. NAIP).Previously, the following (ipython) snippet would not work even if the user was logged into an SSO session via the AWS CLI; the user would need to export all the credentials to the environment to make it work. This PR fixes that.
Checklist
needs-backport
label if the change should be back-ported to the previous releaseNotes
This PR also makes
rastervision_aws_s3
recognize theAWS_REQUEST_PAYER
environment variable and allow it to override Raster Vision'sAWS_S3_REQUESTER_PAYS
config option.Testing Instructions
See new unit tests.