Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bedrock: Cross Region Inference Constructs #31957

Open
2 tasks done
jdebuseamazon opened this issue Oct 31, 2024 · 1 comment
Open
2 tasks done

Bedrock: Cross Region Inference Constructs #31957

jdebuseamazon opened this issue Oct 31, 2024 · 1 comment
Labels
@aws-cdk/bedrock Related to @aws-cdk/bedrock effort/small Small work item – less than a day of effort feature-request A feature should be added or improved. p2

Comments

@jdebuseamazon
Copy link
Contributor

Describe the feature

Abstractions for Bedrock cross region inference profiles and their identifiers (see), similar to those for Bedrock foundation models (see)

Use Case

To grant a principal permission to invoke a cross region inference profile along with the associated foundational model in all supported regions. For example (see), the US Anthropic Claude 3 Haiku profile is supported in us-east-1 and us-west-2. To invoke this profile in us-east-1 a principal must have permission to invoke the profile in us-east-1 and the Anthropic Claude 3 Haiku foundation model in us-east-1 and us-west-2.

Proposed Solution

No response

Other Information

The abstractions may also be useful for #31570

Acknowledgements

  • I may be able to implement this feature request
  • This feature might incur a breaking change

CDK version used

2.164.1

Environment details (OS name and version, etc.)

macOS Sequoia 15.1
@jdebuseamazon jdebuseamazon added feature-request A feature should be added or improved. needs-triage This issue or PR still needs to be triaged. labels Oct 31, 2024
@jdebuseamazon jdebuseamazon mentioned this issue Oct 31, 2024
Closed
1 task
@ashishdhingra ashishdhingra added effort/small Small work item – less than a day of effort p2 labels Oct 31, 2024
@ashishdhingra
Copy link
Contributor

@jdebuseamazon Thanks for the PR contribution

@ashishdhingra ashishdhingra added @aws-cdk/bedrock Related to @aws-cdk/bedrock and removed needs-triage This issue or PR still needs to be triaged. labels Oct 31, 2024
@ashishdhingra ashishdhingra removed their assignment Oct 31, 2024
This was referenced Nov 1, 2024
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
@aws-cdk/bedrock Related to @aws-cdk/bedrock effort/small Small work item – less than a day of effort feature-request A feature should be added or improved. p2
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(bedrock): add cross region inference profiles jdebuseamazon/aws-cdk
3 participants
@ashishdhingra @khushail @jdebuseamazon