Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Issue #, if available:
Description of changes:
Adding support of new Amazon Nova models
Amazon Nova Micro
Amazon Nova Lite
Amazon Nova Pro
Amazon Nova Canvas
Amazon Nova Reels
Backend
.whl
this is until new boto3 apis are made publicbedrock.amazon.nova
to use existingBedrockChatAdapter
this will only work forNova Micro
since the other has to go through multimodal adapter.SAFE_STR_REGEX
to support multi-path s3 paths (i.e. private/user_id/videos/..../*.mp4) since the video generations forcefully puts videos under "randomid/output.mp4" under any S3 URI passed as output path.MultiModalBase
to support file upload/retrieval to/from S3, converse API and generation of non-text content (video/image)Claude
/Idefics
adapters to new MultiModalBase class by returning the expected new structure.Nova
adapter from MultiModalBase (using Converse API where currently possible)bedrock.start_async_invoke
which generates 6s video in background asynchronously in ~4m.UI
chat-message.tsx
has been broken down in smaller components.chat-message-media-display.tsx
to handle the display of media (image/video)video-dialog
for video uploads (max 10MB)seed
options defaulting to 0 inllm-config-dialog
, used only in image/video generation.chat-input-panel.tsx
based on model's OUTPUT_MODALITIES, default to first or only available one.Ran
vet-all
for linting and testing.By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.