Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implementation of AI Remote Worker (AI-323) (rebased) #3168

Merged
merged 62 commits into from
Oct 18, 2024
Merged

Implementation of AI Remote Worker (AI-323) (rebased) #3168

merged 62 commits into from
Oct 18, 2024

Commits on Sep 5, 2024

  1. grpc updates for remote ai worker

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    502568a View commit details
    Browse the repository at this point in the history

  2. update starter to add aiworker and split aiModels processing to orche… 

    …strator and aiworker
    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b81ed3d View commit details
    Browse the repository at this point in the history

  3. add ai_worker core with small update to ModelConstraint to add capacity

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    7a82100 View commit details
    Browse the repository at this point in the history

  4. move functions to core/ai_worker.go

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ec3fb04 View commit details
    Browse the repository at this point in the history

  5. add ai_worker server changes

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e712c13 View commit details
    Browse the repository at this point in the history

  6. make T2I, I2I and Upscale backwards compatible

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1057ece View commit details
    Browse the repository at this point in the history

  7. add additional ai worker metrics

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    f79f0af View commit details
    Browse the repository at this point in the history

  8. add AI max size of response from worker

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    2ffef3e View commit details
    Browse the repository at this point in the history

  9. fix auto price modelid overwritten when price updated

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    5680321 View commit details
    Browse the repository at this point in the history

  10. fix core/ai_worker.go for tests

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    0290dd0 View commit details
    Browse the repository at this point in the history

  11. add ai worker tests

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ce3bac4 View commit details
    Browse the repository at this point in the history

  12. updates for typos

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b5f562a View commit details
    Browse the repository at this point in the history

  13. dont let remote workers connect if incompatible version (lower than o… 

    …rch)
    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    aa54b8d View commit details
    Browse the repository at this point in the history

  14. remove separate capacity from remote ai worker. capacity per model on… 

    … capabilities is used
    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4bde68f View commit details
    Browse the repository at this point in the history

  15. add err check and rename addl data field for server/ai_worker.go

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    f6ba022 View commit details
    Browse the repository at this point in the history

  16. add server/ai_worker tests and update to core/ai_tests.go

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    65b2948 View commit details
    Browse the repository at this point in the history

  17. update interfaces in stubs for server package tests

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4a092d9 View commit details
    Browse the repository at this point in the history

  18. fix serverGetOrchInfo api to add capabilities for ai-video

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e025643 View commit details
    Browse the repository at this point in the history

  19. add more tests, small updates to server/ai_worker.go

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    db4f297 View commit details
    Browse the repository at this point in the history

  20. update core/ai.go ReserveAICapability to check for 0 capacity and upd… 

    …ate related test
    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e75dab4 View commit details
    Browse the repository at this point in the history

  21. revert remote ai worker saving input to disk and change to bytes pass… 

    …through. small update to aiResults endpoint and related test update
    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    a5ba007 View commit details
    Browse the repository at this point in the history

  22. fix err check on handleAIRequest

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    64889d8 View commit details
    Browse the repository at this point in the history

  23. fix lock/unlock capabilities for ai capabilities changes and fix remo… 

    …ving ai capabilities
    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    6db747e View commit details
    Browse the repository at this point in the history

  24. fix typo in log line

    @ad-astra-video
    ad-astra-video committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    9cda839 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. update to make Segment Anything 2 compatible with remote ai worker an… 

    …d update tests
    @ad-astra-video
    ad-astra-video committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    9a46d4d View commit details
    Browse the repository at this point in the history

  2. fix image-to-video

    @ad-astra-video
    ad-astra-video committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    08c82c3 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. delete image-to-video result file

    @ad-astra-video
    ad-astra-video committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    6854eae View commit details
    Browse the repository at this point in the history

  2. fix segment-anything-2 capability lookup

    @ad-astra-video
    ad-astra-video committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    9cf5737 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. increase max response size to 3GB

    @ad-astra-video
    ad-astra-video committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    5311e38 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. fix AIResults to receive something other than worker.ImageResponse

    @ad-astra-video
    ad-astra-video committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    78cd031 View commit details
    Browse the repository at this point in the history

  2. add Capacity field to aiModels.json to override capacity for external… 

    … containers
    @ad-astra-video
    ad-astra-video committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0167dec View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. fix log lines and comment

    @ad-astra-video
    ad-astra-video committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    1fd01d8 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. updated test

    @ad-astra-video
    ad-astra-video committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    3c9deeb View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Ai video remoteaiworker pr rebase (#31) 

    * Minor refactor during code review
    @leszko
    leszko authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    ea21b99 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2024

  1. update for rebase (mostly renaming from aiworker changes)

    @ad-astra-video
    ad-astra-video committed Sep 29, 2024
    Configuration menu
    Copy the full SHA
    59a32ce View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. merge to current ai-video

    @ad-astra-video
    ad-astra-video committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    e9b7c69 View commit details
    Browse the repository at this point in the history

  2. rebase

    @ad-astra-video
    ad-astra-video committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    90373ba View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. update tests

    @ad-astra-video
    ad-astra-video committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    f7634a2 View commit details
    Browse the repository at this point in the history

  2. update log lines

    @ad-astra-video
    ad-astra-video committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    16c7799 View commit details
    Browse the repository at this point in the history

  3. rename core.GetSegmentData to core.DownloadData

    @ad-astra-video
    ad-astra-video committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    2a2a213 View commit details
    Browse the repository at this point in the history

  4. tests update

    @ad-astra-video
    ad-astra-video committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    629df48 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Merge remote-tracking branch 'official/ai-video' into HEAD

    @ad-astra-video
    ad-astra-video committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    5d8043b View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. rebase fixes, add LLM pipeline, updates to handle SSE responses from … 

    …worker
    @ad-astra-video
    ad-astra-video committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    139f034 View commit details
    Browse the repository at this point in the history

  2. remove test not finished and fix dlDur for multipart responses

    @ad-astra-video
    ad-astra-video committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    c21aaa8 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'official/ai-video' into HEAD

    @ad-astra-video
    ad-astra-video committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    0b4f855 View commit details
    Browse the repository at this point in the history

  4. fix test variables

    @ad-astra-video
    ad-astra-video committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    74061a8 View commit details
    Browse the repository at this point in the history

  5. update test and move multipart/mixed parsing to function

    @ad-astra-video
    ad-astra-video committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    54fd7e2 View commit details
    Browse the repository at this point in the history

  6. add test for ExtensionByType

    @ad-astra-video
    ad-astra-video committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    82fa6cc View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. fix tests - add exeception for transcodeFrames

    @ad-astra-video
    ad-astra-video committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    e08f0ad View commit details
    Browse the repository at this point in the history

  2. fix broadcast_test.go

    @ad-astra-video
    ad-astra-video committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    430d172 View commit details
    Browse the repository at this point in the history

  3. update grpc to use AIJobData instead of separate fields in proto file

    @ad-astra-video
    ad-astra-video committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    b7217fa View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2024

  1. expand backwards compatibility comment

    @ad-astra-video
    ad-astra-video committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    4e662f3 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2024

  1. update ExtensionByType to a switch to avoid unpredictable results fro… 

    …m system defined extensions for mimetypes
    @ad-astra-video
    ad-astra-video committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    a3b07c0 View commit details
    Browse the repository at this point in the history

  2. fix combined Orch+AI worker image-to-video to convert response to url… 

    … saved in node storage
    @ad-astra-video
    ad-astra-video committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    1ca3a0b View commit details
    Browse the repository at this point in the history

  3. move defer to after err check

    @ad-astra-video
    ad-astra-video committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    20e1234 View commit details
    Browse the repository at this point in the history

  4. fix channels for streaming response

    @ad-astra-video
    ad-astra-video committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    dabc0e8 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. remove aiJobMutex not used

    @ad-astra-video
    ad-astra-video committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    e2d4bdb View commit details
    Browse the repository at this point in the history

  2. update number for capabilities field in RegisterAIWorkerRequest

    @ad-astra-video
    ad-astra-video committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    3dc663e View commit details
    Browse the repository at this point in the history

  3. grpc codegen updates

    @ad-astra-video
    ad-astra-video committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    8c7889c View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. remove url from grpc AIJobData

    @ad-astra-video
    ad-astra-video committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    49317fb View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. refactor: fix AImodels startup error 

    This commit ensures that the AImodels startup error is only thrown for
AIWorkers.
    @rickstaa
    rickstaa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    b59e04c View commit details
    Browse the repository at this point in the history

  2. refactor: apply some small textual changes 

    This commit applies some small textual changes I noticed during my
review.
    @rickstaa
    rickstaa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    d084218 View commit details
    Browse the repository at this point in the history