Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Standalone remote client #37

Merged
merged 21 commits into from
Apr 15, 2024
Merged

Standalone remote client #37

merged 21 commits into from
Apr 15, 2024

Conversation

gmertes
Copy link
Member

@gmertes gmertes commented Apr 9, 2024

Remote execution no longer needs a local copy of trained model assets. Checkpoint data (and any missing local model parameter) is fetched from the server. Tested and working for all model plugins.

Also supports remote patch_retrieve_requests, the server will send back the patched request if the model requires it.

Changes:

  • Adds a new model class RemoteModel that handles the remote model run and parameter fetching
  • Add a tqdm progress bar during remote inference
  • All the remote code now lives in its own subpackage remote
  • Create an empty remote config file during pip install at ~/.config/ai-models/api.yaml
  • Remote models can be queried with --models --remote

@gmertes gmertes merged commit 4fda395 into develop Apr 15, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant