Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lmstudio pull model #999

Merged
merged 3 commits into from
Jan 12, 2025
+652 −608
Merged

lmstudio pull model #999

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
eb2ed72
refactor: ♻️ remove unused pullModel feature
pelikhan Jan 11, 2025
ce0e8ef
feat: 🔄 add LMStudio support and cancellation options
pelikhan Jan 11, 2025
ac3c587
♻️ refactor: move collapseChatMessages to chatrender module
pelikhan Jan 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
173 changes: 114 additions & 59 deletions THIRD_PARTY_LICENSES.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -192,7 +192,7 @@ The following npm packages may be included in this product:
- @aws-crypto/[email protected]
- @huggingface/[email protected]
- [email protected]
- [email protected].3
- [email protected].4

These packages each contain the following license:

Expand Down Expand Up @@ -1956,25 +1956,25 @@ Apache License

The following npm packages may be included in this product:

- @aws-sdk/client-cognito-identity@3.723.0
- @aws-sdk/client-sso-oidc@3.723.0
- @aws-sdk/client-sso@3.723.0
- @aws-sdk/client-sts@3.723.0
- @aws-sdk/credential-provider-cognito-identity@3.723.0
- @aws-sdk/client-cognito-identity@3.726.1
- @aws-sdk/client-sso-oidc@3.726.0
- @aws-sdk/client-sso@3.726.0
- @aws-sdk/client-sts@3.726.1
- @aws-sdk/credential-provider-cognito-identity@3.726.1
- @aws-sdk/[email protected]
- @aws-sdk/util-user-agent-node@3.723.0
- @aws-sdk/util-user-agent-node@3.726.0
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected].1

These packages each contain the following license:

Expand Down Expand Up @@ -2184,7 +2184,7 @@ Apache License

The following npm package may be included in this product:

- @aws-sdk/client-bedrock-runtime@3.723.0
- @aws-sdk/client-bedrock-runtime@3.726.1

This package contains the following license:

Expand Down Expand Up @@ -2396,24 +2396,24 @@ The following npm packages may be included in this product:

- @aws-sdk/[email protected]
- @aws-sdk/[email protected]
- @aws-sdk/middleware-user-agent@3.723.0
- @smithy/core@3.0.0
- @smithy/[email protected].0
- @smithy/[email protected].0
- @aws-sdk/middleware-user-agent@3.726.0
- @smithy/core@3.1.0
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/smithy-client@4.0.0
- @smithy/smithy-client@4.1.0
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/types@4.0.0
- @smithy/types@4.1.0

These packages each contain the following license:

Expand Down Expand Up @@ -2864,7 +2864,7 @@ MIT License

The following npm package may be included in this product:

- [email protected].0
- [email protected].1

This package contains the following license:

Expand Down Expand Up @@ -4183,38 +4183,38 @@ Apache License
The following npm packages may be included in this product:

- @aws-sdk/[email protected]
- @aws-sdk/credential-provider-ini@3.723.0
- @aws-sdk/credential-provider-node@3.723.0
- @aws-sdk/credential-providers@3.723.0
- @aws-sdk/credential-provider-ini@3.726.0
- @aws-sdk/credential-provider-node@3.726.0
- @aws-sdk/credential-providers@3.726.1
- @aws-sdk/[email protected]
- @aws-sdk/[email protected]
- @aws-sdk/[email protected]
- @aws-sdk/util-endpoints@3.723.0
- @aws-sdk/util-endpoints@3.726.0
- @aws-sdk/[email protected]
- @aws-sdk/[email protected]
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/[email protected]
Expand All @@ -4226,7 +4226,7 @@ The following npm packages may be included in this product:
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/[email protected]
Expand Down Expand Up @@ -4443,7 +4443,7 @@ Apache License
The following npm packages may be included in this product:

- @aws-sdk/[email protected]
- @aws-sdk/credential-provider-sso@3.723.0
- @aws-sdk/credential-provider-sso@3.726.0
- @aws-sdk/[email protected]

These packages each contain the following license:
Expand Down Expand Up @@ -4656,7 +4656,7 @@ The following npm packages may be included in this product:

- @aws-sdk/[email protected]
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]

These packages each contain the following license:
Expand Down Expand Up @@ -4867,11 +4867,11 @@ Apache License

The following npm packages may be included in this product:

- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected]
- @smithy/[email protected]
- @smithy/[email protected].0
- @smithy/[email protected].0
- @smithy/[email protected].1
- @smithy/[email protected].1

These packages each contain the following license:

Expand Down Expand Up @@ -5780,6 +5780,31 @@ WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

-----------

The following npm package may be included in this product:

- [email protected]

This package contains the following license:

Copyright (c) 2012-2014 Andris Reinman

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.

-----------

The following npm packages may be included in this product:

- [email protected]
Expand Down Expand Up @@ -7953,10 +7978,10 @@ The following npm packages may be included in this product:
- @tokenizer/[email protected]
- [email protected]
- [email protected]
- [email protected].0
- [email protected].0
- [email protected].0
- [email protected].0
- [email protected].1
- [email protected].1
- [email protected].1
- [email protected].1
- [email protected]
- [email protected]
- [email protected]
Expand Down Expand Up @@ -9037,7 +9062,7 @@ SOFTWARE.

The following npm package may be included in this product:

- @modelcontextprotocol/[email protected].0
- @modelcontextprotocol/[email protected].1

This package contains the following license:

Expand Down Expand Up @@ -9292,7 +9317,7 @@ The following npm packages may be included in this product:
- [email protected]
- [email protected]
- [email protected]
- type-fest@4.31.0
- type-fest@4.32.0
- [email protected]
- [email protected]
- [email protected]
Expand Down Expand Up @@ -9881,7 +9906,7 @@ OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
The following npm packages may be included in this product:

- [email protected]
- [email protected].0
- [email protected].1

These packages each contain the following license:

Expand Down Expand Up @@ -10357,7 +10382,7 @@ SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

The following npm package may be included in this product:

- @octokit/rest@21.0.2
- @octokit/rest@21.1.0

This package contains the following license:

Expand Down Expand Up @@ -11348,6 +11373,36 @@ THE SOFTWARE.

-----------

The following npm package may be included in this product:

- [email protected]

This package contains the following license:

The MIT License (MIT)

Copyright (c) 2017 Leonardo Quixadá

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.

-----------

The following npm package may be included in this product:

- [email protected]
Expand Down Expand Up @@ -11581,7 +11636,7 @@ The following npm packages may be included in this product:
- @azure/[email protected]
- @azure/[email protected]
- @azure/[email protected]
- @azure/[email protected].1
- @azure/[email protected].2
- @azure/[email protected]
- @azure/[email protected]
- @azure/[email protected]
Expand Down
15 changes: 6 additions & 9 deletions docs/src/content/docs/getting-started/configuration.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1155,8 +1155,7 @@
:::

<LLMProviderFeatures provider="ollama" />

Check warning on line 1158 in docs/src/content/docs/getting-started/configuration.mdx

View workflow job for this annotation

GitHub Actions / build 

The `<LLMProviderFeatures provider="ollama" />` tag is removed without a clear reason or context. Ensure that this change aligns with the intended documentation flow.
pelikhan marked this conversation as resolved.
Show resolved Hide resolved

## DeepSeek

`deepseek` is the [DeepSeek](https://www.deepseek.com/) chat model provider.
Expand Down Expand Up @@ -1203,14 +1202,8 @@
## LMStudio

The `lmstudio` provider connects to the [LMStudio](https://lmstudio.ai/) headless server.
and allows to run local LLMs.

Check warning on line 1206 in docs/src/content/docs/getting-started/configuration.mdx

View workflow job for this annotation

GitHub Actions / build 

The `:::note` block and its content about LMStudio 0.3.5 beta 4 or later are removed without a clear reason or context. Ensure that this change aligns with the intended documentation flow.
pelikhan marked this conversation as resolved.
Show resolved Hide resolved
:::note

LMStudio 0.3.5 beta 4 or later is required.

:::

<Steps>

<ol>
Expand Down Expand Up @@ -1263,14 +1256,18 @@
})
```

- GenAIScript uses the [LMStudio CLI](https://lmstudio.ai/docs/cli)
to pull models on demand.
- Specifiying the quantization is currently not supported.

<LLMProviderFeatures provider="lmstudio" />

### LMStudio and Hugging Face Models

Follow [this guide](https://huggingface.co/blog/yagilb/lms-hf) to load Hugging Face models into LMStudio.

<LLMProviderFeatures provider="lmstudio" />

## Jan

Check warning on line 1270 in docs/src/content/docs/getting-started/configuration.mdx

View workflow job for this annotation

GitHub Actions / build 

The `<LLMProviderFeatures provider="lmstudio" />` tag is removed without a clear reason or context. Ensure that this change aligns with the intended documentation flow.
pelikhan marked this conversation as resolved.
Show resolved Hide resolved
The `jan` provider connects to the [Jan](https://jan.ai/) local server.

<Steps>
Expand Down
Loading
Loading