Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] master from mudler:master #70

Merged
merged 49 commits into from
Apr 28, 2024
Merged

[pull] master from mudler:master #70

merged 49 commits into from
Apr 28, 2024

Conversation

pull[bot]
Copy link

@pull pull bot commented Apr 24, 2024

See Commits and Changes for more details.


Created by pull[bot]

Can you help keep this open source service alive? 💖 Please sponsor : )

mudler and others added 16 commits April 23, 2024 09:22
* WIP: add models to webui

Signed-off-by: Ettore Di Giacinto <[email protected]>

* Register routes

Signed-off-by: Ettore Di Giacinto <[email protected]>

* fix: don't cache models

Signed-off-by: Ettore Di Giacinto <[email protected]>

* small fixups

Signed-off-by: Ettore Di Giacinto <[email protected]>

* fix: fixup multiple installs (strings.Clone)

Signed-off-by: Ettore Di Giacinto <[email protected]>

---------

Signed-off-by: Ettore Di Giacinto <[email protected]>
max token adherence to OpenAI API

improve adherence to OpenAI API when max tokens is omitted or equal to 0 in the request
* fix: update dockerignore and gitignore to exclude sonarqube work dir

Signed-off-by: Chris Jowett <[email protected]>

* fix: remove useless equality check

Signed-off-by: Chris Jowett <[email protected]>

* fix: use sonarqube Dockerfile recommendations

Signed-off-by: Chris Jowett <[email protected]>

---------

Signed-off-by: Chris Jowett <[email protected]>
Show image if present, URL, tags, and better display buttons

Signed-off-by: Ettore Di Giacinto <[email protected]>
Also adds embeddings and llava models

Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
* Update diffusers.yml

Signed-off-by: jtwolfe <[email protected]>

* Update diffusers-rocm.yml

Signed-off-by: jtwolfe <[email protected]>

---------

Signed-off-by: jtwolfe <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
)

deps(llama.cpp): update

Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
localai-bot and others added 9 commits April 24, 2024 22:00
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
* models: add reranker and parler-tts-mini

Signed-off-by: Ettore Di Giacinto <[email protected]>

* fix: chatml im_end should not have a newline

Signed-off-by: Ettore Di Giacinto <[email protected]>

* models(noromaid): add

Signed-off-by: Ettore Di Giacinto <[email protected]>

* models(llama3): add 70b, add dolphin2.9

Signed-off-by: Ettore Di Giacinto <[email protected]>

* models(llama3): add unholy-8b

Signed-off-by: Ettore Di Giacinto <[email protected]>

* models(llama3): add therapyllama3, aura

Signed-off-by: Ettore Di Giacinto <[email protected]>

---------

Signed-off-by: Ettore Di Giacinto <[email protected]>
…ain/langchainpy-localai-example in the pip group across 1 directory (#2125)

build(deps): bump pydantic

Bumps the pip group with 1 update in the /examples/langchain/langchainpy-localai-example directory: [pydantic](https://github.com/pydantic/pydantic).


Updates `pydantic` from 1.10.7 to 1.10.13
- [Release notes](https://github.com/pydantic/pydantic/releases)
- [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md)
- [Commits](pydantic/pydantic@v1.10.7...v1.10.13)

---
updated-dependencies:
- dependency-name: pydantic
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
localai-bot and others added 22 commits April 25, 2024 16:10
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
fix yamlint warnings and errors

Signed-off-by: Dave Lee <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
quiet more security scanner issues: pass one of chmod restriction to remove group and other permissions

Signed-off-by: Dave Lee <[email protected]>
quick update of the langchainjs example to quiet down some dependency security scanner noise

Signed-off-by: Dave Lee <[email protected]>
runCommand ==> ffmpegCommand. No functional changes, but makes it clear to the security scanner and future developers that this function cannot run arbitrary commands

Signed-off-by: Dave Lee <[email protected]>
first group of error handlers to reduce security scanner warning noise level

Signed-off-by: Dave Lee <[email protected]>
use bluemonday as recommended by blackfriday

Signed-off-by: Dave Lee <[email protected]>
* Bump oneapi-basekit, optimum and openvino

* Changed PERFORMANCE HINT to CUMULATIVE_THROUGHPUT

Minor latency change for first token but about 10-15% speedup on token generation.
callHandler() now has all file access rooted within DynamicConfigDir

Signed-off-by: Dave Lee <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
* feat(gallery): keep showing progress also when refreshing

Signed-off-by: Ettore Di Giacinto <[email protected]>

* fix(intel-gpu): better defaults

Signed-off-by: Ettore Di Giacinto <[email protected]>

* feat: make it thread-safe

Signed-off-by: mudler <[email protected]>

---------

Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: mudler <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
* feat: cleanup Dockerfile and make final image a little smaller

Signed-off-by: Chris Jowett <[email protected]>

* fix: add build-essential to final stage

Signed-off-by: Chris Jowett <[email protected]>

* fix: more GRPC cache misses

Signed-off-by: Chris Jowett <[email protected]>

* fix: correct for another cause of GRPC cache misses

Signed-off-by: Chris Jowett <[email protected]>

* feat: generate new GRPC cache automatically if needed

Signed-off-by: Chris Jowett <[email protected]>

* fix: use new GRPC_MAKEFLAGS build arg in GRPC cache generation

Signed-off-by: Chris Jowett <[email protected]>

---------

Signed-off-by: Chris Jowett <[email protected]>
@github-actions github-actions bot added the ci label Apr 27, 2024
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <[email protected]>
@pull pull bot merged commit c398221 into kp-forks:master Apr 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants