be6c4e6061
fix(llama-cpp): consistently select fallback ( #3789 )
...
* fix(llama-cpp): consistently select fallback
We didn't took in consideration the case where the host has the CPU
flagset, but the binaries were not actually present in the asset dir.
This made possible for instance for models that specified the llama-cpp
backend directly in the config to not eventually pick-up the fallback
binary in case the optimized binaries were not present.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* chore: adjust and simplify selection
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix: move failure recovery to BackendLoader()
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* comments
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* minor fixups
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-11 16:55:57 +02:00
1996e6f4c9
chore: ⬆️ Update ggerganov/llama.cpp to 0e9f760eb12546704ef8fa72577bc1a3ffe1bc04 ( #3786 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-10 21:46:50 +00:00
671cd42917
chore(gallery): do not specify backend with moondream
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-10-10 19:54:07 +02:00
568a01bf5c
models(gallery): add gemma-2-ataraxy-v3i-9b ( #3785 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 19:16:23 +02:00
164abb8c9f
models(gallery): add fireball-meta-llama-3.2-8b-instruct-agent-003-128k-code-dpo ( #3784 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 19:13:47 +02:00
ed2946feac
models(gallery): add llama-3.2-3b-agent007-coder ( #3783 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 19:11:50 +02:00
bdd351b372
models(gallery): add nihappy-l3.1-8b-v0.09 ( #3782 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 19:09:49 +02:00
ad5e7d376a
models(gallery): add llama-3.2-3b-agent007 ( #3781 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 19:06:58 +02:00
6e78d8cd9d
models(gallery): add dans-personalityengine-v1.0.0-8b ( #3780 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 18:56:01 +02:00
614125f268
models(gallery): add qwen2.5-7b-ins-v3 ( #3779 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 15:05:09 +02:00
f41965bfb5
models(gallery): add rombos-llm-v2.5.1-qwen-3b ( #3778 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-10 10:47:41 +02:00
85a3cc8d8f
feat(transformers): Use downloaded model for Transformers backend if it already exists. ( #3777 )
...
* signing commit
Signed-off-by: Josh Bennett <562773+joshbtn@users.noreply.github.com >
* Update transformers backend to check for existing model directory
Signed-off-by: Josh Bennett <562773+joshbtn@users.noreply.github.com >
---------
Signed-off-by: Josh Bennett <562773+joshbtn@users.noreply.github.com >
2024-10-10 08:42:59 +00:00
ea8675d473
chore: ⬆️ Update ggerganov/llama.cpp to c81f3bbb051f8b736e117dfc78c99d7c4e0450f6 ( #3775 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-09 21:40:46 +00:00
08a54c1812
models(gallery): add llama-3.1-swallow-70b-v0.1-i1 ( #3774 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-09 17:16:17 +02:00
8c7439b96e
models(gallery): add llama3.2-3b-esper2 ( #3773 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-09 17:08:13 +02:00
a9e42a76fa
models(gallery): add llama3.2-3b-enigma ( #3772 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-09 17:05:50 +02:00
1a3b3d3e67
models(gallery): add versatillama-llama-3.2-3b-instruct-abliterated ( #3771 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-09 16:58:34 +02:00
759d35e6b5
chore: ⬆️ Update ggerganov/whisper.cpp to fdbfb460ed546452a5d53611bba66d10d842e719 ( #3768 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-09 09:42:44 +02:00
825e85bcc5
chore: ⬆️ Update ggerganov/llama.cpp to dca1d4b58a7f1acf1bd253be84e50d6367f492fd ( #3769 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-08 21:41:05 +00:00
62165d556c
models(gallery): add archfunctions template
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-08 18:52:21 +02:00
78459889d8
models(gallery): add archfunctions models ( #3767 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-08 18:51:30 +02:00
0fdc6a92f6
models(gallery): add moe-girl-1ba-7bt-i1 ( #3766 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-08 18:38:27 +02:00
8586a0167a
chore: ⬆️ Update ggerganov/whisper.cpp to ebca09a3d1033417b0c630bbbe607b0f185b1488 ( #3764 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-08 09:35:18 +02:00
f1d16a45c5
chore: ⬆️ Update ggerganov/llama.cpp to 6374743747b14db4eb73ce82ae449a2978bc3b47 ( #3763 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-08 09:35:01 +02:00
2023627d7f
chore(deps): Bump appleboy/ssh-action from 1.0.3 to 1.1.0 ( #3762 )
...
Bumps [appleboy/ssh-action](https://github.com/appleboy/ssh-action ) from 1.0.3 to 1.1.0.
- [Release notes](https://github.com/appleboy/ssh-action/releases )
- [Changelog](https://github.com/appleboy/ssh-action/blob/master/.goreleaser.yaml )
- [Commits](https://github.com/appleboy/ssh-action/compare/v1.0.3...v1.1.0 )
---
updated-dependencies:
- dependency-name: appleboy/ssh-action
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:34:43 +02:00
d5e1958a1f
chore(deps): Bump nginx from 1.27.0 to 1.27.2 in /examples/k8sgpt ( #3761 )
...
Bumps nginx from 1.27.0 to 1.27.2.
---
updated-dependencies:
- dependency-name: nginx
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:34:23 +02:00
f9c58a01d3
chore(deps): Bump llama-index from 0.11.14 to 0.11.16 in /examples/langchain-chroma ( #3760 )
...
chore(deps): Bump llama-index in /examples/langchain-chroma
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.11.14 to 0.11.16.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.11.14...v0.11.16 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:34:05 +02:00
4500650000
chore(deps): Bump openai from 1.50.2 to 1.51.1 in /examples/langchain-chroma ( #3758 )
...
chore(deps): Bump openai in /examples/langchain-chroma
Bumps [openai](https://github.com/openai/openai-python ) from 1.50.2 to 1.51.1.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.50.2...v1.51.1 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:33:25 +02:00
5674e671d0
chore(deps): Bump langchain from 0.3.1 to 0.3.2 in /examples/langchain/langchainpy-localai-example ( #3752 )
...
chore(deps): Bump langchain
Bumps [langchain](https://github.com/langchain-ai/langchain ) from 0.3.1 to 0.3.2.
- [Release notes](https://github.com/langchain-ai/langchain/releases )
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.3.1...langchain==0.3.2 )
---
updated-dependencies:
- dependency-name: langchain
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:33:13 +02:00
0f44c3f69c
chore(deps): Bump debugpy from 1.8.2 to 1.8.6 in /examples/langchain/langchainpy-localai-example ( #3751 )
...
chore(deps): Bump debugpy
Bumps [debugpy](https://github.com/microsoft/debugpy ) from 1.8.2 to 1.8.6.
- [Release notes](https://github.com/microsoft/debugpy/releases )
- [Commits](https://github.com/microsoft/debugpy/compare/v1.8.2...v1.8.6 )
---
updated-dependencies:
- dependency-name: debugpy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:32:59 +02:00
f9069daf03
chore(deps): Bump streamlit from 1.38.0 to 1.39.0 in /examples/streamlit-bot ( #3757 )
...
chore(deps): Bump streamlit in /examples/streamlit-bot
Bumps [streamlit](https://github.com/streamlit/streamlit ) from 1.38.0 to 1.39.0.
- [Release notes](https://github.com/streamlit/streamlit/releases )
- [Commits](https://github.com/streamlit/streamlit/compare/1.38.0...1.39.0 )
---
updated-dependencies:
- dependency-name: streamlit
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:32:40 +02:00
5f58841a3a
chore(deps): Bump llama-index from 0.11.14 to 0.11.16 in /examples/chainlit ( #3753 )
...
chore(deps): Bump llama-index in /examples/chainlit
Bumps [llama-index](https://github.com/run-llama/llama_index ) from 0.11.14 to 0.11.16.
- [Release notes](https://github.com/run-llama/llama_index/releases )
- [Changelog](https://github.com/run-llama/llama_index/blob/main/CHANGELOG.md )
- [Commits](https://github.com/run-llama/llama_index/compare/v0.11.14...v0.11.16 )
---
updated-dependencies:
- dependency-name: llama-index
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:32:30 +02:00
287200e687
chore(deps): Bump aiohttp from 3.10.8 to 3.10.9 in /examples/langchain/langchainpy-localai-example ( #3750 )
...
chore(deps): Bump aiohttp
Bumps [aiohttp](https://github.com/aio-libs/aiohttp ) from 3.10.8 to 3.10.9.
- [Release notes](https://github.com/aio-libs/aiohttp/releases )
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst )
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.10.8...v3.10.9 )
---
updated-dependencies:
- dependency-name: aiohttp
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:32:18 +02:00
b653883c0a
chore(deps): Bump multidict from 6.0.5 to 6.1.0 in /examples/langchain/langchainpy-localai-example ( #3749 )
...
chore(deps): Bump multidict
Bumps [multidict](https://github.com/aio-libs/multidict ) from 6.0.5 to 6.1.0.
- [Release notes](https://github.com/aio-libs/multidict/releases )
- [Changelog](https://github.com/aio-libs/multidict/blob/master/CHANGES.rst )
- [Commits](https://github.com/aio-libs/multidict/compare/v6.0.5...v6.1.0 )
---
updated-dependencies:
- dependency-name: multidict
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:32:08 +02:00
6b8a402353
chore(deps): Bump openai from 1.45.1 to 1.51.1 in /examples/langchain/langchainpy-localai-example ( #3748 )
...
chore(deps): Bump openai
Bumps [openai](https://github.com/openai/openai-python ) from 1.45.1 to 1.51.1.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.45.1...v1.51.1 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 09:24:56 +02:00
d9b63fae7c
chore(tests): improve rwkv tests and consume TEST_FLAKES ( #3765 )
...
chores(tests): improve rwkv tests and consume TEST_FLAKES
consistently use TEST_FLAKES and reduce flakiness of rwkv tests by being
case insensitive
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-08 09:24:19 +02:00
377cdcabbf
chore(deps): Bump openai from 1.50.2 to 1.51.1 in /examples/functions ( #3754 )
...
Bumps [openai](https://github.com/openai/openai-python ) from 1.50.2 to 1.51.1.
- [Release notes](https://github.com/openai/openai-python/releases )
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-python/compare/v1.50.2...v1.51.1 )
---
updated-dependencies:
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-08 00:05:53 +00:00
92a7f40141
chore(deps): Bump langchain from 0.3.1 to 0.3.2 in /examples/functions ( #3755 )
...
Bumps [langchain](https://github.com/langchain-ai/langchain ) from 0.3.1 to 0.3.2.
- [Release notes](https://github.com/langchain-ai/langchain/releases )
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.3.1...langchain==0.3.2 )
---
updated-dependencies:
- dependency-name: langchain
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-07 21:04:18 +00:00
e06daf437a
chore(Dockerfile): default to cmake from package manager ( #3746 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-07 16:42:56 +02:00
d19bea4af2
chore(vllm): do not install from source ( #3745 )
...
chore(vllm): do not install from source by default
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-07 12:27:37 +02:00
fbca9f82fd
fix(vllm): bump cmake - vllm requires it ( #3744 )
...
* fix(vllm): bump cmake - vllm requires it
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* chore(tests): try to increase coqui timeout
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-07 11:22:55 +02:00
04f284d202
models(gallery): add gemma-2-9b-it-abliterated ( #3743 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-07 09:56:33 +02:00
cfd6112256
models(gallery): add violet_twilight-v0.2-iq-imatrix ( #3742 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-07 09:52:23 +02:00
debc0974a6
models(gallery): add t.e-8.1-iq-imatrix-request ( #3741 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-07 09:51:57 +02:00
03bbbea039
models(gallery): add mn-backyardai-party-12b-v1-iq-arm-imatrix ( #3740 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-07 09:46:44 +02:00
55af0b1c68
chore: ⬆️ Update ggerganov/whisper.cpp to 9f346d00840bcd7af62794871109841af40cecfb ( #3739 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-07 09:33:28 +02:00
c8bfb72104
chore: ⬆️ Update ggerganov/llama.cpp to d5cb86844f26f600c48bf3643738ea68138f961d ( #3738 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-06 21:40:25 +00:00
1b8a663001
chore: ⬆️ Update ggerganov/llama.cpp to 8c475b97b8ba7d678d4c9904b1161bd8811a9b44 ( #3736 )
...
⬆️ Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-06 10:10:13 +02:00
a9abfa2b61
chore: ⬆️ Update ggerganov/whisper.cpp to 6a94163b913d8e974e60d9ac56c8930d19f45773 ( #3735 )
...
⬆️ Update ggerganov/whisper.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-10-06 10:09:57 +02:00
092bb0bd6b
fix(base-grpc): close channel in base grpc server ( #3734 )
...
If the LLM does not implement any logic for PredictStream, we close the
channel immediately to not leave the process hanging.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-05 15:14:27 +02:00
Ettore Di Giacinto