491e1d752b
feat(functions): relax mixedgrammars ( #2365 )
...
* feat(functions): relax mixedgrammars
Extend even more the functionalities and when mixed mode is enabled,
tolerate also both strings and JSON in the result - in this case we make
sure that the JSON can be correctly parsed.
This also updates the examples and the gallery model to configure the
grammar.
The changeset also breaks current function/grammar configuration as it
reserves now a stanza in the YAML config.
For example:
```yaml
function:
grammar:
# This allows the grammar to also return messages
mixed_mode: true
# Suffix to add to the grammar
# prefix: '<tool_call>\n'
# Force parallel calls in the grammar
# parallel_calls: true
```
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* refactor, add a way to disable mixed json and freestring
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Fix linting issues
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-22 00:14:16 +02:00
1542c58466
fix(gallery): checksum Meta-Llama-3-70B-Instruct.Q4_K_M.gguf - #2364 ( #2366 )
...
Signed-off-by: Gerrit Pannek <nold@gnu.one >
2024-05-21 21:51:48 +02:00
a58ff00ab1
models(gallery): add stheno ( #2358 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-20 19:18:14 +02:00
7a480bb16f
models(gallery): add LocalAI-Llama3-8b-Function-Call-v0.2-GGUF ( #2355 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-20 00:59:17 +02:00
a10a952085
models(gallery): update poppy porpoise mmproj ( #2346 )
...
models(gallery): update poppy porpose mmproj
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-19 13:26:02 +02:00
b37447cac5
models(gallery): add master-yi ( #2345 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-19 13:25:29 +02:00
f2d182a2eb
models(gallery): add anita ( #2344 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-19 13:25:16 +02:00
e0ef9e2bb9
models(gallery): add yi 6/9b, sqlcoder, sfr-iterative-dpo ( #2335 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-16 20:05:20 +02:00
f7508e3888
models(gallery): add hermes-2-theta-llama-3-8b ( #2331 )
...
Signed-off-by: mudler <mudler@localai.io >
2024-05-16 00:22:32 +02:00
badfc16df1
fix(gallery) Correct llama3-8b-instruct model file ( #2330 )
...
Correct llama3-8b-instruct model file
This must be a mistake because the config tries to use a model file that is different from the one actually being downloaded.
I assumed the downloaded file is what should be used so I corrected the specified model file to that
Signed-off-by: Aleksandr Oleinikov <10602045+tannisroot@users.noreply.github.com >
2024-05-16 00:22:05 +02:00
7123d07456
models(gallery): add orthocopter ( #2313 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-13 18:45:58 +02:00
2db22087ae
models(gallery): add lumimaidv2 ( #2312 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-13 18:44:44 +02:00
fa7b2aee9c
models(gallery): add Bunny-llama ( #2311 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-13 18:44:25 +02:00
4d70b6fb2d
models(gallery): add aura-llama-Abliterated ( #2309 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-13 18:44:10 +02:00
310b2171be
models(gallery): add llama-3-refueled ( #2297 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-12 09:39:58 +02:00
98af0b5d85
models(gallery): add jsl-medllama-3-8b-v2.0 ( #2296 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-12 09:38:05 +02:00
ca14f95d2c
models(gallery): add l3-chaoticsoliloquy-v1.5-4x8b ( #2295 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-12 09:37:55 +02:00
7f4febd6c2
models(gallery): add Llama-3-8B-Instruct-abliterated ( #2288 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-11 10:10:57 +02:00
4db41b71f3
models(gallery): add aloe ( #2283 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-10 16:01:47 +02:00
f69de3be0d
models(gallery): ⬆️ update checksum ( #2278 )
...
⬆️ Checksum updates in gallery/index.yaml
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-05-09 12:21:24 +00:00
ea777f8716
models(gallery): update SHA for einstein
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-08 23:40:58 +02:00
0809e9e7a0
models(gallery): fix openbiollm typo
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-08 23:19:43 +02:00
6eb77f0d3a
models(gallery): add tiamat ( #2269 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-08 19:59:42 +02:00
b20354b3ad
models(gallery): add aurora ( #2270 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-08 19:55:39 +02:00
d6f76c75e1
models(gallery): add kunocchini ( #2268 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-08 19:52:08 +02:00
ed4f412f1c
models(gallery): add lumimaid variant ( #2267 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-08 19:51:53 +02:00
5bf56e01aa
models(gallery): add tess ( #2266 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-08 19:51:44 +02:00
02ec546dd6
models(gallery): Add Soliloquy ( #2260 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-08 00:14:19 +02:00
477655f6e6
models(gallery): average_norrmie reupload
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-06 19:56:24 +02:00
169d8d21ff
gallery: Added some OpenVINO models ( #2249 )
...
* Added some OpenVINO models
Added Phi-3 trust_remote_code: true
Added Hermes 2 Pro Llama3
Added Multilingual-E5-base embedding model with OpenVINO acceleration (CPU and XPU)
Added all-MiniLM-L6-v2 with OpenVINO acceleration (CPU and XPU)
* Added Remote Code for phi, fixed error on Yamllint
* update openvino.yaml
I need to go to rest: today is not my day...
2024-05-06 10:52:05 +02:00
5cb96fe7df
models(gallery): add openbiollm ( #2245 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-05 15:19:46 +02:00
810e8e5855
models(gallery): add lumimaid ( #2244 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-05 15:19:33 +02:00
f3bcc648e7
models(gallery): add icon for instruct-coder
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-05 12:20:06 +02:00
3096566333
models(gallery): poppy porpoise fix
...
correct mmproj URL
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-05 11:56:07 +02:00
f50c6a4e88
models(gallery): update poppy porpoise ( #2243 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-05 11:19:09 +02:00
ab4ee54855
models(gallery): add llama3-instruct-coder ( #2242 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-05 11:18:50 +02:00
f2d35062d4
models(gallery): moondream2 fixups
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-05 10:49:04 +02:00
92f7feb874
models(gallery): add llama3-llava ( #2238 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-04 22:43:11 +02:00
b70e2bffa3
models(gallery): add moondream2 ( #2237 )
...
* models(gallery): add moondream2
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* models(gallery): fix typo for TTS models
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* models(gallery): add base config for moondream2 and icon
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* linter fixes
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-04 18:29:04 +02:00
06c43ca285
fix(gallery): hermes-2-pro-llama3 models checksum changed ( #2236 )
...
fix(gallery): hermes-2-pro-llama3 models checksum
Signed-off-by: Gerrit Pannek <nold@gnu.one >
2024-05-04 17:59:54 +02:00
f7f8b4804b
models(gallery): Add Hermes-2-Pro-Llama-3-8B-GGUF ( #2218 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-02 18:31:13 +02:00
e5bd9a76c7
models(gallery): add wizardlm2 ( #2209 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-05-02 18:31:02 +02:00
962ebbaf77
models(gallery): fixup phi-3 sha
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-05-01 23:06:58 +02:00
445cfd4db3
models(gallery): add guillaumetell ( #2195 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-30 23:24:41 +02:00
b24d44dc56
models(gallery): add suzume-llama-3-8B-multilingual-gguf ( #2194 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-30 23:24:28 +02:00
cd31f8d865
models(gallery): add lexifun ( #2193 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-30 23:24:13 +02:00
baff5ff8c2
models(gallery): add openvino models ( #2184 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-29 18:17:47 +02:00
ea13863221
models(gallery): add llama3-32k ( #2183 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-04-29 18:17:39 +02:00
a8089494fd
models(gallery): add biomistral-7b ( #2161 )
...
* models(gallery): add biomistral-7b
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
* add <|end_of_text|> to llama3 as stopword
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-04-28 12:04:04 +02:00
a248ede222
models(gallery): add Undi95/Llama-3-LewdPlay-8B-evo-GGUF ( #2160 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-04-28 12:02:50 +02:00
Ettore Di Giacinto