mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-05-12 13:49:51 -05:00
Code Issues Packages Projects Releases Wiki Activity
4,947 Commits 98 Branches 146 Tags
a86fdc408766c612ae1afb27434e02eba483d1a3
Commit Graph

361 Commits

Author SHA1 Message Date
Ettore Di Giacinto a86fdc4087 Update binaries.md with macOS download instructions 
Added download instructions for macOS DMG file and updated command for Linux and macOS.

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-11-04 12:06:56 +01:00
LocalAI [bot] e485bdf9ab docs: ⬆️ update docs version mudler/LocalAI (#6996) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-11-01 21:08:08 +00:00
Ettore Di Giacinto 238aad666e chore(deps): bump cogito (#6785) 
chore(deps): Bump cogito

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-10-27 10:07:31 +01:00
Chakib Benziane 32c0ab3a7f fix: properly terminate llama.cpp kv_overrides array with empty key + updated doc (#6672) 
* fix: properly terminate kv_overrides array with empty key

The llama model loading function expects KV overrides to be terminated
with an empty key (key[0] == 0). Previously, the kv_overrides vector was
not being properly terminated, causing an assertion failure.

This commit ensures that after parsing all KV override strings, we add a
final terminating entry with an empty key to satisfy the C-style array
termination requirement. This fixes the assertion error and allows the
model to load correctly with custom KV overrides.

Fixes #6643

- Also included a reference to the usage of the `overrides` option in
  the advanced-usage section.

Signed-off-by: blob42 <contact@blob42.xyz>

* doc: document the `overrides` option

---------

Signed-off-by: blob42 <contact@blob42.xyz>
 2025-10-23 09:31:55 +02:00
Ettore Di Giacinto a22f6a499d feat(mcp): add planning and reevaluation (#6541) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-10-18 18:26:32 +02:00
Ettore Di Giacinto e963e16bc5 Remove model size guidance from FAQ 
Removed redundant information about model sizes in the WebUI.

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-10-10 21:50:56 +02:00
Ettore Di Giacinto 1e9b115251 chore(docs): enhancements and clarifications (#6433) 
chore(docs): Small enhancements

Fixes: https://github.com/mudler/LocalAI/issues/6250
Relates to: https://github.com/mudler/LocalAI/issues/6251
Fixes: https://github.com/mudler/LocalAI/issues/6249
Fixes: https://github.com/mudler/LocalAI/issues/6250
Fixes: https://github.com/mudler/LocalAI/issues/6253

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-10-10 21:31:11 +02:00
Ettore Di Giacinto cb0ed55d89 feat(neutts): add backend (#6404) 
* feat(neutts): add backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(ci): add images to CI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(gallery): add Neutts

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make it work with quantized versions

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Apply suggestion from @mudler

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

* Apply suggestion from @mudler

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

* Apply suggestion from @mudler

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-10-09 21:51:28 +02:00
Ettore Di Giacinto c38564e22c Update docs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-10-07 16:25:03 +02:00
Ettore Di Giacinto 183559bb98 chore(docs): add MCP example (#6405) 
docs update

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-10-07 11:42:28 +02:00
Ettore Di Giacinto 85e27ec74c feat: add agent options to model config (#6383) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-10-05 21:54:04 +02:00
Ettore Di Giacinto 698205a2f3 Add links to Awesome MCPs and MCPs by mudler 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-10-05 21:27:44 +02:00
Ettore Di Giacinto 930553ef60 Update mcp.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-10-05 18:21:02 +02:00
Ettore Di Giacinto 60b6472fa0 feat: Add Agentic MCP support with a new chat/completion endpoint (#6381) 
* WIP - add endpoint

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Rename

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Wire the Completion API

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Try to make it functional

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Almost functional

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Bump golang versions used in tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add description of the tool

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make it working

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Small optimizations

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Cleanup/refactor

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-10-05 17:51:41 +02:00
LocalAI [bot] 530c174fd3 docs: ⬆️ update docs version mudler/LocalAI (#6378) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-10-03 23:26:09 +02:00
LocalAI [bot] 357bf571a3 docs: ⬆️ update docs version mudler/LocalAI (#6318) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-09-21 08:40:00 +02:00
LocalAI [bot] f7f26b8efa docs: ⬆️ update docs version mudler/LocalAI (#6315) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-09-20 09:41:58 +02:00
LocalAI [bot] d3c5c02837 docs: ⬆️ update docs version mudler/LocalAI (#6307) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-09-18 23:48:02 +02:00
LocalAI [bot] 542f07ab2d docs: ⬆️ update docs version mudler/LocalAI (#6305) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-09-17 21:06:50 +00:00
Gianluca Boiano d0e99562af chore(aio): upgrade minicpm-v model to latest 4.5 (#6262) 
chore(aio): upgrade vision model to MiniCPM-V 4.5

Signed-off-by: Gianluca Boiano <morf3089@gmail.com>
 2025-09-14 15:04:58 +02:00
Mauro Morales 59311d8b1e Point to LocalAI-examples repo for llava (#6241) 
Signed-off-by: Mauro Morales <contact@mauromorales.com>
 2025-09-09 16:40:55 +02:00
Ettore Di Giacinto 0b528458d8 chore(docs): add MacOS dmg download button (#6233) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-09-09 00:19:37 +02:00
Ettore Di Giacinto e905e90dd7 Add MLX-audio entry to compatibility table 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-09-08 09:54:01 +02:00
Aliz Fara 9911ec84a3 Fix Typos in Docs (#6204) 
Signed-off-by: alizfara112 <alizfaraafa@gmail.com>
 2025-09-05 22:11:21 +02:00
LocalAI [bot] 326f6e5ccb docs: ⬆️ update docs version mudler/LocalAI (#6201) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-09-04 21:03:02 +00:00
Ettore Di Giacinto 43e0437db6 Revise GPU usage recommendations in documentation 
Updated recommendations for GPU usage on Xorg.

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-09-01 22:20:41 +02:00
Ettore Di Giacinto 195aa22e77 chore(docs): update list of supported backends (#6134) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-08-24 20:09:19 +02:00
Ettore Di Giacinto c899e90277 Update image-generation.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-08-20 10:37:11 +02:00
LocalAI [bot] b70ee45fff docs: ⬆️ update docs version mudler/LocalAI (#6046) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-08-12 22:05:50 +02:00
lnnt 7d41551e10 docs: update links in advanced-usage and models documentation (#5994) 
* docs: update links in advanced-usage and models documentation

* docs: update links in advanced-usage and models documentation
 2025-08-08 10:23:42 +02:00
LocalAI [bot] e83652489c docs: ⬆️ update docs version mudler/LocalAI (#5967) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-08-04 21:00:23 +00:00
LocalAI [bot] a1e1942d83 docs: ⬆️ update docs version mudler/LocalAI (#5956) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-08-01 22:14:23 +02:00
Dedy F. Setyawan 787302b204 fix(docs): Improve responsiveness of tables (#5954) 
Signed-off-by: Dedy F. Setyawan <dedyfajars@gmail.com>
 2025-08-01 22:13:53 +02:00
Richard Palethorpe c07bc55fee fix(intel): Set GPU vendor on Intel images and cleanup (#5945) 
Signed-off-by: Richard Palethorpe <io@richiejp.com>
 2025-07-31 19:44:46 +02:00
LocalAI [bot] 9d7ec09ec0 docs: ⬆️ update docs version mudler/LocalAI (#5929) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-07-28 21:03:44 +00:00
Ettore Di Giacinto 949e5b9be8 feat(rfdetr): add object detection API (#5923) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-27 22:02:51 +02:00
LocalAI [bot] 078c22f485 docs: ⬆️ update docs version mudler/LocalAI (#5920) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-07-26 20:58:54 +00:00
Ettore Di Giacinto 6ef3852de5 chore(docs): fixup tag 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-26 21:25:07 +02:00
Ettore Di Giacinto a8057b952c fix(cuda): be consistent with image tag naming (#5916) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-26 08:30:59 +02:00
Ettore Di Giacinto fd5c1d916f chore(docs): add documentation on backend detection override (#5915) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-26 08:18:31 +02:00
LocalAI [bot] a760f7ff39 docs: ⬆️ update docs version mudler/LocalAI (#5912) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2025-07-25 22:15:16 +02:00
Ettore Di Giacinto facf7625f3 fix(vulkan): use correct image suffix (#5911) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-25 19:20:20 +02:00
Ettore Di Giacinto 3973e6e5da fix(install.sh): update to use the new binary naming (#5903) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-25 10:43:22 +02:00
Ettore Di Giacinto deda3a4972 Update build documentation 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-24 22:53:08 +02:00
Ettore Di Giacinto a28f27604a Update backends.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-07-24 16:18:25 +02:00
Nathaniel Hyson 4db1b80278 Update quickstart.md (#5898) 
Fixed spelling mistake

Signed-off-by: Nathaniel Hyson <Shinrai@users.noreply.github.com>
 2025-07-24 15:04:02 +02:00
Ettore Di Giacinto 5f7ece3e94 fix(p2p): adapt to backend changes, general improvements (#5889) 
The binary is now named "llama-cpp-rpc-server" for p2p workers.

We also decrease the default token rotation interval, in this way
peer discovery is much more responsive.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-23 12:40:32 +02:00
Ettore Di Giacinto 98e5291afc feat: refactor build process, drop embedded backends (#5875) 
* feat: split remaining backends and drop embedded backends

- Drop silero-vad, huggingface, and stores backend from embedded
  binaries
- Refactor Makefile and Dockerfile to avoid building grpc backends
- Drop golang code that was used to embed backends
- Simplify building by using goreleaser

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(gallery): be specific with llama-cpp backend templates

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(docs): update

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(ci): minor fixes

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: drop all ffmpeg references

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix: run protogen-go

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Always enable p2p mode

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update gorelease file

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(stores): do not always load

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fix linting issues

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Simplify

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Mac OS fixup

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-07-22 16:31:04 +02:00
Dedy F. Setyawan a1d061c835 fix(docs): Resolve logo overlap on tablet view (#5853) 
* fix(docs): Resolve logo overlap on tablet view

Signed-off-by: Dedy F. Setyawan <dedyfajars@gmail.com>

* fix(docs): Adjust header logo size

Signed-off-by: Dedy F. Setyawan <dedyfajars@gmail.com>

* refactor(docs): Rework header logo sizing implementation

Signed-off-by: Dedy F. Setyawan <dedyfajars@gmail.com>

---------

Signed-off-by: Dedy F. Setyawan <dedyfajars@gmail.com>
 2025-07-18 15:55:44 +02:00
Ettore Di Giacinto 7e1f2657d5 Update GPU-acceleration.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-07-06 19:03:34 +02:00