mirror/LocalAI

mirror of https://github.com/mudler/LocalAI.git synced 2025-12-31 06:29:55 -06:00

Files

History

Brandon Beiler 6a6e1a0ea9 feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855 )

* Adding the following vLLM config options: disable_log_status, dtype, limit_mm_per_prompt

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

* using " marks in the config.yaml file

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

* adding in missing colon

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

---------

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

2025-02-18 19:27:58 +01:00

..

backend.py

feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855 )

2025-02-18 19:27:58 +01:00

install.sh

chore(deps): bump grpcio to 1.68.1 (#4301 )

2024-12-02 19:13:26 +01:00

Makefile

feat: create bash library to handle install/run/test of python backends (#2286 )

2024-05-11 18:32:46 +02:00

README.md

refactor: move backends into the backends directory (#1279 )

2023-11-13 22:40:16 +01:00

requirements-after.txt

fix(python): move vllm to after deps, drop diffusers main deps

2024-08-07 23:34:37 +02:00

requirements-cpu.txt

fix(dependencies): pin pytorch version (#3872 )

2024-10-18 09:11:59 +02:00

requirements-cublas11-after.txt

feat(venv): shared env (#3195 )

2024-08-07 19:45:14 +02:00

requirements-cublas11.txt

fix(dependencies): pin pytorch version (#3872 )

2024-10-18 09:11:59 +02:00

requirements-cublas12-after.txt

feat(venv): shared env (#3195 )

2024-08-07 19:45:14 +02:00

requirements-cublas12.txt

fix(dependencies): pin pytorch version (#3872 )

2024-10-18 09:11:59 +02:00

requirements-hipblas.txt

fix(dependencies): pin pytorch version (#3872 )

2024-10-18 09:11:59 +02:00

requirements-install.txt

feat: migrate python backends from conda to uv (#2215 )

2024-05-10 15:08:08 +02:00

requirements-intel.txt

fix(intel): pin torch and intel-extensions (#4435 )

2024-12-19 15:39:32 +01:00

requirements.txt

chore(deps): bump grpcio to 1.70.0 (#4682 )

2025-01-24 10:18:22 +01:00

run.sh

feat: create bash library to handle install/run/test of python backends (#2286 )

2024-05-11 18:32:46 +02:00

test.py

feat(vllm): add support for embeddings (#3440 )

2024-09-02 21:44:32 +02:00

test.sh

feat: create bash library to handle install/run/test of python backends (#2286 )

2024-05-11 18:32:46 +02:00

README.md

Creating a separate environment for the vllm project

make vllm