mirror of https://github.com/mudler/LocalAI.git synced 2025-12-31 06:29:55 -06:00

Files

Ettore Di Giacinto 2defe98df8 fix(vllm): Update flash-attn to specific wheel URL

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

2025-11-21 18:06:46 +01:00

backend.py

fix: vllm missing logprobs (#5279 )

2025-04-30 12:55:07 +00:00

install.sh

Add NVCC_THREADS and MAX_JOB environment variables

2025-11-21 16:14:13 +01:00

Makefile

feat(mlx): add mlx backend (#6049 )

2025-08-22 08:42:29 +02:00

README.md

…

requirements-after.txt

fix(python): move vllm to after deps, drop diffusers main deps

2024-08-07 23:34:37 +02:00

requirements-cpu.txt

chore(deps): bump pytorch to 2.7 in vllm (#5576 )

2025-06-04 08:56:45 +02:00

requirements-cublas11-after.txt

feat(venv): shared env (#3195 )

2024-08-07 19:45:14 +02:00

requirements-cublas11.txt

chore(deps): bump pytorch to 2.7 in vllm (#5576 )

2025-06-04 08:56:45 +02:00

requirements-cublas12-after.txt

fix(vllm): Update flash-attn to specific wheel URL

2025-11-21 18:06:46 +01:00

requirements-cublas12.txt

chore(deps): bump pytorch to 2.7 in vllm (#5576 )

2025-06-04 08:56:45 +02:00

requirements-hipblas.txt

feat: Add backend gallery (#5607 )

2025-06-15 14:56:52 +02:00

requirements-install.txt

…

requirements-intel.txt

chore(deps): bump pytorch to 2.7 in vllm (#5576 )

2025-06-04 08:56:45 +02:00

requirements.txt

chore(deps): bump grpcio from 1.75.1 to 1.76.0 in /backend/python/vllm (#6827 )

2025-10-27 21:31:47 +01:00

run.sh

feat: Add backend gallery (#5607 )

2025-06-15 14:56:52 +02:00

test.py

fix: vllm missing logprobs (#5279 )

2025-04-30 12:55:07 +00:00

test.sh

feat: Add backend gallery (#5607 )

2025-06-15 14:56:52 +02:00

README.md

Creating a separate environment for the vllm project

make vllm