mirror of https://github.com/mudler/LocalAI.git synced 2026-04-21 17:28:57 -05:00

Files

T

Ludovic Leroux 939411300a Bump vLLM version + more options when loading models in vLLM (#1782 )

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

2024-03-01 22:48:53 +01:00

backend_pb2_grpc.py

2023-11-20 21:21:17 +01:00

backend_pb2.py

2024-03-01 22:48:53 +01:00

Makefile

2023-12-21 08:35:15 +01:00

README.md

2023-11-20 21:21:17 +01:00

run.sh

2023-12-21 08:35:15 +01:00

sentencetransformers.py

2023-11-23 15:22:37 +01:00

test_sentencetransformers.py

2023-12-11 19:26:02 +01:00

test.sh

2023-12-21 08:35:15 +01:00

Creating a separate environment for the sentencetransformers project

make sentencetransformers