Ludovic Leroux 939411300a Bump vLLM version + more options when loading models in vLLM (#1782) ...

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

2024-03-01 22:48:53 +01:00

330 B

Executable File

Raw Blame History

View Raw