mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-02-11 20:49:15 -06:00
Code Issues Packages Projects Releases Wiki Activity

feat: bundle python inside backends (#6123)

Browse Source 
* feat(backends): bundle python

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* test ci

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* vllm on self-hosted

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add clang

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Try to fix it for Mac

* Relocate links only when is portable

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make sure to call macosPortableEnv

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Use self-hosted for vllm

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* CI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto
2025-08-23 22:36:39 +02:00
committed by GitHub
parent 259383cf5e
commit 1ba66d00f5
5 changed files with 286 additions and 95 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
scripts/build/python-darwin.sh
View File

@@ -2,6 +2,7 @@
set -ex
export PORTABLE_PYTHON=true
IMAGE_NAME="${IMAGE_NAME:-localai/llama-cpp-darwin}"
mkdir -p backend-images
make -C backend/python/${BACKEND}