mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-01-04 09:40:32 -06:00
Code Issues Packages Projects Releases Wiki Activity
2,154 Commits 67 Branches 133 Tags
82d5123c1ea26bfe74cd313a57600905e459dbe4
Commit Graph

227 Commits

Author SHA1 Message Date
Ettore Di Giacinto
82d5123c1e Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 23:20:37 +02:00
Ettore Di Giacinto
031627584b ci: try to fix commit-pr workflow 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 19:44:18 +02:00
Ettore Di Giacinto
27e16a00fa ci: correctly use the pinned nvidia version 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 14:36:26 +02:00
Ettore Di Giacinto
96f67efe32 ci(swagger): run protogen-go before 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 11:28:44 +02:00
Ettore Di Giacinto
4a22e54cda Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 19:29:27 +02:00
Ettore Di Giacinto
b5661d6302 Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 18:19:41 +02:00
Ettore Di Giacinto
d384627fa9 ci: evaluate diff from base branch 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 08:45:11 +02:00
Ettore Di Giacinto
1ed6b96dd7 ci: use github action (#2899) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-16 23:57:01 -04:00
Dave
1f7cedf5ee build: fix go.mod - don't import ourself (#2896) 
* minor cleanup to go.mod - importing ourself?

Signed-off-by: Dave Lee <dave@gray101.com>

* figured out why we were importing ourself and fixed it

Signed-off-by: Dave Lee <dave@gray101.com>

* set pull_request_target

Signed-off-by: Dave Lee <dave@gray101.com>

---------

Signed-off-by: Dave Lee <dave@gray101.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-16 22:49:43 +02:00
Ettore Di Giacinto
50cdfe0090 ci: change action for commenting PRs 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-16 22:40:09 +02:00
Ettore Di Giacinto
c6838d4301 ci: comment PRs as LocalAI bot 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-16 20:05:29 +02:00
Ettore Di Giacinto
f521e50fa8 ci: add workflow to comment new Opened PRs (#2892) 
* ci: add workflow to comment new Opened PRs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update comment-pr.yaml

eliminate a stray ' character that was terminating the shell script by slightly rewriting the prompt

Signed-off-by: Dave <dave@gray101.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Dave <dave@gray101.com>
Co-authored-by: Dave <dave@gray101.com>
 2024-07-16 16:49:23 +00:00
Ettore Di Giacinto
6585ba2a9c ci: stop PRs for gpt4all.cpp 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-14 09:16:13 +02:00
dependabot[bot]
ce035416aa build(deps): bump docker/build-push-action from 5 to 6 (#2592) 
Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 5 to 6.
- [Release notes](https://github.com/docker/build-push-action/releases)
- [Commits](https://github.com/docker/build-push-action/compare/v5...v6)

---
updated-dependencies:
- dependency-name: docker/build-push-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-07-13 21:08:59 +00:00
Ettore Di Giacinto
4bc92d448c ci: let the docs autobumper follow convcommits 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-13 22:53:56 +02:00
Ettore Di Giacinto
9c0df648a6 ci: let the bot follow up convcommits style 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-13 22:53:29 +02:00
dependabot[bot]
1ad84ec396 chore(deps): Bump dependabot/fetch-metadata from 2.1.0 to 2.2.0 (#2791) 
Bumps [dependabot/fetch-metadata](https://github.com/dependabot/fetch-metadata) from 2.1.0 to 2.2.0.
- [Release notes](https://github.com/dependabot/fetch-metadata/releases)
- [Commits](https://github.com/dependabot/fetch-metadata/compare/v2.1.0...v2.2.0)

---
updated-dependencies:
- dependency-name: dependabot/fetch-metadata
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-07-12 22:50:59 +00:00
Rene Leonhardt
fc87507012 chore(deps): Update Dependencies (#2538) 
* chore(deps): Update dependencies

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>

* chore(deps): Upgrade github.com/imdario/mergo to dario.cat/mergo

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>

* remove version identifiers for MeloTTS

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>

---------

Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>
Signed-off-by: Dave <dave@gray101.com>
Co-authored-by: Dave <dave@gray101.com>
 2024-07-12 19:54:08 +00:00
Ettore Di Giacinto
68e15e71be ci: drop description linting 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-12 18:23:13 +02:00
Ettore Di Giacinto
41bce28d5f ci: add workflow to check PR style 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-12 10:01:27 +02:00
Ettore Di Giacinto
dcbdc12cc9 Update bump_deps.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-11 22:59:02 +02:00
Ettore Di Giacinto
03efa26ff5 ci: Do not test the full matrix on PRs (#2771) 
* ci: Do not test the full matrix on PR

Hipblas and sycl take long time to build from scratch as for now. Until
we find a way to speedup image building we are going to test these only
on master, and not for every open PR.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ci: do not run release workflow twice

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-11 19:08:39 +02:00
Dave
fd0bc21c3e fix abseil test issue [attempt 3] (#2769) 
* use a sed hack to jam a missing line in place for grpc's abseil version.

Signed-off-by: Dave Lee <dave@gray101.com>

---------

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-07-11 01:40:54 +00:00
Ettore Di Giacinto
28c6daf916 ci(deps): add libgmock-dev (#2761) 
* Revert "ci(grpc): disable ABSEIL tests (#2759)"

This reverts commit cbb93bd8ec.

* Revert "fix: arm builds via disabling abseil tests (#2758)"

This reverts commit 8d046de287.

* Revert "ci(arm64): fix gRPC build by adding googletest to CMakefile (#2754)"

This reverts commit 401ee553f4.

* ci(gmock): install libgmock-dev

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-10 15:23:23 +02:00
Ettore Di Giacinto
cbb93bd8ec ci(grpc): disable ABSEIL tests (#2759) 
* ci(grpc): disable ABSEIL tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-10 13:15:33 +02:00
Dave
8d046de287 fix: arm builds via disabling abseil tests (#2758) 
fix: disable abseil tests

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-07-10 08:43:27 +02:00
Ettore Di Giacinto
2845baecd5 fix(cuda): downgrade default version from 12.5 to 12.4 (#2707) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-09 23:13:29 +02:00
Ettore Di Giacinto
401ee553f4 ci(arm64): fix gRPC build by adding googletest to CMakefile (#2754) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-09 19:47:14 +02:00
Ettore Di Giacinto
c184f23621 models(gallery): add llama-3_8b_unaligned_alpha_rp_soup-i1 (#2734) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-06 15:31:00 +02:00
Ettore Di Giacinto
683c306f90 ci(Makefile): adds tts in binary releases (#2695) 
* ci(Makefile): run tts and stablediffusion in dist

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* re-add macos-13

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* rely on detection

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* move logic to a script

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* missing some libs still

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-05 23:19:24 +02:00
Ettore Di Giacinto
5c135d0dec ci: change action to send twitter notification 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 18:50:51 +02:00
Ettore Di Giacinto
ff19b22d72 ci: change action to send twitter notification 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 18:28:46 +02:00
Ettore Di Giacinto
83576d7f57 ci: change action to send twitter notification 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 18:04:56 +02:00
Ettore Di Giacinto
9aec1b3a61 ci: try to add twitter notifications for new models 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 17:51:00 +02:00
Ettore Di Giacinto
6f5b6711ea ci(notify-models): Specify the bot identity 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-04 12:02:04 +02:00
Ettore Di Giacinto
a637ee2278 ci: use different channel for release notifications, enhance prompt 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 09:22:31 +02:00
Ettore Di Giacinto
b10441a41c ci: add pipelines for discord notifications (#2703) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-04 09:15:29 +02:00
Ettore Di Giacinto
466eb82845 ci: add latest tag for vulkan images 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-28 09:04:33 +02:00
Ettore Di Giacinto
7b1e792732 deps(llama.cpp): bump to latest, update build variables (#2669) 
* arrow_up: Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* deps(llama.cpp): update build variables to follow upstream

Update build recipes with https://github.com/ggerganov/llama.cpp/pull/8006

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable shared libs by default in llama.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable shared libs in llama.cpp Makefile

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Disable metal embedding for now, until it is tested

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix(mac): explicitly enable metal

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix typo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-06-27 23:10:04 +02:00
Ettore Di Giacinto
f93fe30350 ci: vulkan not ready for arm64 yet 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 18:11:57 +02:00
Ettore Di Giacinto
784ccf97ba ci: adjust max-parallel 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-25 15:14:43 +02:00
Ettore Di Giacinto
e84b31935c feat(vulkan): add vulkan support to the llama.cpp backend (#2648) 
feat(vulkan): add vulkan support to llama.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 20:04:58 +02:00
Ettore Di Giacinto
04b01cd62c ci: put a cap on parallel runs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-24 18:08:09 +02:00
Ettore Di Giacinto
eb4cd78ca6 ci: run master jobs on self-hosted 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-23 10:15:53 +02:00
Ettore Di Giacinto
40ce71855a ci: disable max-parallelism on master 2024-06-22 23:28:09 +02:00
Ettore Di Giacinto
9c0d0afd09 ci: bump parallel jobs (#2633) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 23:24:46 +02:00
Rene Leonhardt
43f0688a95 feat: Upgrade to CUDA 12.5 (#2601) 
Signed-off-by: Rene Leonhardt <65483435+reneleonhardt@users.noreply.github.com>
 2024-06-19 17:50:49 +02:00
Ettore Di Giacinto
89a11e15e7 fix(single-binary): bundle ld.so (#2602) 
* debug

* fix copy command/silly muscle memory

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* remove tmate

* Debugging

* Start binary with ld.so if present in libdir

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* small refactor

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-18 22:43:43 +02:00
Ettore Di Giacinto
4897eb0ba2 ci: pack less libs inside the binary (#2579) 
The binary grew up to 1.8GB quickly - rocm at least raises +800MB by
itself - so we might just want to manage the GPU libs separately.

Adds a comment to list all the libraries found so far that we are
depending on, but will likely follow up in a way to bundle these
separately.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-16 22:10:28 +02:00
Ettore Di Giacinto
ac4a94dd44 feat(build): bundle libs for arm64 and x86 linux binaries (#2572) 
This PR bundles further libs into the arm64 and x86_64 binaries

This can be improved by a lot - it's far from perfect, however in this PR I wanted to collect the required libs, and give a simple baseline to improve later upon. It is quite challenging to do this exercise with CI only - but it's the fastest way I see now. 

I hope that after the list is initially built we can further improve this down the line and remove some of the technical debt left here to speedup things and do not get stuck in the middle of CI cycles.

In this PR:

- The x86_64 binary now bundles hipblas, nvidia and intel libraries too to avoid any dependency to be installed in the host
- Similarly, for the arm64 we now bundle all the required assets

## What's left

We should be also able to cross-compile Nvidia for arm64 - however I didn't succeed so far so I've left that open. Similarly I might have missed some libraries, but we will see with bug reports and testing around with the new binaries. I've tested on my arm64 board and I could finally start things up.

An open point still is shipping libraries for e.g. tts and stablediffusion. this is not done yet, however with the same methodology we should be able to extend support also for these two backends in the binary.
 2024-06-16 09:10:44 +02:00