mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-12-30 06:00:15 -06:00
Code Issues Packages Projects Releases Wiki Activity

chore(model gallery): add huihui-ai_huihui-gemma-3n-e4b-it-abliterated (#5833)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto
2025-07-11 11:42:01 +02:00
committed by GitHub
parent ec293b3b59
commit 99058511cc
1 changed files with 16 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

16
gallery/index.yaml
View File

@@ -2521,6 +2521,22 @@
- filename: TheDrummer_Tiger-Gemma-12B-v3-Q4_K_M.gguf
sha256: b1756e46d7fce1718cf70cb74028ada567bac388503e93fc23af0baea5b5cd9f
uri: huggingface://bartowski/TheDrummer_Tiger-Gemma-12B-v3-GGUF/TheDrummer_Tiger-Gemma-12B-v3-Q4_K_M.gguf
- !!merge <<: *gemma3
name: "huihui-ai_huihui-gemma-3n-e4b-it-abliterated"
urls:
- https://huggingface.co/huihui-ai/Huihui-gemma-3n-E4B-it-abliterated
- https://huggingface.co/bartowski/huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF
description: |
This is an uncensored version of google/gemma-3n-E4B-it created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
It was only the text part that was processed, not the image part. After abliterated, it seems like more output content has been opened from a magic box.
overrides:
parameters:
model: huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_M.gguf
files:
- filename: huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_M.gguf
sha256: bf3f41f5d90c30777054d5cc23c10a31f08a833e774a014733f918b5c73f2265
uri: huggingface://bartowski/huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-GGUF/huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_M.gguf
- &llama4
url: "github:mudler/LocalAI/gallery/llama3.1-instruct.yaml@master"
icon: https://avatars.githubusercontent.com/u/153379578