Skip to content

Commit 14c7c04

Browse files
localai-botmudler
andauthored
chore(model gallery): 🤖 add 1 new models via gallery agent (#10874)
chore(model gallery): 🤖 add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
1 parent ec933b8 commit 14c7c04

1 file changed

Lines changed: 70 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 70 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,74 @@
11
---
2+
- name: "hy3"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/AngelSlim/Hy3-GGUF
6+
description: |
7+
中文&nbsp;|&nbsp;English
8+
9+
[](#license)
10+
&nbsp;&nbsp;
11+
[](https://huggingface.co/tencent/Hy3)
12+
&nbsp;&nbsp;
13+
[](https://modelscope.cn/models/Tencent-Hunyuan/Hy3)
14+
&nbsp;&nbsp;
15+
[](https://cnb.cool/ai-models/tencent/Hy3)
16+
&nbsp;&nbsp;
17+
[](https://ai.gitcode.com/tencent_hunyuan/Hy3)
18+
19+
🖥️&nbsp;Official Website&nbsp;&nbsp;|&nbsp;&nbsp;
20+
💬&nbsp;GitHub
21+
22+
## Table of Contents
23+
24+
- Model Introduction
25+
- Stronger Agent Capabilities
26+
- More Reliable Product Experiences
27+
- Benchmark Appendix
28+
- News
29+
- Model Links
30+
- Quickstart
31+
- Deployment
32+
- vLLM
33+
- SGLang
34+
- Finetuning
35+
- RL Post-training
36+
- Quantization
37+
- License
38+
- Contact Us
39+
40+
## Model Introduction
41+
42+
**Hy3** is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Following the Hy3 Preview launch in late April, we gathered feedback from 50+ products and scaled up post-training with higher quality data. Today, we introduce Hy3, which outperforms similar-size models and rivals flagship open-source models with 2-5x parameters. It also shows significant gains in utility across various products and productivity tasks.
43+
44+
## Stronger Agent Capabilities
45+
46+
...
47+
license: "apache-2.0"
48+
tags:
49+
- llm
50+
- gguf
51+
overrides:
52+
backend: llama-cpp
53+
function:
54+
automatic_tool_parsing_fallback: true
55+
grammar:
56+
disable: true
57+
known_usecases:
58+
- chat
59+
options:
60+
- use_jinja:true
61+
- spec_type:draft-mtp
62+
- spec_n_max:6
63+
- spec_p_min:0.75
64+
parameters:
65+
model: llama-cpp/models/Hy3-Q4_K_M-mtp/Hy3-Q4_K_M-mtp.gguf
66+
template:
67+
use_tokenizer_template: true
68+
files:
69+
- filename: llama-cpp/models/Hy3-Q4_K_M-mtp/Hy3-Q4_K_M-mtp.gguf
70+
sha256: 2524ee6cf689731ec924f0edabed0f57b634488fafe855c6bb3c2c2f86c08ae5
71+
uri: https://huggingface.co/AngelSlim/Hy3-GGUF/resolve/main/Hy3-Q4_K_M-mtp.gguf
272
- &bonsai-8b
373
name: "bonsai-8b-1bit"
474
url: "github:mudler/LocalAI/gallery/qwen3.yaml@master"

0 commit comments

Comments
 (0)