kiuckhuang/whisper-large-v3-cantonese-ggml
Automatic Speech Recognition โข Updated
Kiu Huang
kiuckhuang
AI & ML interests
Fun
Recent Activity
updated a model 24 days ago
kiuckhuang/whisper-large-v3-cantonese-ggml new activity about 1 month ago
spiritbuun/Qwen3.6-27B-DFlash-GGUF:it works on new upstream weight liked a model 6 months ago
zai-org/GLM-ASR-Nano-2512Organizations
None yet
updated a
model 24 days ago
it works on new upstream weight
3
#1 opened about 1 month ago
by kiuckhuang
liked a
model 6 months ago
liked a
model 9 months ago
Chat template tool calling issue
3
#1 opened 10 months ago
by kiuckhuang
Tool calling error
70
#1 opened 10 months ago
by 
austinsr
liked a
model 11 months ago
reacted to bartowski's post with ๐ 11 months ago
Post
135314
Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :')
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinjaand it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
liked a
model 12 months ago
liked a
dataset about 1 year ago
upvoted an article about 1 year ago
Article
Tiny Agents in Python: a MCP-powered agent in ~70 lines of code
- +2
celinah, julien-c, Wauplin, evalstate
โข โข 172 reacted to Jofthomas's post with ๐ about 1 year ago
Post
4748
Meet our new agentic model : ๐๐ฒ๐๐๐๐ฟ๐ฎ๐น
Devstral is an open-source LLM built software engineering tasks built under a collaboration between Mistral AI and All Hands AI ๐.
๐๐ฒ๐ ๐ณ๐ฒ๐ฎ๐๐๐ฟ๐ฒ๐ :
โข ๐ค ๐๐ด๐ฒ๐ป๐๐ : perfect for Agentic coding
โข ๐ ๐น๐ถ๐ด๐ต๐๐๐ฒ๐ถ๐ด๐ต๐: Devstral is a ๐ฎ๐ฐ๐ parameter based on Mistral small.
โข ยฉ๏ธ ๐๐ฝ๐ฎ๐ฐ๐ต๐ฒ ๐ฎ.๐ฌ, meaning fully open-source !
โข ๐ A ๐ญ๐ฎ๐ด๐ธ context window.
๐Blog : https://mistral.ai/news/devstral
โกAPI : The model is also available on our API under the name ๐ฑ๐ฒ๐๐๐๐ฟ๐ฎ๐น-๐๐บ๐ฎ๐น๐น-๐ฎ๐ฑ๐ฌ๐ฑ
๐ค repo : mistralai/Devstral-Small-2505
Can't wait to see what you will build with it !
Devstral is an open-source LLM built software engineering tasks built under a collaboration between Mistral AI and All Hands AI ๐.
๐๐ฒ๐ ๐ณ๐ฒ๐ฎ๐๐๐ฟ๐ฒ๐ :
โข ๐ค ๐๐ด๐ฒ๐ป๐๐ : perfect for Agentic coding
โข ๐ ๐น๐ถ๐ด๐ต๐๐๐ฒ๐ถ๐ด๐ต๐: Devstral is a ๐ฎ๐ฐ๐ parameter based on Mistral small.
โข ยฉ๏ธ ๐๐ฝ๐ฎ๐ฐ๐ต๐ฒ ๐ฎ.๐ฌ, meaning fully open-source !
โข ๐ A ๐ญ๐ฎ๐ด๐ธ context window.
๐Blog : https://mistral.ai/news/devstral
โกAPI : The model is also available on our API under the name ๐ฑ๐ฒ๐๐๐๐ฟ๐ฎ๐น-๐๐บ๐ฎ๐น๐น-๐ฎ๐ฑ๐ฌ๐ฑ
๐ค repo : mistralai/Devstral-Small-2505
Can't wait to see what you will build with it !
- 1 reply
liked a
model about 1 year ago
upvoted an article about 1 year ago
Article
Vision Language Models (Better, faster, stronger)
- +3
merve, sergiopaniego, ariG23498, pcuenq, andito
โข โข 613 published a
model about 1 year ago
liked 2
models about 1 year ago
upvoted a collection about 1 year ago
liked a
model almost 2 years ago
liked a
model over 2 years ago
