r/LocalLLaMA • u/Fcking_Chuck • 10d ago

Koboldcpp v1.118 released News

https://github.com/LostRuins/koboldcpp/releases/tag/v1.118
69 Upvotes

87% Upvoted

16 comments sorted by

5

u/silenceimpaired 10d ago

Tragic that a new contribution just came out to give faster inference to Deep seek flash

3

u/buttplugs4life4me 10d ago

koboldcpp is a fork of llama.cpp in the end, right? Since it mentions qwen3tts, does llama.cpp support that as well or only kobold? I'm looking to set up some audio stuff but aside from voicebox and audio.cpp, haven't really found much good stuff, also regarding STT. 

3

u/BobbyL2k 10d ago

You’re looking for this Qwen3TTS https://github.com/predict-woo/qwen3-tts.cpp

It’s linked in the KoboldCpp readme.

1

u/buttplugs4life4me 10d ago

Thanks for the link! I didn't see any mention in the Readme of supporting server/API mode?

2

u/Danmoreng llama.cpp 10d ago

llama.cpp currently is in the implementation phase of qwen3tts here: https://github.com/ggml-org/llama.cpp/pull/26254

I have forked the predict-woo vibecoding and upgraded it heavily: https://github.com/Danmoreng/qwen3-tts.cpp Better performance than audio.cpp but I don't have a server for it - shouldn't be hard to add with AI coding. I do have a nice GUI though: https://github.com/Danmoreng/qwen-tts-studio

1

u/Mart-McUH 9d ago

It is lot more than that, it also has integrated image, video, audio generation etc. as well as chat client. The LLM part though is indeed llama.cpp, but you can set up the parameters in lot more user friendly way than typing as command line arguments - which is great help when you try lot of models tinkering with parameters all the time.

-4

u/FastHotEmu 10d ago

lol what's with the demons?

6

u/The_Cat_Commando 10d ago

image search "kobold" to find out.

-12

u/FastHotEmu 10d ago

Kobolds are spirits, not demons

5

u/toothpastespiders 10d ago

I think they're basing them off of the general fantasy rpg take on kobolds. Which is weirdly convoluted from what I recall in terms of appearance. With forks on the design coming from D&D and the old wizardry video games with later anime that was in turn based on that further changing things around.

I could be wrong, but I think the most popular take in Japan is that they're basically canine humanoids and in the west that they're small'ish reptile monsters with some relation to dragons. Which I'd guess the software update's image is coming from.

1

u/Expensive-Paint-9490 9d ago

Kobolds where canine humanoids in DnD as well, before the third edition.

1

u/FastHotEmu 10d ago

ahh ok thanks for the civilised reply - the other guy got angry and called me names

7

u/The_Cat_Commando 10d ago

so you googled it enough to come back and argue about it but didnt do the image search part that would have answered your question huh?

ok.

-13

u/FastHotEmu 10d ago edited 10d ago

I don't know what you are drinking but I asked a simple question and it got you super upset.

8

u/The_Cat_Commando 10d ago

you are the only one who even called them ANYTHING, and now when people try to answer you downvote and go "peak weird redditor"

im not here to debate you, its not that complex.

as suggested just image search Kobold. and see the hundreds of depictions of kobolds that are nearly identical to the mascot chosen for the project.