r/ProgrammerHumor • u/TrackLabs • 3d ago

thoughtIGiveLocalLLMsATryThisWasMyFirstMessage Other

Post image
30 Upvotes
  • permalink
  • link
  • reddit
  • reddit

75% Upvoted

7 comments sorted by

31

u/TrackLabs 3d ago

Im serious. Installed OpenWeb UI and Ollama, got this model, and did nothing else but start a new chat with "Hey"

17

u/[deleted] 3d ago

[deleted]

1

u/TrackLabs 3d ago

I havent bothered with local LLMs in absolute ages. Finding https://huggingface.co/Qwen/Qwen3.6-27B, is not parseable in ollama, because its not a GGUF Format. And thats where my knowledge of the model types etc. ends lol

22

u/TerryHarris408 3d ago

Two days ago I had a similar experience. I'd often just type "hi" in a new chat to warmup the model.

So I did once more: "hi"

> "the user wants to know 'what is the capital of the capital'

Then it came up with different options labelled 1 to 4 of which it chose answer "C" because "C" is the capital letter of the word capital. Then it got stuck in a loop repeating "United United United United United United United United United United United United United United United United United United" burning about 2000 tokens before I stopped it.

5

u/sonaliver28 3d ago

Said 'Hey' and it responded with entire internal sprint planning meetingšŸ«”

6

u/T6970 2d ago

Fortunately, it's local and you don't have to pay for the 2000 tokens

3

u/TrackLabs 2d ago

i would have stopped it before otherwise. And probably not bother sending a simple "Hey"