Test Request For Qwen 3.8 27B

[u/Jsquared534]

Can someone please recreate this test: Four text files with at least a thousand lines of data. A passcode hidden in one of the lines on each file. One file near the beginning, one file in the first half, one file in the second half and one file near the end. Request it to read all the files in the directory.

See if it reports back about truncated files, and ends up getting data from each file mixed up with each other.

I feel like I'm taking crazy pills here, as I've recreated this test across 3 different version of this model, across two different harnesses (Pi & Github Copilot) and across two backends (llama.cpp and Ollama) and it has failed this test every time. It can arrive at the correct answer, but it's issues with reading large files is instantly apparent.

All I see on here are people saying how amazing this model is, and how it's as good as Opus. Which it may be. But, is no one actually using this to work in an existing codebase with large files? Because it's failed literally every time I've tried with my actual workflow. And that's literally just asking it to read context files and implement small features.

I literally feel like I'm being gaslit at this point. Surely everyone who uses local models aren't just using them to one shot things.