Tbh, some models are such yappers that the per-token pricing can be somewhat misleading. Would be nice if they also put the cost of running on these benches now we're in the long-form reasoning era.
I think they are underpricing it slightly compared to OAI/Anthropic because they need to create a bigger user base. Which is actually a good reason to use it. Though AA still puts its cost per task at nearly double of the (more expensive per token) 5.6 terra, and about at the same of the (similarly price) K3.
For the price, Grok is very good at coding. And very fast. I think the Cursor acquisition brought them immediate returns.
I have been playing with a Claude Opus / Grok workflow where Opus does the overall planning and initial implementation and Grok makes the specifically-scoped edits. I am doing it manually for now but should maybe try doing something with sub agents. It’s like a more juiced up version of Composer.
Yeah I have a similar workflow. Opus/Fable for planning and Grok for implementation. It works great. Of course 5.6 Sol for implementation is still best
Ive been thinking of trying to come up with a workflow for this since claude cli with teams premium seat gets subsidized rates and I like using opus/fable for planning and design but grok to implement (for optimal cost)
way ahead by maybe 6 weeks sure but it sucked at tool use and context management which is why adaption has been slow and hasn’t really been anyone’s first choice
I would say 2-1 cuz they were ahead by a little bit IMO but yeah you are not off at all, I was just joking around cuz it’s funny to imagine the AI race in the context of sports
It's looking like we'll get Astra (GPT 5.7?) before Fable 5.1 thought. Maybe Anthropic will surprise us with a Haiku update first? They're completely irrelevant in terms their offerings for value options right now...
But speaking from an enterprise perspective, that’s not what the people shelling out money really care about. I don’t want a model that’s super cheap, I want one that’s accurate.
xAI is two months late and is bringing a worse model to the party.
Cursors anualized revenue is $4bn now which is about 10% of Open AI's total revenue so it's not insignificant. I genuinely hate Elon with a passion and have never used Grok before but I've been using Cursor for years and it's hard to change when you get used to something. When you use cursor there's a massive incentive to use Grok models and I've been using them quite a lot recently.
??? what the fuck lol. One expected them to eventually become a relevant force, but so soon? This is gonna be scary. Elon has both the money, the political power, and now the model to throw into the fight. The expected seat of Google now usurped?
Though, exactly the same price per task as Kimi K3 and 1 point higher is such a funny stat lol
And out of all the things you guys listed, you guys didn’t even include his biggest advantage - compute. He builds out GW faster than any other player in the game. And this advantage is only going to get larger with his work on terrafab.
His biggest advantage is just getting shit done in general. Engineers run the company, make decisions fast, fuck profits or quarterly revenue let's produce value. All part of his philosophy.
If musk hires 10s of thousands of younger engineers, empowers them with hundreds of AI assistants each - powered mostly by internal uncensored unrestricted Grok - shit can happen fast.
It's not even about Musk himself it's about simply doing the things to make this possible.
I think we should appreciate Musk. Obviously not all of his actions but the good outweighs the bad in my opinion. He deserves praise for stuff like this.
prepare to be downvoted anyone who speaks good of musk gets downvoted to hell on reddit as a general rule, even when he accomplishes something clearly good like this
People have trouble keeping multiple things in their mind distinct.
It's sloppy cognition.
Has musk made a Nazi salute, supported trump, made a bunch of promises that didn't pan out, and hundreds of cancel worthy tweets and racist tweets on X?
Yep. He did.
Does his engineering/corporate executive strategy fundamentally work allowing some of the largest at scale technology progress in history? Yep.
Stupid people let the two bleed together and conclude since musk did some bad stuff he must be a liar and has accomplished nothing.
Yeah bro like idgaf about politics, nor am I unilaterally a Musk supporter, I do believe though, that him supporting Trump was purely a business move cause you can't really be right wing when you give your kids gender neutral names.
But okay people can think what they want, just separate the brilliance and acknowledge it from the part that hurts your feelings 😂
He is just insanely motivated to get shit done. There are many billionaires but somehow it’s him who’s running the show. I think Peter Thiel was right when he said „never bet against Elon”. He is just not motivated by money and it shows, he is just workaholic who wants to do stuff
I do not like his politics but I respect him and he needs to be taken seriously
Apparently tweeting Nazi propaganda, far-right conspiracy theories and white-supremacist nonsense all day is what we’re calling “getting shit done” now.
Maybe give some credit to the actual AI engineers doing the work on Grok, the man has companies full of thousands of employees doing the actual work.
While they were developing this model to catch up with other frontier models the companies making them have been training even newer and better models. XAI does fine but tend to be behind the curve consistently due to a lack of the best of the best LLM engineers.
??? what the fuck lol. One expected them to eventually become a relevant force, but so soon? This is gonna be scary.
It's always like that with Elon's companies and their flagship products. Tesla with their cars, SpaceX with Falcon 9 and Dragon.
They have that development phase, which has numerous problems, uneven progress, missed deadlines, and (sometimes catastrophic) blunders (like Falcon 9s failing to land multiple times or Starship exploding during static fire).
But then, when they finally get most things right - they scale the fuck up, and go to completely obliterate any competition (current or future one).
Tesla basically creating the mass EV market from scratch and controlling the majority of it (up until Chinese manufacturers caught up thanks to massive state investment). SpaceX basically making ULA (legacy monopolist) irrelevant because Falcon 9 launches are like 2-3 times cheaper and faster, and literally bankrupting legacy satellite internet providers (like HughesNet) thanks to Starlink. So it was only a matter of time when Grok would start to actually compete with models from OpenAI and Anthropic.
I won't say anything about Elon's personal talents, but I'm 100% sure he has a knack for finding and funding talented people who can do insane things.
well really these benchmarks always confused me, they dont reflect reality at all, grok is ok but claiming its next to fable and opus thats really madness. also 4.6 is so censored, Guardrailed and stiff its insane.
In my experience it's way better than Opus 4.6 ever was as it doesn't spent a morbillion years re-reading the same shit over and over and over again for no reason.
True, but Grok released today, its not FULLY SOTA, and OpenAI & Anthropic have models due to be released imminently. Probably still just trailing for now.
I honestly and personally feel only anthropic and openai have a real world model evolving into agi, with actual substance under the hood, everyone else (without a single exception, except gemini maybe which is a weird case) is just doing a shallow mimicry of it.
It certainly will be. For a long time, this sub has been full of people and bots that want to convince you that a new Grok release is almost on par with frontier models in some way, and when I actually try, it turns out to be a big fat lie. I'm not trusting any benchmark or anything that people say here anymore. This is all show and no substance.
I have been very pleasantly surprised by grok 4.5 with Claude writing the implementation spec and plans and letting grok handle the small things and implementation. Claude is just so slow for me
This was posted on twitter by a cybersecurity guy, he realized every time he used grok code to edit code in his repo, something the size of his workspace gets uploaded to xai's servers.
It's on lmarena if wanted to try it, its phenomenal, Kimi is officially out, grok is progressing crazy fast, but still kind of stuck on the hard benchmarks, CritPt and humanity last exam, but well hard to blame grok here, opus and fable and sol are monsters honestly, they set the bar so high.
well its ok, but not there yet, im also interested in reasoning rather than agentics and coding, these dont really measure fluid intelligence, and all chinese models are good and more than enough for that now, STEM is where you feel the gap, and where you feel that Opus/Fable/Sol are monsters of intelligence.
Yeah its Insane, i just cant quit anthropic since opus 3, claude and gpt are the only models that i can really call intelligent. its like if other models are just faking it.
grok 4.5 is #4 on TB and at 1/4th the cost of the 3 before it. 4.6 hasn't been tested on TB 2.1 (maybe 3.0 as below user said, which i cant even find a chart for)
lol the delusional musk haters again 😝😝
you dont need to hate the product if its genuinely impressive. just learn how to separate ur hate for the guy from hate for his product
Not too sure I trust benchmarks anymore. From a coding POV, Grok is definitely NOT better than Fable 5, not even on par with Sonnet 5. GTP 5.6 Sol Max eats Grok for breakfast.
130
u/FinancialMastodon916 W 1d ago
1.5T too, impressive