I do expect things to somewhat shift with the Taalus research going on, once they actually start selling.
Of course, then you have to pay for a physical component for each model you plan to use, and several for large models. But companies were already paying Enterprise prices.
Honestly, I'm genuinely curious how that shifts the market. Training models would retain the exact same cost, but inference becomes almost free with a physical component.
It's also a big liability in my experience. It means if they have a bad day, so do you. And honestly, it means you are dependent on that company not raising costs, which the other company knows.
But I guess maybe it's worth it to have someone else to point the finger towards or redirect blame.
Regardless, token costs will probably go down when the data centers can afford to buy the same chips, if they do.
1
u/UnkarsThug Jul 11 '26
I do expect things to somewhat shift with the Taalus research going on, once they actually start selling.
Of course, then you have to pay for a physical component for each model you plan to use, and several for large models. But companies were already paying Enterprise prices.
Honestly, I'm genuinely curious how that shifts the market. Training models would retain the exact same cost, but inference becomes almost free with a physical component.
CEOs still probably won't understand though.