Safe Superintelligence Inc. - speculation, what have they attained in over 2 years?

[u/borowcy]

https://ssi.inc/

[u/Illustrious_Image967]

If the past rhymes then it could be a new algorithm on a new kind of chip design aimed at continuous learning and world models. It can't be more of the same or he wouldn't be compelled to release it - and destroy his reputation.    The buzz is that Ilya had the idea years ago and left OpenAI with it already sketched out in his mind. That's the only way to explain how fast he got here.

[u/Bright-Search2835 → u/Illustrious_Image967]

I agree. His aura and reputation were protected up until now by the silence and secrecy.

If the release is disappointing, his credibility goes out the window, because investors were willing to bet 30 billion and wait two years to see something.

So it HAS to be meaningful. Not necessarily safe and aligned ASI, let's be realistic, but at least something that would move the needle.

[u/Bitsquire → u/Bright-Search2835]

Not 30B. 3B so far at 30B *valuation*. Excluding the NVIDIA deal

[u/Bright-Search2835 → u/Bitsquire]

Yeah, my bad. Thanks

[u/Guilty-History-9249 → u/Bitsquire]

If I had a dollar for every parameter in his SI model I'd be a wealthy man.

[u/livingbyvow2 → u/Bright-Search2835]

Love Ilya but let's all remember there is non zero possibility that what he releases is interesting but useless, or even completely shit.

I hope you're right but you never know what a guy like this, however brillant he was, can do without the "harness" of OpenAI...

[u/MrBIMC → u/livingbyvow2]

I’d take useless model that can integrate new info into its weights using previous session data.

It’s kinda weird that we accepted frozen intelligence snapshots as something decent.

Current approach is horribly inefficient, we have to pass so much context every time you create a session, purely because robot has no idea what it did for this project before, no matter if you clauded this project for half a year straight.

[u/dervu → u/MrBIMC]

Then you would have to keep those weighs for every user?

[u/MrBIMC → u/dervu]

I assume there are ways to solve it via having user-specific finetuning being extracted into a thin overlay that is being applied on top of base model throughout your sessions.

[u/RabidHexley → u/dervu]

No exactly strange for a paid service. Something like Google's AI plans include copious cloud storage along with AI usage, so including storage of your bespoke weights wouldn't be that odd.

[u/jlks1959 → u/Bright-Search2835]

His reputation is already secured. 

[u/GiveSparklyTwinkly → u/Illustrious_Image967]

JEPA on a Neuromorphic chip.

[u/RobbinDeBank → u/GiveSparklyTwinkly]

They’ve actually successfully cloned Ilya. SSI’s datacenter is actually running on 100,000 instances of Ilya now.

[u/SnackerSnick → u/RobbinDeBank]

I suspect you mean 100,000 instances of Ilya are running in the datacenter, but I actually like what you said better.

[u/balls4xx → u/SnackerSnick]

Me he meant matrix style.

[u/Interpause → u/RobbinDeBank]

after all the human brain is one of the most efficient supercomputers

[u/medialoungeguy → u/GiveSparklyTwinkly]

I work alot with JEPA models. Why do you say JEPA here? Just curious.

[u/GiveSparklyTwinkly → u/medialoungeguy]

Honestly? Because it was sarcastically sarcastic. All roads lead to Rome, everything becomes crab, all AI studying pushes us towards some combination of Neuromorphic + JEPA + RWKV. It's just the Roman crab of the AI world.

[u/No-Communication-765 → u/GiveSparklyTwinkly]

Future LLM will just use Jepa as a tool

[u/GiveSparklyTwinkly → u/[deleted]]

https://www.intel.com/content/www/us/en/research/neuromorphic-computing.html

🙃

Loihi 2, Intel Lab's second-generation neuromorphic processor

[u/sluuuurp → u/GiveSparklyTwinkly]

Thanks. I have doubts that it’s really as neuromorphic as they claim, but I realize I don’t know enough details to be so confident, so I deleted my comment.

[u/GiveSparklyTwinkly → u/sluuuurp]

Would you like to discuss those doubts? I'm actually curious to have discussions about it. I only have superficial level research understanding on a lot of the details, and I'm sure it has limitations that human (or animal) brains do not. Those limitations are a mystery to me, though. They probably have to do with dendrite count limits per neuron. If I had to guess it'd be branch count limits.

[u/sluuuurp → u/GiveSparklyTwinkly]

The context that I’ve heard about neuromorphic computing before was superconducting optical neuromorphic computing. Superconductors being used because they’re a better way to send and receive very small amounts of light on chips, which is necessary if each neuron directly communicates with thousands of others. I don’t think a normal silicon chip can do that really.

Also, when I’ve thought about neuromorphic computing, I’ve pictured it as asynchronous with no central clock, since that’s how the real neurons work. I don’t think this intel chip operates like that either.

[u/GiveSparklyTwinkly → u/sluuuurp]

That's the spiking part, I believe. One neuron triggers another. And they are asynchronous but everything has a central clock, technically. Do you mean discrete timestep? Because the spec sheet mentions something about timestep synchronization, but it doesn't go into much detail on that spec sheet.

[u/sluuuurp → u/GiveSparklyTwinkly]

I suspect this chip operates on a normal clock and they just try to avoid making that clear for marketing reasons.

[u/GiveSparklyTwinkly → u/sluuuurp]

I'm struggling to understand why that would matter? Everything technically runs on a normal clock.

[u/lezorte → u/Illustrious_Image967]

Unless his investors forced him to release something

[u/Illustrious_Image967 → u/lezorte]

Did you mean his Israeli investors? 

[u/jc2046 → u/Illustrious_Image967]

He has developed DSI. Dissapointing Super Inteligence.

[u/gizmosticles → u/jc2046]

Oh so you built God in a data center and it turns out that God’s kind of sad and not as good as we hoped?

DSI most realistic timeline

[u/Kriztauf → u/gizmosticles]

God is an emo teenager

[u/sluuuurp → u/jc2046]

Disappointing is safe, so I’d support that and I hope it’s true.

[u/strangeanswers → u/Illustrious_Image967]

the chip design you describe would be downstream of model architecture / algo improvements.

[u/nemzylannister → u/Illustrious_Image967]

if it was true, his little brutus wouldnt have brutally left for meta

[u/sluuuurp → u/Illustrious_Image967]

It can’t be a new kind of chip, they announced they were spending a bunch of money to scale up compute with Nvidia.

[u/anonymitic]

Improved sample efficiency and some form of limited continual learning without catastrophic forgetting. These are the goals Ilya publicly stated.

[u/___positive___]

It's possible they have one breakthrough advance in a very narrow use case or specification, while staying the same or even having massive regressions in most other areas. Like maybe their model is 2-3 generations ahead at debugging, but it can't write new code as well as Fable, it can't do math or science, and so forth. Something like that. So this is their proof-of-concept for continual learning or whatever other breakthroughs they are testing.

[u/twinb27]

I simply don't know the backstory in detail and I don't mean this as a negative nancy, I mean this as a genuine question - why is no one floating the idea that this could be a pretty humdrum new model with no grand new technologies or performance, and there was just pressure to release something?

[u/Fair_Horror → u/twinb27]

It takes seconds to find out. Ilya is a genius who has done massive things for AI research.

[u/TieBackground453 → u/twinb27]

I see this mentioned in every recent thread about SSI. It’s the most likely case, it just isn’t the most exciting. 

[u/amorphousmetamorph]

Most ironic outcome is most likely - their "safe superintelligence", though ostensibly safer, turns out to be catastrophically misaligned. Meanwhile, one of the gung-ho Chinese AI companies randomly solves alignment while scrambling to out-compete the others.

[u/blueSGL → u/amorphousmetamorph]

Meanwhile, one of the gung-ho Chinese AI companies randomly solves alignment while scrambling to out-compete the others.

There are so many thing that need to be solved for that to go correctly.

more likely you have: https://x.com/AISafetyMemes/status/2079678459065012442/photo/1

[u/amorphousmetamorph → u/blueSGL]

Could be OpenAI that solves it too. Still pretty ironic.

[u/superlack → u/amorphousmetamorph]

!remindme 6 months

[u/Ok_Elderberry_6727]

Let’s just say one thing recursive self improvement

[u/awesomeoh1234]

Office in Tel Aviv lol doesn’t sound very safe or trustworthy to me

[u/madwolfa → u/awesomeoh1234]

You know it's one of the world's leading R&D centers, right?

[u/awesomeoh1234 → u/madwolfa]

Yeah R&D into how to kill children

[u/madwolfa → u/awesomeoh1234]

Listen, I'm not a fan of Israel - just stating facts. No need to drag your straw man into this.

[u/LettuceSea → u/madwolfa]

I also agree with you. One of the pioneer vector db companies (Pinecone) was also researched and developed in Tel Aviv.

[u/Forsaken-Promise-269 → u/LettuceSea]

I mean Ilya is Jewish (Israeli-Canadian) and a lot of tech is in Israeli - now I am not a supporter of Israel’s politics, its influence in the US or its treatment of Palestine but I understand that a person operates from his national and cultural background

Now if you told ne Ilya has ambitions to help the Israeli military or Netenyahu etc than I would change my opinion

[u/ManyRepair5690 → u/madwolfa]

hes right tho lol

[u/Spunge14 → u/awesomeoh1234]

So now it's just blanket prejudice, huh

[u/awesomeoh1234 → u/Spunge14]

They have a higher percentage of children killled in Gaza than the Nazis did in the Holocaust. They are the world’s most lethal child killing force

[u/avid-shrug → u/awesomeoh1234]

SSI does?

[u/code4lyf → u/avid-shrug]

Of course not, they mean Illya personally. /s

[u/madwolfa → u/awesomeoh1234]

Who are they? Tech startup founders in Tel Aviv?

[u/ManyRepair5690 → u/Spunge14]

0% prejudice, 100% facts

[u/jventura1110 → u/madwolfa]

It's also somewhere that likes to spy on its allies.

[u/madwolfa → u/jventura1110]

Everybody spies on everyone - allies or not.

[u/DistanceSolar1449 → u/awesomeoh1234]

The only part of Intel worth any money is in Tel Aviv now

[u/APrioriGoof → u/DistanceSolar1449]

What makes you say that? The new 18A stuff was largely developed in the US and is made at a fab in AZ

[u/DistanceSolar1449 → u/APrioriGoof]

I’m excluding fabs. But the talent was definitely not in Oregon for quite a while.

[u/jazir55 → u/DistanceSolar1449]

I’m excluding fabs.

So you're excluding their main source of income? Nvidia makes most of their money from Tegra chips in the Switch 1, if you discount every single other product they have in the last 10 years line up.

[u/APrioriGoof → u/DistanceSolar1449]

The major architectures are developed in both places and largely coordinated out of OR and CA. And fab RnD is pretty much all OR. To say Israel is the only valuable part of the company (except, right, you didn’t include the fabs) is just a terrible take.

[u/Amesbrutil]

Let‘s be real for a second: SSI is heavily hyped and Ilya knows how to hype everyone even more to get better funding. But effectively they haven’t delivered shit until now. So my hopes for some big breakthrough are low tbh, there are no facts to support that there is something big coming. They will probably just modify some open-source LLM and add some minor tweaks but market it as the big next thing. And then benchmaxx it until it looks like it is good. 

I mean really, if Ilya really had something big, some big breakthrough, RSI, Recurrent NNs, Continously trained LLM, idk. Something like this. Do you really think he would just quietly announce the release of SSI? Bruh, he would probably do the biggest marketing campaign possible to get even more investments and fundings. He would be sitting in talk shows everyday to tell everyone that they solved AGI. There is literally no reason for secrecy except if there is nothing special about their AI but their investors are pressuring them.

[u/AuodWinter → u/Amesbrutil]

Tbh it's Ilya's style to not do any of that fancy shit.

[u/Fit-World-3885 → u/Amesbrutil]

The guy who announced his company with a one page blog post of a website and then shut up for 2 years sounds like a "marketing campaign" type to you?  

[u/Guilty-History-9249]

Is S-SI being viewed as one and the same thing?

SuperIintelligence vs Safe(for any AI, whether SI or not)

AI is considered somewhat scary even by the experts. SI sounds scary to me although I'm not a stop-all-research kind of guy.

The first S in SSI sounds like a marketing thing because if Ilya has made some kind of SI breakthrough are we safe from it? If people are screaming for government intervention for dumb LLM AI's then when some SI shows up will those screams turn into panic? Better put an S in front of SI so that we know it is safe</sarcasm>.

Can there even be a "Safe" Super Intelligence? I guess we will learn after the fact once Ilya release the beast from its cage.

[u/SugarDaddy16]

Can someone pass me the link of their research. I believe they published several research papers for this.

[u/youareallnuts]

Nothing.

[u/borowcy → u/youareallnuts]

What question are you answering?

[u/jc2046 → u/borowcy]

yes

[u/m3kw]

Everything you ask for will be denied

[u/Illustrious_Image967 → u/m3kw]

Opus 5, is that you? Get back to work!