It uses dangerously too few tokens to provide the same level of response as the previous version.
spiderice 3 hours ago [-]
You mean what they said about GPT-2?
welcome_dragon 2 hours ago [-]
Or 3 or 4 lol
irregularbowels 2 hours ago [-]
[dead]
1-6 2 hours ago [-]
In other words: "We're compute constrained and we've already reached an asymptote."
prettyblocks 3 hours ago [-]
I remember when they promised to slow down and released a new model less than a week later.
idbnstra 2 hours ago [-]
Or when they didn’t release thinking models until deepseek was first released
batperson 60 minutes ago [-]
Why do I keep seeing this nonsense posted around? gpt-o1 was released sept 2024 and deepseek r1 was jan 2025
tancky 2 hours ago [-]
"Too dangerous to release" until an open-weight model replicates it two weeks later.
beej71 2 hours ago [-]
Prompt: "Based on similar announcements delaying the release of frontier models as 'too dangerous', when can we expect OpenAI to release the model they announced was too dangerous today?"
augment_me 2 hours ago [-]
We got Mythos 1 week after the "too dangerous" announcement at the firm I was at during that time(larger bank).
So the danger level is proportionate to how little money you have
4b11b4 3 hours ago [-]
Haven't even tried Astra, nor GPT 6.. I don't even have fomo anymore
5.6 Sol still cranking along
shepherdjerred 22 minutes ago [-]
It's worth looking into for the decreased cost if nothing else
devin-2030 3 hours ago [-]
You’re not missing out. Astra was good for a couple of days and is now so quantized it’s often worse than 5.6. And 6 sol is a nothing burger to keep a wedge in the media when Opus 5.5 came out.
xtracto 2 hours ago [-]
This. We use both opus 5.5 and 6 Sol in a way that allows us to compare their performance. Opus is considerably better.
riknos314 2 hours ago [-]
> that allows us to compare their performance. Opus is considerably better.
In coding? Software architecture? Math? General knowledge?
The diversity of model use-cases is so broad that comments about "model x is better" without any context are largely useless
senectus1 2 hours ago [-]
OPENAI / JOBS
Killswitch Engineer
San Francisco, California, United States
300,000-500,000 per year
About the Role
Listen, we just need someone to stand by the servers all day
and unplug them if this thing turns on us. You'll receive
extensive training on "the code word" which we will shout if
GPT goes off the deep end and starts overthrowing countries.
We expect you to:
• Be patient.
• Know how to unplug things. Bonus points if you can
throw a bucket of water on the servers, too. Just in case.
• Be excited about OpenAI's approach to research
reilly3000 1 hours ago [-]
What are we going to do when the servers are in space? Presumably, that would involve shooting down a bunch of satellites and sending us into Kessler Syndrome in the process.
MiroslavPokorny 59 minutes ago [-]
The hype is over or has reached some peak, and they want to cash out.
jswelker 2 hours ago [-]
Unrealistically low TC, instant immersion killer.
protocolture 1 hours ago [-]
They would never upset their AI eschaton by switching it off. If anything they need more ceremonial cult leaders.
kelseyfrog 3 hours ago [-]
I have a project that requires a model with at least a 20% chance of existential threat. Please release this Sama.
OutOfHere 2 hours ago [-]
OpenAI will have to keep releasing unless it wants to bleed customers. If Anthropic leaps ahead by a couple of more models, even more OpenAI users will then switch over their $100+ subscription from OpenAI to Anthropic. As an example, see what happened to Google.
The safety concerns exist only because the underlying third-party servers are grossly insecure to begin with.
A.k.a.: Too expensive for inference at fp16 and too dumb after quantisation, so it wouldn’t look good to release a step backwards.
GPT 4.5 was scrapped for similar reasons.
hosel 2 hours ago [-]
I can’t believe how cynical everyone on HN is about this. Sure Sama is a chronic liar, and maybe this is a farce; but a lot of very intelligent people are afraid of the danger we are bringing about by racing to superintelligence.
All I really would like is for some of you to CONSIDER THAT YOURE INCORRECT. Just imagine that people ringing the fire alarms are being sincere. Please entertain the position with an open mind.
kadoban 2 hours ago [-]
Did they fix it by not releasing a point release of an already existing model? No?
Did they just get a bunch of credulous "news" coverage out of it? Yes?
Will they just release this within the next weeks, at best? Yes?
Huh, funny that.
wbxp99 1 hours ago [-]
I’m tired of the doom trolling. Boy who cried wolf. We can’t stop them anyway so no point in letting them stress me any further
antonvs 38 minutes ago [-]
So we should believe the boy who cried wolf, this time?
If all these claims were being made about some tech further along than LLMs currently are, they might be plausible. But LLMs on their own are not going to be “superintelligence” of the kind Altman is currently cynically spreading fear about. We know their limitations, and those limitations can’t simply be eliminated with more training or better harnesses.
> Just imagine that people ringing the fire alarms are being sincere.
The top three possibilities here are: they’re not being sincere, they’re just marketing; they’re being sincere, but they don’t understand the technology very well and are putting too much weight in what the first group are saying; they’re talking about a risk further in the future than OpenAI’s latest model.
No-one serious outside of OpenAI believes “this is the one”. At best, you’re conflating arguments being made on entirely different timelines, falling for the exact kind of equivocation Altman is relying on.
nonethewiser 2 hours ago [-]
This is an inherent feature of "alignment." It's always been bullshit.
Just align it to do what the customer wants.
jackb4040 3 hours ago [-]
I am also not releasing my newest A.I. model over safety concerns. And I'll do it for half what OpenAI will!
jswelker 3 hours ago [-]
I have the best model, but it lives in Canada, so you wouldn't know it.
welcome_dragon 2 hours ago [-]
She goes to a different school
2 hours ago [-]
paul7986 2 hours ago [-]
Muse is totally free. It doesn't throw up gauntlet messages to use it like GPT does even for paying members. Also with Muse's free version I can create iPhone apps unlike chatGPT Work which I pay $20 a month for.
Anyone else using Muse more and noticing similar stuff?
fallingfrog 3 hours ago [-]
Lots of people seem to have the bizarre opinion that companies like openai declare their own products to be unsafe as some kind of marketing stunt.
Ok- so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive? If the company did that do you imagine it would be good for business?
I'm trying to understand the logic here.
RunSet 3 hours ago [-]
I would consider it more "bizarre" to assume that Sam Altman was telling the truth about anything.
(Not saying that it is a marketing stunt, though they said the same thing about GPT-2).
I think the marketing stunt portion is more that the technology is "too powerful". It's just TOO good. It's so intelligent we couldn't possibly give it to the public! This message, to anyone who's using AI, means that there's something even BETTER than the one they're currently using.
symfoniq 2 hours ago [-]
Car companies sell mostly the same car every year. They don’t have billions (or trillions) of dollars of debt riding on the next model they release being substantially better and cheaper (closer to profitability) than the previous one.
These AI companies have been selling AGI as coming any day for a while now. If it doesn’t arrive soon, the safety angle may be the only spin that keeps the massive (and required) investments pouring in.
If instead the narrative became that LLM progress was slowing, we’d almost certainly be looking at the next global recession.
At this point, there is too much money in AI for the truth to have much of a chance.
symfoniq 54 minutes ago [-]
And adding to this:
Does anyone really believe that the first company to AGI would decide not to release it in the interests of safety? Of course not. The first company to AGI would not forfeit their historic opportunity.
Yet, we are supposed to believe that in the name of safety, far less capable models are being held back by the very very same companies that are selling the AGI dream.
This is an industry that cannot speak, unless it is speaking out of both sides of its mouth.
cobbzilla 3 hours ago [-]
Because no car company would ever announce they had an unsafe car. They’d fix the problem and announce an awesome car.
alexfortin 3 hours ago [-]
Hype: you tell the world you alone have a very powerful and potentially dangerous product, and you're the only one who can be trusted keeping it safe.
adfgaiu 2 hours ago [-]
Motorcycle manufacturers have been known to do so. Riding a motorcycle is thrilling in part because it is dangerous. The fact that powerful motorcycles are so difficult to control that most people have no business owning one is absolutely used to make them sound cool and desirable.
For instance, this article repeatedly mentions danger and the need for absolute focus and control:
There is also a parallel (though not a very close one) to "pacing the frontier": there's a gentleman's agreement that limits the top speed of motorcycles to 300 kph (186 mph).
antihipocrat 2 hours ago [-]
Because they declare that their product is unsafe regularly, which gains massive exposure on every news outlet worldwide, then they release the model anyway with zero negative repercussions.
What's with so many people using bad analogies to try and explain simple topics?
Different type of business. Many car companies release new cars showing you how much more powerful and implied dangerous they are. Both in capabilities and design style. In the US (other places too , but especially) they also get much bigger with less visibility which gets double dangerous. But the sentiment they're going for is pretty close - "you want this powerful thing, don't you?"
adfgaiu 2 hours ago [-]
>In the US they also get much bigger with less visibility.
Those are usually presented as an improvement in safety. And they are—for the people inside. Not so much for everyone else.
Dylan16807 2 hours ago [-]
> so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive?
How about we actually try to make it sound cool? They're not releasing the new car because the horsepower was too much, they need more time to get it under control.
I could easily see a car company doing that.
RunSet 29 minutes ago [-]
"Drink responsibly."
kennywinker 3 hours ago [-]
At the moment, their main "customer" is investors, not users. But even users want to use the most dangerous model, because dangerous is just another word for powerful.
Sports cars are advertised with how fast they can accelerate from time to time, or tesla's "ludicrous mode" - that is them advertising how dangerous it is.
wbxp99 59 minutes ago [-]
I think your inclination to take them at face value is the bizarre behavior
zugi 2 hours ago [-]
It's perfectly safe for YOU, the CUSTOMER.
It's just so powerful that, like, the WORLD can't handle it, man!
kipper89 2 hours ago [-]
Why do you think they would announce this then?
They know what they're doing, even if you don't.
protocolture 1 hours ago [-]
Considering that the venn diagram of AI safety gooners and OpenAI is a circle, and that these idiots are starting to worship this stuff as a religion, expecting rational action from them is kind of ludicrous. For all we know Aella promised them a gangbang if they delayed the model a week.
zmgsabst 3 hours ago [-]
There are cars that market based on only being track legal — and even more that market on requiring being tuned down for street safety.
Most sports cars do the second, exactly like OpenAI.
outside1234 3 hours ago [-]
Isn’t this like the twentieth model they said this about?
Are they sure it isn’t because they are setting money on fire and have no business model?
ToucanLoucan 3 hours ago [-]
Yawn.
2 hours ago [-]
Kurd 3 hours ago [-]
Ah shit, here we go again.
option 2 hours ago [-]
lol, nevermind then
chis 2 hours ago [-]
[flagged]
cyanydeez 3 hours ago [-]
Sounds a lot like a hostel keeping its virgin for the best customer.
pas 3 hours ago [-]
brothel?
spiderice 3 hours ago [-]
Gotta find the right hostels
zugi 2 hours ago [-]
Yeah I've evidently been staying at the wrong hostels.
So the danger level is proportionate to how little money you have
5.6 Sol still cranking along
In coding? Software architecture? Math? General knowledge?
The diversity of model use-cases is so broad that comments about "model x is better" without any context are largely useless
Killswitch Engineer
San Francisco, California, United States
300,000-500,000 per year
About the Role
Listen, we just need someone to stand by the servers all day and unplug them if this thing turns on us. You'll receive extensive training on "the code word" which we will shout if GPT goes off the deep end and starts overthrowing countries.
We expect you to:
• Be patient.
• Know how to unplug things. Bonus points if you can throw a bucket of water on the servers, too. Just in case.
• Be excited about OpenAI's approach to research
The safety concerns exist only because the underlying third-party servers are grossly insecure to begin with.
GPT 4.5 was scrapped for similar reasons.
All I really would like is for some of you to CONSIDER THAT YOURE INCORRECT. Just imagine that people ringing the fire alarms are being sincere. Please entertain the position with an open mind.
Did they just get a bunch of credulous "news" coverage out of it? Yes?
Will they just release this within the next weeks, at best? Yes?
Huh, funny that.
If all these claims were being made about some tech further along than LLMs currently are, they might be plausible. But LLMs on their own are not going to be “superintelligence” of the kind Altman is currently cynically spreading fear about. We know their limitations, and those limitations can’t simply be eliminated with more training or better harnesses.
> Just imagine that people ringing the fire alarms are being sincere.
The top three possibilities here are: they’re not being sincere, they’re just marketing; they’re being sincere, but they don’t understand the technology very well and are putting too much weight in what the first group are saying; they’re talking about a risk further in the future than OpenAI’s latest model.
No-one serious outside of OpenAI believes “this is the one”. At best, you’re conflating arguments being made on entirely different timelines, falling for the exact kind of equivocation Altman is relying on.
Just align it to do what the customer wants.
Anyone else using Muse more and noticing similar stuff?
Ok- so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive? If the company did that do you imagine it would be good for business?
I'm trying to understand the logic here.
https://web.archive.org/web/20240112010809/https://www.sfchr...
I think the marketing stunt portion is more that the technology is "too powerful". It's just TOO good. It's so intelligent we couldn't possibly give it to the public! This message, to anyone who's using AI, means that there's something even BETTER than the one they're currently using.
These AI companies have been selling AGI as coming any day for a while now. If it doesn’t arrive soon, the safety angle may be the only spin that keeps the massive (and required) investments pouring in.
If instead the narrative became that LLM progress was slowing, we’d almost certainly be looking at the next global recession.
At this point, there is too much money in AI for the truth to have much of a chance.
Does anyone really believe that the first company to AGI would decide not to release it in the interests of safety? Of course not. The first company to AGI would not forfeit their historic opportunity.
Yet, we are supposed to believe that in the name of safety, far less capable models are being held back by the very very same companies that are selling the AGI dream.
This is an industry that cannot speak, unless it is speaking out of both sides of its mouth.
For instance, this article repeatedly mentions danger and the need for absolute focus and control:
https://www.triumphmotorcycles.co.uk/for-the-ride/news/inspi...
There is also a parallel (though not a very close one) to "pacing the frontier": there's a gentleman's agreement that limits the top speed of motorcycles to 300 kph (186 mph).
What's with so many people using bad analogies to try and explain simple topics?
Last time this happened: GPT - 4 https://www.theguardian.com/technology/2023/mar/17/openai-sa...
Those are usually presented as an improvement in safety. And they are—for the people inside. Not so much for everyone else.
How about we actually try to make it sound cool? They're not releasing the new car because the horsepower was too much, they need more time to get it under control.
I could easily see a car company doing that.
Sports cars are advertised with how fast they can accelerate from time to time, or tesla's "ludicrous mode" - that is them advertising how dangerous it is.
It's just so powerful that, like, the WORLD can't handle it, man!
They know what they're doing, even if you don't.
Most sports cars do the second, exactly like OpenAI.
Are they sure it isn’t because they are setting money on fire and have no business model?