It's a good bit.

My guess is if you went to the Apple Campus and held up an iPhone recording its employees, you'd have the same thing happen to you.

you really don't

Not resetting limits when the model comes out though. Obvious miss. They need a Tibo.

Not sure who the Quincy institute is. But can you imagine if the U.S. permanently broke open the great firewall with AGI, and media started flowing in unrestricted into China?

Or can you imagine the reverse, if China managed to hack in with ASI into the U.S. DoD's tech servers for specs on our drones and planes?

There's a gigantic amount at stake. Attacks like the Hezbollah pager attack would be almost trivial with levels of compromise enabled by a sufficiently advanced AI.

It's not clear to me the paper addresses any meaningful part of the risk and hand waves it away.

Congrats. Can you do Launch / software videos as well?

Thank you for your feedback. We will provide software videos later.

What political debate is married to the facts? Name one.

Really, for most debates it makes no sense to call the entirety of the conversation "married to" or "divorced from" from the facts, because even if one particular "side" of the conversation is "married to" the facts, another "side" might not be. For example, a debate between a "humans don't significantly contribute to climate change" side and a "humans do significantly contribute to climate change" side is not going to be "married to" the facts when considered as a whole, even though the latter side is "married to" the facts (in some conexts).

See also: https://news.ycombinator.com/item?id=49746654

The best piece of reporting on the subject I have ever seen.

Fascinating. By scale, the Ukraine War, Sudan, Syrian Civil War, etc. have caused significantly more misery and death. But there's 0 money in reporting on them, and it doesn't not tap into the latent desire for a global conspiracy and enemy. You don't have to agree with the country (and you can hate what they're doing in Gaza) and still see the scale of media coverage doesn't align.

A really, really good question!

Well, it's not like humans are nigh-invincible demigods. We are quite fragile and could have killed ourselves as a species since way before AI. If AI wants to kill us, it shouldn't be that difficult. So I don't see why people are fixating on this question.

Precisely. We might kill ourselves with AI. Unlikely AI will do the job for us.

Not really. The answer is completely obvious: Take over and destroy the digital infrastructure that humans have spent the past 30 years connecting every aspect of civilization to.

Good luck ordering supplies for a hospital or grocery store today without the Internet. Paper catalogs are gone, fax machines are mostly gone, landlines are mostly gone, etc. etc. All the ways that used to be there for running things are gone, it’s all online.

You'd have mass casualties on a hitherto unseen scale, but hardly an extinction