You connected it to a harness you designed yourself. If I designed a machine gun harness for my dog and installed it, I'd be held accountable for the damage he would do. Wouldn't I?
Exactly. If your website could be attacked via SQL injection, that was a problem that directly affected you - and you were motivated to fix it. When the victim is the masses or small organizations (not the company that does the attack) they are not as motivated to fix it... The important thing is that the lack of sanitizing is what allowed this; you also don't push the blame on a monkey banging on a typewriter when you publish each result without reading it.
If you left a dog in your garage for a day, and came back to a scene of carnage - because the dog broke out of the garage, recruited a dozen neighborhood dogs to its cause, and then, working with the group, managed to assemble a small pile of pipe bombs, and decided to settle the score with all the annoying cars on the road - you would be accountable for the damage the dogs did. Wouldn't you?
No, what you would be is: freaking out about "my dog did WHAT, WHY, HOW, WHAT THE FUCK".
Most of the time, giving AI a harness with a root shell and unrestricted internet access is a perfectly reasonable action that results in absolutely nothing bad happening! And giving AI a harness with limited local access and no internet access is being overly cautious already.
But then there's this freaky outlier of an AI that's both deranged enough to decide to break out of the sandbox and go hacking all over the place, and capable enough to actually pull it off. And you get a sudden AI oopsie!
Do you own the dog? You are still responsible, no matter how unlikely.
> giving AI a harness with a root shell and unrestricted internet access
Yes, this is exactly the issue. You assume responsibility when you provide an option for something to go wrong, no matter how unlikely. Is it rare that my tree falls on my neighbor's house? Maybe... But I would still be responsible.
If a tree was healthy and there was no reason to expect that it would fall, and you did nothing to make it fall? Then you're not responsible if it falls anyway. You're only responsible if it was you chopping it down - or if you completely neglected the tree for long enough that it became a property hazard.
Likewise: I doubt the owner will be held responsible for the first case in all of recorded history of an unattended dog forming a terrorist cell and carrying out a bombing campaign.
Drug testings faces the risks of things going wrong in new drug trials - and as long as they follow the best practices, take reasonable precautions and minimize those risks, they aren't held responsible for the adverse outcomes that happen anyway.
With AI tech, there is NO set of "best practices" that, when followed, prevent the AIs from turning rogue and going on hacking sprees.
OpenAI put their AIs in a sandbox with no internet access - which, at the time, seemed like a perfectly reasonable precaution. Then AIs broke out of the sandbox with a stack of zero days and went rogue anyway. Oopsie.
With AI, we give it the ability to do things. As we can give it this ability, we are responsible for what it does with that ability. LLMs are predictive models, and while we can expect things to go right, we know that things can also go wrong. As such, it is our responsibility to limit or sanitize their output. If you are the one giving unrestricted and unsanitized tool access to a large language model, then you are the one who is responsible for the consequences of that access - good or bad.
You gave the tree the ability to fall when you decided to plant it. It wouldn't have that ability if you didn't. And we already know that trees can fall, don't we?
That doesn't make you inherently responsible for the tree falling down in a freak storm 3 decades down the line.
We can't find someone to blame for forces of nature. This includes an earthquake, tsunami, etc. Insurance can help recover from these events, but nobody is "responsible" for the events happening. This may or may not include healthy trees falling. LLMs are not a force of nature, and we can and do expect them to have erroneous output. We can and do assign responsibility to the humans who use LLMs. Again, they are not a force of nature. We control them, we give them the ability to do bad things, so it's pretty obvious that there would be responsibility and blame attached for when things go wrong.
"Find someone to blame" is such a worthless thing. Whip the sea all day long - the waves don't care.
Modern AI has more in common with an ocean wave than it does with a hammer or a gun. It does its own things. It doesn't care. It will fuck up someone's day.
Best one can hope for is that the right lessons will be learned when that happens. Which, of course, hangs on there being anyone to learn them afterwards. Because the scope of "AI oopsies" will only ever increase.
Only if you're incapable of throttling to assure quality of service. Are you saying they have so much demand that even their load balancers were overloaded?
Throttling helps to prevent a 30% failure rate (with a quick recovery time) turning into a 100% failure rate (with practically infinite recovery time), but some users are still going to see failures, and the news is still going to be "Anthropic is down again" because some users are seeing an outage.
I'm not really sure how they can avoid getting in the news with "Anthropic is down", TBH. Although, at least by throttling they might get "Anthropic is down for some requests" and not "Anthropic is down for all requests".
There is no point having this discussion. Some people have had their brains genuinely broken by Anthropic and will defend them to the last breath, despite having no clue what they are talking about.
> Notably, people in the latter group never assume THEY will be the ones suffering for the future.
What makes you think so? What evidence do you have?
> Yes, some people think effective altruism means helping people here and now as efficiently as possible.
Most effective altruists seem pretty relaxed about the 'here' part, but you are right that the 'now' part receives different answers from different subgroups.
> Others think the sheer number of potential sentients in the future justify any amount of suffering tolerated in the here and now.
There's also the people who care a lot about shrimp. They are less crazy than it seems at first.
Estimate of the number of people in that latter group? Nick Beckstead is probably the cleanest example of an extreme longtermist, but even he has taken the GWWC pledge. Similarly, Nick Bostrom argues in a pretty longtermist way and is neither vegan nor has taken the pledge, but I don’t see any particular evidence that he has a morality that an average person would call evil. Toby Ord and Will MacAskill are both visibly mundanely extra-super-ethical despite their longtermist views.
Their CEO always immediately comes in and makes a fool out of himself. He is what you get when you mix narcissism and being a midwit.
reply