Once upon a time, a scientist was driving fast In a car full of weaponized superebola. It was raining heavily so he couldn’t see clearly where he was going. His passenger said calmly, “Quick question: what the fuck?” “Don’t worry,” said the scientist. “Since I can’t see clearly, we don’t know we’re going to hit anything and accidentally release a virus that kills all humans.” As he said this, they hit a tree, released the virus, and everybody died slow horrible deaths. The End The moral of the story is that if there’s more uncertainty, you should go slower and more cautiously. Sometimes people say that we can’t know if creating a digital species (AI) is going to harm us. Predicting the future is hard, therefore we should go as fast as possible. And I agree - there is a ton of uncertainty around what will happen. It could be one of the best inventions we ever make. It could also be the worst, and make nuclear weapons look like benign little trinkets. And because it’s hard to predict, we should move more slowly and carefully. And anybody who's confident it will go well or go poorly is overconfident. Things are too uncertain to go full speed ahead. Don't move fast and break things if the "things" in question could be all life on earth. Read more: All
0 Comments
Leave a Reply. |
Popular postsThe Parable of the Boy Who Cried 5% Chance of Wolf
The most important lesson I learned after ten years in EA Why fun writing can save lives Full List Categories
All
Kat WoodsI'm an effective altruist who co-founded Nonlinear, Charity Entrepreneurship, and Charity Science Health Archives
October 2024
Categories
All
|