The Gaming Den

http://en.wikipedia.org/wiki/Limits_to_computation
Anything that approaches these is beyond human imagination.

And if you think you have keep a superintelligence locked up in a box, here's a story for you to read:
http://lesswrong.com/lw/qk/that_alien_message/

And it seems to me you're vastly underestimating what "superintelligence" means. People usually think of intelligence on a "village idiot" to "Einstein" scale, when really it's "insect" to "something so far beyond any fictional God we're incapable of imag...

A recursively self-improving AI based on neural networks would be humanity's last mistake. If I thought somebody was about to build one I'd seriously trigger a global nuclear war to prevent it if that was an option.

Read Yudkowsky's paper for explanation. He's a better writer than me.

which is to say they don't have AI that even comes close to something that understands what "over throw" or indeed "us" means. That's essentially the problem. The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else. "...

Have you read anything by Eliezer Yudkowsky? He has written about how people tend to drastically underestimate the risks of strong AI, because lacking any non-human example of powerful intelligence, we tend to anthropomorphize AI. Human values are a result of our evolutionary history, and an AI lack...

It's too short notice to get the full benefit, but this is the kind of task where Spaced Repetition can help. If you're not familiar with the concept then read supermemo.com . The best Spaced Repetition software is Anki ( http://ichi2.net/anki/ ). Supermemo's scheduling algorithm is marginally super...