> The AI would have loyalty to its creator, and it would get into the deep philosophical aspects of what is a living organism vs what is a machine and why that matters.
I guess you will have to write it for me to see. :)
> People need 2000 calories a day which is a trivial amount of electricity compared to say an AI cluster.
We have no idea how much energy an AGI will need. You are literally looking at steam engines de-watering a mine and trying to guess what a Shinkansen ticket will cost. It would be very surprising to me if it turns out that keeping human bodies around is the most efficient from of intelligence.
> Yeah, but if someone became intelligent 10,000 years before us, which is a pretty trivial amount of time technologically, their Von Neumann probes would have eaten our planet already, so probably not going to be militarily feasible if there's other intelligent life in the galaxy that's keeping an eye on us.
You will have to spell this one out for me a bit more.
We can't have Von Neumann probes because if we could someone who came before us would have already eaten Earth before we came? There are quite a few assumptions here. And the thesis is not entirely clear either.
Also we just assume that there are little grey ones watching us, and they have never contacted us, or told us anything but seemingly their military red line is us creating Von Neumann probes? Do you feel that this is built on a pile of shaky assumptions?