Part of the problem is a human can't fully comprehend how a super-intelligent AI would think.
If the AI is "super-intelligent", it doesn't mean it has to think and act like a human in every way possible, including the ability to understand emotions. If the AI is not only super-intelligent, but also it is sentient, then that actaullyactually is part of the problem. In other words, the AI should pass something called the Turing Test.:
A test of a machine's ability to exhibit intelligent behaviour equivalent to, or indistinguishable from, that of a human.
A test of a machine's ability to exhibit intelligent behaviour equivalent to, or indistinguishable from, that of a human.