Honestly, I really don't see any wrong in someone who isn't too much of a fan calling it "Kingdom of Hearts." I have siblings that call it that and though I want to correct them, it doesn't really bother me.. and I usually say nothing..
If you want to correct them then it bothers you. And that is the chink in the armor of your soul and all I need to make you mine.