Harry is upset because Kate trusts him completely and never shows signs of jealousy--he thinks that maybe she doesn't love him anymore.