You've touched on something real here.

The term 'genius' bothers me too because it seems calling someone a genius is less about the object (ie the person we are talking about), but more about the speakers feelings toward that object (eg godlike awe etc).