I never did grasp the subject vs object distinction in grammar, partially because I don’t remember it being explained. If it takes more than a rule or two to find it, then forget it. “Whom” is a word I am completely uncomfortable with using.