I would of been like "Oh you mean Paul?! He was so nice to me when I first started working here! We had lunch a few times and he really made me feel welcomed."
In a way, it sounds like this person thinks he is the card police. He chooses who gets to sign and who doesn't. I think he should have just gone around and asked if you and other unknown people would like to sign the card. I wouldn't confront him. He sounds like a control freak, and kiss up anyway.
your coworker was rude, not much you can do about it