Well I'm SOOOO sorry I am such a pain in your a$$! You know MOST people appreciate a good fart joke every now and then. That is, people that DON'T have a nose so big it HAS to be looked down upon to see people.
You know next time we fly together I might just take it to the next level and as soon as you say "V1" take my hand off the levers and put it right on your leg, and we aint talkin' the knee here. We'll see who's doing the talking then. After we clear 10,000 (and you turn back to your normal shade of yellow) I will begin to recite Monty Python and the Quest for the Holy Grail from start to finish and, if there's time, ask you to join me in singing It's a Small World After All. Did I mention I sneeze a lot? I will never move my mic away from my face when I do so but when I'm NOT talking to you will be sure to place my mic in the airstream of the overhead vent.
I will, of course, remain professional decending below 10,000 again and eliminate all necessary conversation but I WILL call out airspeeds and altitudes and deviations from SOP at 15 second intervals. "Leaving 8 for 5, airspeed 5 over 250." And after we roll into the chocks you can BET your a$$ I'll turn to you, slap you on the back and say, "Cheated death once again, didn't we?!!"
I hope you get that I'm only kidding, to a point) we've all flown with guys we had a problem with. All the previous answers were spot on but if they all fail there is one more thing. . .
If there's something that annoys you so much about him, there's surely something YOU can do that annoys him just as much. Exploit that and have fun with it!!