Jimmy proved he was very much a man on the Boardwalk Empire episode "Gimcrack and Bunkum." This is a scene from it.
Van Alden has trouble keeping it together on this season. He's reacting to the condition of a colleague.

Boardwalk Empire Season 2 Episode 6 Quotes

Margaret: Are you in the habit of toying with women, Mr. Sleater?
Owen: I wouldn't call it a habit.

Not every insult requires a response.