I'm not sure which episode it is, but indeed I remember reading about an episode where it shows his driver's license, I'm sure on columbophile website there's an article talking about columbo's first name and about that scene in that episode.
Also there's an episode, undercover, where he says his real name is Lieutenant! He does that when Geraldine Ferguson asks him, their last conversation before she's mudered.