"Well, there you are sir. You see, I'm not as dumb about these things as I thought."
Yes, it comes from "A Matter Of Honor". Columbo says it to Luis Montoya while the two of them are in the stable discussing the sort of "stick-thingy" that victim Hector Rangel would have had with him out there in the bullring.