I can think of two....where he thought he may have been wrong til the very end...Swan Song....when Johnny Cash flies away on a plane ...and Stitch in Crime when they do not find dissolving suture in the O.R....
When Charles Clay is found dead in the dreadful "Last Salute To The Commodore" Columbo has to start all over again since Clay was the prime suspect.
Why did you find that episode dreadful?
Nobody thought to mention " Columbo cries wolf " He was COMPLETELY fooled in that episode until the women appears alive near the end :)