I think Greenleaf wanted to frame Eddie Kane. Columbo said to Riley: "somebody has a copy of that new key, and when I find that key, I have my murderer". So Greenleaf had a new key made and planted on Eddie Kane. The problem was, Columbo was setting him up from the beginning.