Well, did some research, there were two Punk vs. Holly matches that ended 2006 (Dec. 12th and 19th).
Punk vs. Holly 3 was the January 9th, 2007 match where Punk finally lost one. So, at least it wasn't random loss to random opponent.
...and, with the exception of a Matt Striker loss somewhere, Punk just kept winning week after week in the months after the Holly loss. So I doubt Punk was wallowing over "the loss that derailed his momentum".