Is that the same guy that did the site? As I recall you paid the guy that did the site a fair price and some of that undoubtedly helped you get there too.
No relationship to the guy that did the site whatsoever. And I believe the guys that did the site did not necessarily do anything to make it SEO friendly or optimized. They just designed it. So I paid a lot of dough to get a decent "looking " site that nobody was ever going to see and then I interviewed probably 15 SEO guys and finally settled on a guy that gave me an offer I could not refuse.
Panda and Penguin didn't hurt my site, but I know it hurt some of my competition. I feel sort've lucky. I have no idea what might have happened to my site if someone else was doing my SEO.
I sure would like to move up a few spots, though!