I really think it just depends on the car. I bought one from Victory a few months ago and it has given me no problems- it was low mileage, in excellent condition, as advertised. Sure, I have little improvements and things I want to do to it, but none that have to be done right now.
I did personally inspect/test drive the car before buying it, and would encourage anyone else to do the same. I drove mine 730 miles home the same day. My only problem was trying to figure out how to fill it up properly!
Overall, I think the people who have bad experiences are sometimes more vocal than those who have a good experience. I know I'm certainly that way when I have something go wrong.
For me, they went above the call of duty and did everything as promised. I may have been able to eventually find another car like mine from an individual if I wanted to look for six months, but for me I wanted to "get it done" and they do have some really nice low mileage ones.
If you really want piece of mind, but not as much fun, drive a Toyota Landcruiser. That's my other car semi-daily driver that is 100% bulletproof.
I'm sure people will flame me for saying this, but you can also buy a drivetrain extended 30 month warranty that would cover you against catastrophic problems that surfaced after having the car for awhile. Its cheap insurance as far as I'm concerened compared with a potential $8000 bill for engine rebuild.