As been stated many times in other RE threads...first time home buyers start modest and work up from there. As Motion says there's many ways to get started in SoCal for 1st time buyers as long as they realize they won't be in La Jolla 2 blocks from the Pacific... A 2BR/2BA condo/townhome, in need of some lovin (floors, counters, paint, cabinets, windows, etc...), with a somewhat handy, or willing to learn, owner is the ideal place to start.
I'm positive I have way less discretionary income than you Dueller. My wife is a stay home Mom so we take it in the shorts financially even more than most. No fancy cars, our yearly family vacation is a 5 day road trip, we don't eat out much, struggling to put money away. Yet, living where we do, we feel very very fortunate. YMMV.