I too say go for it but then the conservative, cautious part of me kicks in and wants to run through every possible scenario. Don't worry I won't
The first thing that came to mind though was if your wife doesn't want to work and you force the issue, she will eventually feel resentment towards you. I'm not saying it's right, not saying you don't deserve to retire early, just saying this could be an issue down the road for you.
Second and last thought I am going to address is the fact your kids are so young. Lots of future expenses coming your way...
On the flip side, it would be awesome to be able to retire so young and enjoy the things you love and not have to work until you are too old to do so!
All the best to you and your decision.