Gotta think aobut his kid. He clued you in. IF you had confronted the guy you would have blown the confidence that the kid gave you.
As for the his jerk dad. You can now reply the next time, "ask my wife" -- and give him a wink
You'll know then if he's a man or not.
IF your wife accepts his advances ... then you'll know what kind of woman she is.