Rarly,
I think the point is, you have no idea what that crazy stranger will do. Racing on the street is for the most part a pissing contest - many times its 'harmless' until somebody does something stupid (like cut in front of other cars, or not looking where they're going because they're glaring at you, etc). Then things can turn real bad real fast. Not to sound like Mary Poppins or anything, but to me the 5% chance that something bad will happen is plenty enough for me to "take it to the track"
Brad