Borrowing from 457 plan
 

Looking for some help:
I know, I shouldn't even think of touching any of this money. But the price of real estate is starting to drop and I need a little extra cash to put down. That being said, I can borrow up to 50% of my savings without penalty and have 5 years to pay back myself. My question is: when do I pay the tax on this? It's all tax deferred right now. Do I have to claim this as income or not because I'm paying myself back?
thanks