Thanks to all for the thoughts and advice. The house is two stories and is a nantucket style home. I think I am going to keep getting estimates as $16,000 is way more than I am willing to spend.
So If I do nothing and just let it weather am I going to damge the siding?