[recycled sixtie]

All of the above have good points. You have taken for granted the peacefulness of not having to share walls with neighbours and you are a reasonable distance from them too.
Check HOA rules, fees for a townhouse. We have a condo that is rented out and I see a townhome being somewhere between a house and a condo.

For ourselves we live in a 1400 sq ft house and my wife is really attached to it. As long as we can do the yard work, snow shovel etc then we will stay. Perhaps you should look at a smaller house?

Guy