At 44,000, you have a low mileage car that has quite a bit of value just from the low mileage. I agree that if you had a car with 100k on the clock AND showing lots of aging, then just hack away. It won't hurt the value much.
I've done plenty of stereo systems that don't require any cutting of materials or drilling new holes. You have to shop very carefully and have to find the best components that fit in the factory openings and screw holes.
If you do change the stereo, keep ALL of the factory components. That way, you can return everything to stock if/when you sell the car.
Also, keep in mind that a lot of these original door panel vinyl choices are no longer available. My brother has an '83 SC that the previous owner hacked in a 3 way speaker system (they drilled in a mid, tweeter AND the crossover right into the door panel...!). The vinyl is un-matchable and we tried many sources including overseas sources that are known for having factory materials available. So, his panels are permanently damaged.
I like the comment of getting a different set of door panels to hack up while keeping the originals in good condition.
Good luck!
Jay
90 964, 84 3.2