Neither mirror would move “away” from the car horizontally. They would only move “towards” the car. I hope that makes sense; if you were to sit in the driver’s seat in a LHD model, the mirror would not move to the Left. The opposite would be true from the passenger’s seat/mirror.
I just got the replacement switch in the mail and installed it and we’re all good now.
Thanks!