I took the old switch apart, and you can clearly see the "grain of wheat" bulb as part of the switch.
I would guess that if you had the right bulb you could solder it in place of the existing bulb - or try retrofitting an LED.
However, stock, the window switches have no designed ability to reaplace the light.
Todd