[Formerly Steve Wilkinson]

It simply slides upward and out of a u-shaped slot in the part that's glued to the glass. You probably won't be able to simply lift it out if it's been there awhile, but you can tap on the mirror-stem part, gently, with something like a small rubber or plastic mallet. I wouldn't recommend using a steel hammer, you might crack the glass.