Looking at the wiring diagram, there are only two wires labeled "ground" in my setup. One goes to the CD changer, which I don't have, and the other is apparently the main ground for the whole head unit. If that was intermittent, I'd lose power to the whole unit. I don't see anything that looks like a ground which is separate from the main ground for an internal power amp.
