I'd suggest running 3 conductor wire to the sub panel.
I'd probably pull the meter and redo this installation to include a disconnect, while I was messing with it.
Lots of basic electrical work safety videos on the tube.
https://www.youtube.com/watch?v=0Crmfnz-KgI