I did try just the center pin on the RCA's and the noise increased.
Gain is at about 3/4 so I may try and adjust it back and tune the deck again.
Crossover is at 120 on both the deck and amp. HP filter is on (amp), and on the deck its set at through. I have tweeked these settings a bit and this seems to work best.
Front channels on the deck are at 5db and the rear are at 10db, with the infinity powered sub on its own connection.
Deck installed...all of the noise issues came with the amp install as the deck worked perfect before with just the infinity powered sub.