welp, you said "all opinions appreciated":
I think he may hate you for it! Not literally, but I know from personal lifetime experience that such a name can haunt. My parents had the brilliant idea to call me 'Theodore' (gag!). Have always shunned that name and gone by 'Ted', but the double name thing gets confusing throughout life (given name vs. common name). I'd stick to something one or two syllables, more simple. Tell him later you considered 'Remington' and he will thank you for reconsidering!
If you go ahead with it, I bet he'll invent something like 'Remo' before he reaches teen years, rather than 'Remy'.