That's such a great phrase, "I'm JUST sayin'" You can say nearly anything and pass it off.
as in:
"Hey, I really like that car,
I'm JUST sayin' it looks like a POS"
"No really, you look great,
I'm JUST sayin' you could lose a few pounds."
It's the soap of conversation, it cleans all....