I basically ignore it... I think it's a throwaway and I don't think many people pay attention to what they say or how it may be perceived anyway.
Another version of it that is a little less goofy-sounding would be when someone says something like, "Honestly, Bob, I can't think of anyone I'd rather work with on this project."
I guess it is also similar to the use of "seriously" in the same situation.
Or "personally," as in "Personally, Bob, I can't think of anyone I'd rather work with on this project."
In agreement with whoever mentioned it on page 1, I also find "the fact of the matter is" to be a totally useless waste of breath and time.
I also find the use of the word "actually" in every other sentence to be very annoying.
"Hey Matt, are you guys coming out to Andy's gig tonight?"
"Actually, we were planning to, but we just remembered that we had already committed to go to this dinner with Bonnie's sister."
"Cool... y'all have fun. You know the band is gonna be releasing their new CD tonight... do you want me to pick one up for you?"
"Actually, yes... that would be great... I may call you tomorrow morning."
"Okay."
"Actually, we're planning to hit some garage sales near you... would it be okay if we drop by around 11 to get it?"
And on and on and on and on...
