The biggest difficulty we had was the IRS office has no sign on the door of the building so it was had to find. And we had to park in a parking garage two blocks away. Finding the parking garage, and the IRS office was a challenge for us, as we don't go downtown very often.
Our Social Security office is in a building of it's own, a few miles away, and a nice free parking lot right there.
My goal is to never have to deal with either of them person to person ever again.
