[stomachmonkey]

Lots of info about your setup missing.

Are the cameras wired or wireless?

Are you viewing the live stream or does it record to disc and then play back?

Do you know or can you find out what format the cameras/DVR are pushing?

Do they send the signal to a DVR that rebroadcasts to your remote devices or are they hooked into a service that you log into to watch?

When you are on site you are (most likely) on the same network as the cameras, reduced latency.

When viewing remotely the signal needs to leave the facility and make its way to you.

As mentioned, if your broadband is not robust enough in one or both of the locations you'll encounter issues.

Again depending on your setup have you checked to see if you can enable buffering?