There are things that you can buy that do just that. It's a strap type of deal that hooks to a band at you belt line. I have used the ol' duct tape method before surgery. Just wrap yourself up over a pair of jockey shorts. You don't want to do that over bare skin!
Just Google Hernia Support or Truss.