I have given this same thing alot of thought and have come to the conclusion that a turbo is the way to go. There is no radiator to worry about no cutting just a nice neat package of the turbo system. From what I have seen over at Shop Talk and the books I have bought it really is not that hard. The biggest help I have is a friend that does turbos for a living. Reddawg racing has a few good pictures on their site showing a rotory swap. I was going to do a V8 swap until I seen this V6 conversion at a meet and it made me wanna puke! It was a mess. Since then it has been turbos all the way for me. Either way, like you said, it is all about the hobby and having fun. Play with the turbo calculators here it should get you motivated.
http://www.turbofast.com.au/welcome.html