Is there any type of house on the property now? It is pretty easy to get a regular 30-year commercial of Federal guaranteed...but might need decent down payment.
Can you make it your permanent residence and you current home your "second"? Also, if rural, this is a program many do not know about.
https://www.rd.usda.gov/programs-services/single-family-housing-guaranteed-loan-program
As far as buying and then refi, you generally have to pay a slightly higher rate on a refi...but not always.
__________________
74 Targa 3.0, 89 Carrera, 04 Cayenne Turbo
http://www.pelicanparts.com/gallery/fintstone/
"The problem with socialism is that you eventually run out of other people's money"
Some are born free. Some have freedom thrust upon them. Others simply surrender