I don't know what your wind loads are in your area but anything fabric can take off like a kite unless you can remove it in a hurry.
I would build a pergola with substantial columns near the fence line. This is one my brother and I did earlier this year which is more oriental in style but you could do a hacienda style to match your house with thicker slats and adobe style rendering on the columns