I've had both and for the pure pleasure of driving, there is nothing like an open top car.
On the street nobody will ever notice the torsional difference.
I would say on the track the most notable downside would be the weight up top.
Only 911 guys like coupes better, XKE's Ferraris topless cars are favored.
I guess 356 Speedsters or Cabriolets are not popular among the coupe gang.
Since fewer Targas were produced maybe it's just jealousy