Yea, I guess it's littering. Laying on a sidewalk it would be an eyesore and messy.
But chucking an apple core out your window into the ditch as you drive down a country road is the kind of littering I can live with. And within a week or two there will be no trace of it anymore, unlike Big Gulp cups and McD's wrappers.
So I vote that in an urban setting find a garbage can, but rurally just try not to hit that young equestrian taking her horse out for a trot!