[JP Noonan]

I would say at the least you are chewing up the flywheel. At worst something is coming loose, like the starter or flywheel.

I dunno if it were me I would look into it further, a little investigation now is better than a new flywheel later.