not really unless its getting to hot. but normally it will deform the filament if its hot.
Skipping back means its not slipping (good) but there is 2 much pressure build up.
if the feeder is 2 tight it can squash the filament 2 much and be tight in the bowden.
or there could be something wrong the the hot end like blocked nozzle etc.
If the feeder is to loose then in will slip and grind. but in your case if the filament is moving to the side its possible that it could grind even with good contact.
what material, temps and speeds are you trying to print at?