So the other thing just so you know is that I'm using Octolapse and someone on reddit mentioned that there are retraction settings for Octolapse. So probably the issue is there.
Spider profile.curaprofile
BTW, it just occurred to me that which I was complaining about the consistent travel moves at certain points of time were due to my timed 30 seconds profile I used.
Octolapse truly is a new artform.