I had a similar problem to a worse degree. I initially wanted to solve the root problem and did some investigation with the great folks on this forum. I did not want to use hack tracks as that felt like cheating and an admission that I built something wrong. Eventually, I wanted to make stuff instead of problem solving, installed hack tracks, and it solved my issues.
Pretty simple to install and seems to fix issues for a lot of people.
And you’re engaging the x motor before you begin? I’ve done that once or twice, it wanders a bit.