Cannot adjust the A brackets on Rear of Z Axis Do I need shims

If I even slightly tighten up the retaining nuts on the A brackets which hold the pipe for the Z Axis the tension on the pipes is too much and it will make the travel very difficult.
Do I need to use shims?
Just a visual but it looks as if it is off by about .25"