Not sure it will help a lot but it maybe related to infill/wall overlap, as infill keep the sema direction and not rotate when turning the 3d model it still.make sens tha only X o Y is impacted : :Is that a problem ? micro-z-banding
Try -5% for overlap infill/wall (note the minus sign)
Try without or with tiny infill ratio