How to improve layer shifts when layer time changes

Hi there,

I am trying to improve layer shifts that seem to occur whenever the print hits a horizontal layer that takes a lot longer to print than the rest.
It seems to me like the previous layer(s) cool and shrink more creating an even shift across the whole part, so the newer layers end up larger than the previous ones by around 0.2mm. Here a picture showing the issue.

I have printed it on an A1 mini and also on the X1C in PLA and I am getting the same result. I tried different speeds, infills, increased the number of wall loops, decreased the number of top and bottom shell layers. I have also tried to change the geometry in order to stagger the horizontal surfaces across layers but it seems to me like I hit the limits before it makes a difference - top and bottom shells need a lot more material and time to print in relation to walls.

One thing I noticed is that the fan speed increases for bridging layers, which probably doesn’t help with premature cooling of the area underneath. Where can I adjust this? Another approach besides printing the tops and bottoms faster (or walls slower) could be to decrease the infill on tops and bottoms or make them thicker to bring their layer times down, can this be adjusted?

Any other hints on how to improve this?

Thank you,
Nestor