Thanks for the feedback. I did some tests to try to find out what was happening;
Moving the object in bambu did not do anything.
Changing the stl resolution from the native file and import it back in did not make a difference either.
However, Meshmixer found a faulty face in the layer that was causing troubles, which was not detected as an error in Solidoworks (the native file format). This was related to a fillet, so I went to the Solidworks file, changed the fillet size and then re exported to stl.
That fixed it! Iguess that there was a faulty edge or face in Solidworks that went undetected.