I just realized why orbit speed feels even higher for me. I usually place the objects near the end of the plate for easier access and faster cooling (I place the plate half hanging).
Because orbit pivot point is the center of the plate and not center of the selected object the faster orbit speed is amplified. Alexosbourn also mentioned that here:
Again something that Orca Slicer has. These are simple things, but improve QOL a lot.