Also just experienced this with Bambu filament too - It always works fine on the normal AMS, even from different AMS!
I have it all set up properly, auto refill shows me what it will swap to, come in in the morning “AMS slot 4 is empty…” and an unfinished print - no ■■■■, you were meant to swap to slot 1!