I took apart the buffer and discovered the magnet. It’s a bar with a side marked with a red dot. I fumbled around with the magnet and mised which direction it was originally pointing.
I had never opened the buffer in this way ever before. On my first attempt to guess which direction it should face I pointed the red dot towards the side that has the spring (or when looking at the X1C from the back, the side that would be on the right).
Here are some photos to help others in the future know what to do. Luckily it started working again, though since I never opened it before, I don’t know how it was backwards and yet the AMS has worked a couple of times before it stopped working on me.