Priming issue when using the external spool holder

I’ve had my H2D for about a month now and noticed some issues with using the external spool holder. The extruder seems to struggle feeding from the spool, I was originally getting motor overloaded errors. I solved this by printing a spool roller that fits over the stock holder and greatly reduces the resistance. This solved the error.

However, now I’m having problems when it starts to print where it hardly extrudes any filament during the prime line. This then causes minor issues with the part where the first few mm are under-extruded. Once it gets going though, it’s fine.

Is this a known issue? I’m hoping to eventually replace the spooler holder with the AMS-HT

Pic for example:

(Sometimes nothing is extruded during priming, depending on the filament I’m using)