Drag and drop is indeed problematic sometimes.

Altough only with certain provinces, for me at least.
If this happens when trying to create a new stack for example, try pressing CTRL when clicking on one of the units.
It should not happen with simply moving a stack however.