How long ago did you do the migration?
It took me about a week to migrate all my followers when I last did a transfer.
The transfers happen in batches and depend on the follower's own server getting round to carrying it out. You may suddenly have a load of people from one server transferred, because their server has got to your request in the queue.