If you have a Pokémon with Flame Body AND Flash Fire it takes half the time, but yeah it was clogging up my party for a while before it hatched.
Also, dunno if this is old news, if you save your game at 23:59 in front of an electric sign you can soft reset to get to the swarm you want. I...