Don't forget Gliscor as one of the big defensive nuisances for the team. I'm pretty sure he outspeeds everything other than Infernape, and it's going to take a lot of priority attacks to drag him down.
I'm not sure to what extent you can implement this, but the usual way to run a Fighting-heavy team is to use one or two U-Turners to rack up damage vs. Rotoms and bulky fliers and use that as the means to open the holes for the sweep. The reason this is hard to do is that U-Turn Infernape/Primeape aren't so good without Choice items, which means that they're basically forced to do nothing but U-Turn until you're certain you can sweep, which really restricts your options. On the other hand, it would either give you an out vs. setup (with Scarf) or more raw sweeping power once the walls are cleared out of the way (with Band), but it's not clear that you can build a team that can manage it.
The Breloom question is an interesting one, because the Ground resistance is pretty strong given that you're carrying at least two Ground weaks (no way you don't have Lucario and Infernape), but it's slow and restricted as a sweeper. I actually think it's worth considering Sporeless Breloom here, so you can use Stone Edge in addition to both STABs, or possibly Stone Edge + Mach Punch + fighting move of choice. Spore is pretty useful when it threatens to cripple a sweeper or win you free turns of setup, so I don't know, but it's an option that I don't think is totally invalid.
Small bonus to Breloom, protection against status is probably at a premium on this team. Infernape can absorb Wisps, but I don't know how many of your guys can afford to run Lum Berry, and most guys are better off running a boosting item to strengthen their priority.
Also, I don't think Toxicroak is ideal (among other things, he's probably going to give you 3x ground and/or 3x fire weaks), but it does have the advantage of resisting both Waterfall and Stone Edge from Gyarados, so that's something at least. I doubt he's usable, but it's worth noting that Poliwrath does the same, although he's probably not good enough either.
I'm not sure to what extent you can implement this, but the usual way to run a Fighting-heavy team is to use one or two U-Turners to rack up damage vs. Rotoms and bulky fliers and use that as the means to open the holes for the sweep. The reason this is hard to do is that U-Turn Infernape/Primeape aren't so good without Choice items, which means that they're basically forced to do nothing but U-Turn until you're certain you can sweep, which really restricts your options. On the other hand, it would either give you an out vs. setup (with Scarf) or more raw sweeping power once the walls are cleared out of the way (with Band), but it's not clear that you can build a team that can manage it.
The Breloom question is an interesting one, because the Ground resistance is pretty strong given that you're carrying at least two Ground weaks (no way you don't have Lucario and Infernape), but it's slow and restricted as a sweeper. I actually think it's worth considering Sporeless Breloom here, so you can use Stone Edge in addition to both STABs, or possibly Stone Edge + Mach Punch + fighting move of choice. Spore is pretty useful when it threatens to cripple a sweeper or win you free turns of setup, so I don't know, but it's an option that I don't think is totally invalid.
Small bonus to Breloom, protection against status is probably at a premium on this team. Infernape can absorb Wisps, but I don't know how many of your guys can afford to run Lum Berry, and most guys are better off running a boosting item to strengthen their priority.
Also, I don't think Toxicroak is ideal (among other things, he's probably going to give you 3x ground and/or 3x fire weaks), but it does have the advantage of resisting both Waterfall and Stone Edge from Gyarados, so that's something at least. I doubt he's usable, but it's worth noting that Poliwrath does the same, although he's probably not good enough either.