Diophantine said:I think that winrate-based levels are flawed because any given Pokemon can be carried or carry its team and there are so many variables uncounted for. What teammates did you have? What did your opponent have in a given game? You might have a team of really bad individual Pokemon that just happen to work really well together, or conversely a team of OU Pokemon that don't synergise well with each other at all. The same could be said for the opponent.
I see the argument for trying to use objective reasoning to determine a hierarchy, so to speak, of Pokemon in the RandBatts format, but I think that you need to dig a bit deeper than just analysing winrates.
You could argue that things could statistically balance out, but I think that there are way too many variables that impact a Pokemon's viability ingame that it has nothing to do with.
I suspect that there's enough Randbats played that this doesn't matter (because each Pokemon will be on a wide variety of different teams, so it's overall winrate will be an accurate reflection of its true strength). By a similar argument to yours (though I agree it doesn't fully apply) one
could argue that Smogon's usage-based metas are flawed because they also are based on the straightforward stats (albeit usage, rather than winrate) of one Pokemon, and yet I don't see many arguing that should be fundamentally changed, the system seems to work, on the whole.
Also, I've just noticed that you've pre-empted this exact argument in your last paragraph, I still hold that I think things will statistically balance out, given the very high number of Random Battle games played, and the variables involved in dynamic levelling based on winrate can be adjusted to increase the chance of it statistically balancing out (increasing the threshold for 'proof' that a level should be changed by the automated system e.g. by increasing the period of time in which the updates happen (e.g. every three months instead of every month) - which means that more games are played to inform the levelling); increasing the threshold required for a Pokemon's level to be adjusted up or down (e.g. to 60% winrate for a reduction, rather than 55%) - which means that changes don't happen unless there is very considerable statistical winrate evidence that a Pokemon is too strong/weak; reducing the level adjustments made (e.g. reducing the level increase from 2 to 1 for a <40% winrate in a given winrate assessment period) - which means that the impact of the dynamic levelling system is more gradual), though the only way to find out for sure would be to give it a go...
There's the additional point that making a levelling system more complex than just basing on winrate (just as Smogon singles tiers are primarily based on just usage rate) sounds even more difficult to code and justify.
Also wouldn't you think that a winrate-based levelling system would at least be an
improvement on the current levelling system based on Smogon singles usage-based tiers?
I suppose, on this reflection, I can see why A Cake Wearing A Hat and The Immortal are right that the need for refining the levelling system becomes more urgent if Dynamax isn't banned - because Smogon tiers become less relevant in that instance and thus the current system becomes more problematic, and also what Cake says about movesets not having to change as much on the move to a dynamic levelling system if Dynamax is kept (I presume that's because if Dynamax is kept then the format will already be moving away from Smogon tiers, so adding dynamic levelling would help the meta to balance around Dynamax, whereas if Dynamax is banned then a move to dynamic levelling would be more of a shock to the format which would require changing all the movesets?) See Cake's really helpful clarification below!!