Proposal Suspect Test Qualification Reform

Hi, in this thread I'll be advocating for suspect test qualification reform. I will be focusing largely on the process as it pertains to OU, but ultimately is applicable to other tiers should they find this suitable. Currently, OU sets a benchmark of a requisite elo & gxe, such as you've seen in the ongoing tera blast test. When you meet this threshold, you earn the right for your singular vote in the suspect test. I am proposing that there be different tiers of qualification, awarding different values of points based on the merit of your qualification. Suspects would use points instead of votes, and the threshold for results would be based on the % of points allocated towards a certain result, instead of the current system, being the % of singular votes allocated towards a result. I'll use the current OU suspect test as an example:

In the current system, 1750 elo & 80 gxe earns you the right to a vote. Everyone's vote is then tallied. 60% of votes to get a result, you know the deal. In my proposed system, there would be 3 tiers of qualification: tier 1 would earn you 1 point, tier 2 would earn you 2 points, and tier 3 would earn you 3 points. Tier 1 would require the normal 1750 elo & 80 gxe. Tier 2 would require 1850 elo & 82 gxe. Tier 3 would require 1950 elo & 84 gxe. The total summation of points is tallied, and 60% of that is required for a result. It's a bit backwards for me to be explaining the system before explaining the problems that I'm trying to address, so I'll now get into that.

If you have remotely played in bigger smogon tournaments or otherwise spend time in spaces with tournament players, you will absolutely have heard the notion that suspect tests are too easy. It's the notion that we, communally, are giving votes to people who realistically do not understand the tier on a level that actually qualifies them to make decisions about it. On the flip side, you absolutely have people who feel they deserve to be heard and not have reqs be absurdly difficult. The problem of course is that "absurdly difficult" is relative. I find myself at an impasse where I empathize with both parties. I agree that reqs should be an accessible challenge. That being said, I also agree that an SPL player who easily breezes through reqs at 34-2 should not be withheld to having their vote measured the same as billybob96, who qualified after 400 games, and realistically does not understand the metagame at (what more elite players would consider) a reputable level. My solution splits the difference here. It keeps reqs just as accessible for players who are not amazing but can hold their own. It also gives structure to the (imo) 100% true notion that better players SHOULD have more sway in the tiering of a tier. It does this without removing the aforementioned players from the equation. People have theorized solving this issue and it's always so one dimensional: increase elo & gxe to a length some would otherwise find absurd. This foregoes that while giving them a tangible reward in lieu of what they're seeking. It doesn't ruin the experience for players worse than them, and frankly if anything gives them something more to strive for & grow with.

There's more besides the core rationale seen above as to benefits of this proposal, imo. I'm going to split them up a bit for the sake of readability. For one, it can help shape the opinion of players further by having a reason to play more games vs better opponents. This doesn't become a required extra grind for players seeking a vote, since the base requisite for a vote still remains. Another reason that is parallel to this one is that it will absolutely create growth in the overall skill of players. You are giving them more to strive for, without making it required but also putting reward behind it, and thus there's a reason to struggle and improve. This isn't at all "why" you'd implement this reform, but it's certainly imo a cool indirect benefit of it. Smogon would absolutely benefit from this, and in the most immediate sense with respects to subforum discussion threads.

Another more direct benefit involves an element we're all familiar with, that there are people who seek out reqs strictly for the coveted tiering contributor badge. This is common & visible in lower tiers but obviously happens in OU as well, given size & visibility. These folks would still get there baseline reqs for the tier 1 qualification, but their vote would not impact the results as much as the diehards who will strive for tier 2/3. This is an immensely useful benefit imo, as this has been a complaint that has been lambasted for eons on this website by mainers of respective tiers holding a suspect. Like the situation a few paragraphs above, it respects both sides of the coin at the same time. It gives accessibility while giving the grinders something to feel content about in regards to their investment. A last very minor benefit is that it will definitely increase ladder play statistics, however much we care about those these days.

There are a few things to clean up about this before I click "post thread." For one, I would want to make it as easy on the verifying staff as possible. Users would be able to submit ONE suspect alt verification image. Having someone post a tier 1, strive for tier 2, and then fall below tier 1 permanently sounds like a nightmare. Asking staff to verify your post before you continue laddering is also a massive timesuck, especially in OU. Overall, it's something the player would have to be accountable for. Another element to clean up is that I would not want to make the tech guys job too difficult, but I imagine this could be reasonably solved. Let me know if I am incorrect. I also think it's very tunable, meaning that you can set the 3 tiers to whatever the hell you want. I think what I provided works well for OU, but UU & so on of course would have to adopt a different method should they find this acceptable. Anyway, that is it for now i think. I wrote this hella on a whim, so i'll edit in more/make another post should I consider it too relevant to ignore.

edit: the amounts of elo/inclusion of gxe even in ou is of course negotiable. i think 3 tiers works best, though. 2 feels too few, 4 too hectic and overbearing.
 
Last edited:
If the goal is just to reduce the influence of less qualified voters, couldn’t we simply raise the GXE requirement to 82% instead of introducing a whole weighted voting system? I don’t really see the point of keeping unqualified voters for inclusivity if in practice we’re trying to reduce the impact of those votes anyway. Raising Elo/GXE can feel “one dimensional” but that’s kinda the idea. It keeps things simple and it avoids creating arbitrary differences between players who have all already proven they’re qualified. A single cutoff is more honest in my eyes (and it’s simpler!).

Also, 1950 Elo is basically top 25 and getting there feels way more like a test of free time than skill if GXE is the same. Laddering is already not a very fun experience and it's even worse when you’re getting single digit points per game. It’s already pretty rare for invested players (aka council members, tournament players) to consistently go for reqs so making it more time consuming to have their votes "fairly counted" might just not make any significant change in the suspect process.
 
Last edited:
Maybe I'm reading this wrong, but if the goal if "make the people who are good at the game have stronger voting power" then wouldn't it make more sense to give these people who are likely doing well/did well in tours that took place around the same time as a suspect to just give them voting power worth more instead? To my knowledge, older gen suspect requirements, especially for tiers without an active ladder, are done through doing well in tours and it could probably be changed in a current gen with an active ladder from "you get reqs because you got top 8 or something" to "you get reqs and your vote is worth 2 points instead of 1 because you got top 8" which seems a lot cleaner than "You won an entire tour, go on ladder and get top 25" at least to me anyway.
 
I can't speak to current gen OU, but I do agree with this post in the context of old gen OUs.

The last suspect in ADV OU was in August 2025 and had the following requirements
1775835248338.png

Naturally, any threshold that only 3 players on a very active ladder met is heavily gatekeeping (which makes sense and was the goal for an old metagame like this). However, it comes with drawbacks. The main issue is that it's extremely hard to design a gatekeeping threshold such that the limiting factor is Elo without creating a very long grind even for very strong players. Thus, these reqs usually become chosen such that GXE is the limiting factor (as described above, only 10% of the ladder meeting the Elo requirement had the GXE requirement at the time the suspect started)

Harsh GXE reqs, while it has the advantage of gatekeeping well while still letting strong players through relatively quickly (on average), are still widely hated by the playerbase. It is non-intuitive and extremely punishing for losses in early in the run. It also creates a negative spiral where players who get early losses constantly reset, create new accounts in the 1000-1300 range, and then contribute to other suspect accounts getting early losses. Strong players can usually just eat a few losses and power through (though it may take a bunch more games, it took ABR 75 games or so and Hclat several hundred - and several strong players just gave up completely rather than bothering).

For people more on the cusp, they essentially have no choice but to go into the low elo reset mines, which is a terrible experience and makes everyone mad.
1775834953714.png

Back the original suggestion, I believe that a more flexible multi-tiered suspect would allow for problems like this to be addressed. For a tier that wants to heavily gatekeep votes, having a "consolation prize tier" would significantly reduce the incentive for people to grind resets and thus make it far easier for the strongest players to achieve GXE reqs in a reasonable amount of games. For example, something like a two tier system with 1700 Elo + 80% gxe tier 1 and 1750 elo 82% gxe tier 2 would've made the ADV suspect discussed above much more effective imo.

Generally, I think giving more flexibility to the tier leaders to create a suspect reqs system that achieves the goals they want is a good thing. Assuming it is not a huge technical ask I think it will be very helpful almost across the board.
 
This feels like we’re chasing solutions for a problem that doesn’t exist. I’ve always heard this sentiment that suspect requirements are too easy, but have yet to see a single suspect test this generation negatively impacted by these so called “lower quality” voters. In fact, the biggest scandal of the generation arguably happened because some tournament players felt the requirements were too hard!

Every time this topic comes up, no one can ever really point to a good reason why we should raise/segregate requirements, other than “well I think so”. Not a single suspect test has been flipped due to worse players voting, we’ve already taken steps to address this non-existent problem, and yet we still think that somehow, suspect requirements aren’t enough?
 
Reqs.png

captured above: everybody who played sv in SPL XVII (the most recent spl) and their involvement as far as i can tell in the last 3 sv ou suspects.
i also did this with ost top 16 and the results are roughly identical.

suspects are too easy but they're also a slog and the average player of sufficient qualification recognises this; people who are almost guaranteed to get reqs don't even try because it's way too much of a hassle and not worth the reward. after a certain point the current reqs system skews away from general game skill and more towards testing your ability to concentrate for long periods of time without tilting or making choke plays. any suggestion like in the op that incentivises people to play for longer or to reset if they take a loss in the first 30 games instead of the first 20 only exacerbates this and would not improve things IMO.

as an aside im not entirely sure suspects are too easy. im wondering if you guys are just seeing bad opinions and refusing to believe they can be held by good players. think on it. i wager most of you guys know at least one good player who secretly thinks chi-yu or shed tail should be given another chance or that so and so nu shitmon is viable.
 
Back
Top