Announcement SV OU Tiering Surveys

Status
Not open for further replies.

Finchinator

no longer Harry’s house
is a Tournament Directoris a Top Social Media Contributoris a Community Leaderis a Community Contributoris a Live Chat Contributoris a Top Tiering Contributoris a Contributor to Smogonis a Top Smogon Media Contributoris a Super Moderator Alumnusis a Battle Simulator Moderator Alumnusis a Past WCoP Championis a former Tournament Circuit Champion
OU & NU Leader
Hello everyone. This thread will be used to post and log results of our SV OU tiering surveys. We used this thread for this last generation.

With regards to OU playerbase surveys, the OU council values the input of its playerbase and feels that this input can be used to help guide them throughout the decision making process. The OU council is able to ask questions about topics they are discussing and potentially gain a greater understanding on the perception of other players who frequent the metagame. These surveys allow for the OU council to gain information pertinent to the tiering process from both the general playerbase and specific individuals with more proven degrees of competency due to success on the ladder or in tournaments.

If you have any questions, feel free to shoot Ruft or me a PM!
 

Finchinator

no longer Harry’s house
is a Tournament Directoris a Top Social Media Contributoris a Community Leaderis a Community Contributoris a Live Chat Contributoris a Top Tiering Contributoris a Contributor to Smogonis a Top Smogon Media Contributoris a Super Moderator Alumnusis a Battle Simulator Moderator Alumnusis a Past WCoP Championis a former Tournament Circuit Champion
OU & NU Leader
Hello everyone, the OU Council is putting out a survey to gauge public opinion on the current metagame. Anyone with Smogon account may respond and we will be taking a particularly close look on those who have experience on the ladder or in tournaments.

We will keep this open through 10:00 PM GMT-5 of Friday, December 9th, but the council will be reading responses as they come in, so respond when possible. It only takes a few minutes to respond, so please do so if you are invested in our metagame!

HERE is the first ever SV OU tiering survey. Please respond!!!
 

Finchinator

no longer Harry’s house
is a Tournament Directoris a Top Social Media Contributoris a Community Leaderis a Community Contributoris a Live Chat Contributoris a Top Tiering Contributoris a Contributor to Smogonis a Top Smogon Media Contributoris a Super Moderator Alumnusis a Battle Simulator Moderator Alumnusis a Past WCoP Championis a former Tournament Circuit Champion
OU & NU Leader
Hello everyone, thank you for responding to the survey! For the first time in the history of Smogon, we have hit over 4000 individual responses to one of our tiering surveys! Today we have a set of data that tells us how the community as a whole and the group of higher ladder and successful tournament players feel.

Let's get started with the question everyone cares about the most: Do you feel any tiering action at all is needed on the topic of Terastallization?

Of the qualified (top 250 on ladder OR made round 3 of the No Johns Release Tournament) responses, 62% favored acting on Terastallization while 38% did not. This sample consisted of 143 people and was heavily vetted due to an abundance of repeat responses, people claiming they qualified despite not having alts within the top 250 at any point, and people claiming they made the third round of the tournament despite not doing so or not even having a forum account.


Of the general responses, 57% favored not acting on Terastallization while 43% favored acting. This sample consisted of 4100 people and is entirely unvetted due to the fact that we received such a large quantity of responses, so we have dozens of duplicates, people who said they have not played or play primarily on cartridge with their own rulesets, and so on.
For normal surveys, I am able to go through and remove responses of people who do not meet requirements (see: not having a forum account), but this would have been a full-time job with so many responses (esp. with how many where done without following the rules) and I already work one of those, so I left it largely unfiltered.

There was also a very amusing phenomenon with these. Historically in the first 12-16 hours we get at least half of our total responses as most people who are invested respond quickly due to it being spread throughout places they frequent. In this range, we had 1300ish responses and 58% in favor of acting. Within the next few hours, Joey uploaded a video and suddenly the survey absolutely blew up, which is cool in one right but also the way it blew up was a little demoralizing from my end as an organizer because nobody actually followed instructions about having a Smogon account or answering the question about restrict vs. outright ban only if you favor action since there's obviously an inherent, so suddenly it became an impossibility trying to meet the standards for quality-of-results that we had reached last generation. This breakneck pace continued for that entire day as well, which is when I ultimately decided I could no longer vet things on a response-by-response basis and just let it rip with what we had.

Please note that if any action does happen, it will be done via public suspect, NOT council vote!

The follow-up question was as follows: If you answered yes, do you believe it should be restricted or outright banned?

Of the qualified responses, 53% favored restricting Terastallization over outright banning while 47% favored outright banning over restricting.


Of the general responses, 74% favored restricting Terastallization over outright banning while 26% favored outright banning over restricting. I also want to note that over 200 people failed to follow instructions as they voted on this prompt while responding "no tiering action" to the first question, which distorts this demographic's responses a great deal. With this said, the number would clearly favor restricting regardless.

The final question on Terastallization is as follows: If you answered restricted, which of the following restrictions do you find to be the most appropriate? (You can select multiple)

Of the qualified responses, we had the above distribution of opinions on the various options for how to restrict Terastallization.


Of the general responses, we had the above distribution of opinions on the various options for how to restrict Terastallization.

This wraps up the portion of the tiering survey on Terastallization.

Regarding Pokemon, we had questions on five individual Pokemon in alphabetical order. The scale for ranking each Pokemon was provided and is as follows: 1 indicates balanced, 3 indicates potentially banworthy, and 5 indicates banworthy. Let's delve into the responses on each!

:Annihilape: Annihilape :Annihilape:


The average qualified response of the 143 responses was roughly a 3.5 out of 5 and over 110 of the 143 total responses where 3 or higher on the scale.


The average general response was roughly a 3.08 out of 5.

:Chi-Yu: Chi-Yu :Chi-Yu:


The average qualified response of the 143 responses was roughly a 3.5 out of 5 and over 105 of the 143 total responses where 3 or higher on the scale.


The average general response was roughly 3.14 out of 5.

:Cyclizar: Cyclizar :Cyclizar:


The average qualified response of the 143 responses was roughly a 3.3 out of 5 and over 100 of the 143 total responses where 3 or higher on the scale.


The average general response was roughly 3.15 out of 5.

:Espathra: Espathra :Espathra:


The average qualified response of the 143 responses was roughly a 3.0 out of 5 and over 90 of the 143 total responses where 3 or higher on the scale.


The average general response was roughly 2.56 out of 5.

:Gholdengo: Gholdengo :Gholdengo:


The average qualified response of the 143 responses was roughly a 3.0 out of 5 and over 90 of the 143 total responses where 3 or higher on the scale.


The average general response was roughly 3.04 out of 5.

This wraps up the portion of the tiering survey on Pokemon in the metagame and the entire survey itself. Thanks to everyone for responding and reading. I am tired, so I'm going to let this sit for a little, but you can expect more news on tiering very soon!
 

Finchinator

no longer Harry’s house
is a Tournament Directoris a Top Social Media Contributoris a Community Leaderis a Community Contributoris a Live Chat Contributoris a Top Tiering Contributoris a Contributor to Smogonis a Top Smogon Media Contributoris a Super Moderator Alumnusis a Battle Simulator Moderator Alumnusis a Past WCoP Championis a former Tournament Circuit Champion
OU & NU Leader
Hello everyone, the OU Council is putting out a survey to gauge public opinion on the current metagame. Anyone with Smogon account may respond and we will be taking a particularly close look on those who have experience on the ladder or in tournaments.

We will keep this open through 10:00 PM GMT-5 of Friday, January 27th, but the council will be reading responses as they come in, so respond when possible. It only takes a few minutes to respond, so please do so if you are invested in our metagame!

HERE is the second ever SV OU tiering survey. Please respond!!!
 

Finchinator

no longer Harry’s house
is a Tournament Directoris a Top Social Media Contributoris a Community Leaderis a Community Contributoris a Live Chat Contributoris a Top Tiering Contributoris a Contributor to Smogonis a Top Smogon Media Contributoris a Super Moderator Alumnusis a Battle Simulator Moderator Alumnusis a Past WCoP Championis a former Tournament Circuit Champion
OU & NU Leader
Hello everyone, thank you for responding to the survey! We have hit over 1600 individual responses, which shows a LOT of retained interest in our metagame! Today we have a set of data that tells us how the community as a whole (general -- 1637 unfiltered responses) and the group of higher ladder and successful tournament players (qualified -- 153 responses who meet these parameters) feel.

On a scale of 1-10, how enjoyable do you find the current metagame?

Response data:
  • Qualified: 7.052/10
  • General: 7.205/10
It appears that the entire playerbase finds the metagame quite enjoyable, but there may still be room to improve on this front.

On a scale of 1-10, how competitive and balanced do you find the current metagame?

Response data:
  • Qualified: 6.039/10
  • General: 6.374/10
It appears that the entire playerbase finds the metagame somewhat competitive and balanced, but there is still a lot of room to improve on this front.

For the following, rate how worthy of tiering action you feel these Pokemon are in the current metagame (listed alphabetically).

On a scale of 1-5, how do you feel about Chien-Pao?


Response data:
  • Qualified: 4.105/5
  • General: 3.461/5
It appears that the qualified playerbase expresses overwhelming support to act on Chien-Pao while the general playerbase expresses a good amount of support, but to a lesser extent.

On a scale of 1-5, how do you feel about Garganacl?

Response data:
  • Qualified: 3.059/5
  • General: 3.228/5
It appears that the entire playerbase expresses some support to act on Garganacl, but by no means a substantial amount of support.

On a scale of 1-5, how do you feel about Gholdengo?

Response data:
  • Qualified: 2.536/5
  • General: 2.497/5
It appears that the entire playerbase expresses much more support to act on other Pokemon than Gholdengo right now, but sporadic support is present and could lead to future inclusion in tiering inquiries.

On a scale of 1-5, how do you feel about Espathra?

Response data:
  • Qualified: 2.980/5
  • General: 2.607/5
It appears that the entire playerbase expresses more support to act on other Pokemon than Espathra right now, but support is present and could lead to future inclusion in tiering inquires.
 
Status
Not open for further replies.

Users Who Are Viewing This Thread (Users: 1, Guests: 2)

Top