RE: Surveys,
The OU tiering surveys are something we introduced last generation and I have championed during my tenure as TL. They did not exist for the entire history of Smogon prior, but I found it most appropriate to have a regular feature after TDK introduced it, so I made them often.
So far this generation, we had a good trend going:
- Terastallization had survey support, so it got suspected
- Chien-Pao had survey support, so it got suspected
- Espathra got overwhelming survey support, so it got quickbanned
- Garganacl/Volcarona/Shed Tail received middling support that was all about equal and HOME dates were coming up, so we waited
- Shed Tail (month later) got overwhelming survey support, so it got quickbanned
Every bit of tiering action was prompted by the community past the first week or two. There were points when I did not agree personally, but we acted a way in large part because of the community.
Then, we had the quickbans on Regieleki and Magearna. The second quickban only being Magearna made a lot of people mad at the process and results, so we changed the vote threshold upon community prompting
here. Given this, it felt appropriate to hold a community survey to see if we should vote again sooner than anticipated. I put up another survey before Magearna was even banned on PS to see if another emergency vote was needed like we had on Regieleki the week prior, and sure enough, it was. We banned Chien-Pao and Zamazenta-Crowned.
Prior to this weekend's vote, we had 3 big bans (Magearna, Chien-Pao, and Zamazenta-Crowned) implemented on PS since a good portion of the survey results went up. Given this, the survey's purpose was to focus on the potential for an emergency vote, which we did
imply. It feels inappropriate to use responses from a metagame that is multiple bans dated to dictate the radar or the proceeding vote, so we did not.
To me, the issue seems like the fact that this was not communicated sufficiently on my end, for which I apologize as I have had a very busy week, and we need to adjust our tiering process surrounding releases, for which I created a thread on
here and have been reading every post possible here. The Volcarona ban half of the council posted their thoughts on prior and it was included in the radar, so I think the effort was good, but the overall logistics could have been better.
I find it unfair for people to say we ignore surveys or just do what we want given the track record I outlined above surveys have quite literally had more say than either tier leader so far this generation, and it's not particularly close. Community input drives OU and will continue to do so. I do think there is room for improvement though; sudden releases like HOME are unprecedented and finding the right pace and process has been very challenging, but more experience will help and input guide us moving forward. Personally I want to try some type of ongoing/rolling survey during release periods where people can respond intermittently and we can collect data as it goes -- may be too idealistic, may end up just as weekly surveys instead of monthly, or may be somewhere in-between, but we have been and will continue to be committed to both using community data and improving our processes.