1. Welcome to Smogon Forums! Please take a minute to read the rules.
  2. Click here to ensure that you never miss a new SmogonU video upload!

Data Official Smogon University Usage Statistics Discussion Thread, mk.3

Discussion in 'Smogon Metagames' started by Antar, Jan 5, 2017.

  1. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
    So... it looks like there were no non-bank ladders for Ubers / Doubles / LC? Is that correct?
  2. perry

    perry formerly Mr. Perry
    is a Pre-Contributor

    Joined:
    Jan 3, 2014
    Messages:
    533
    yes, they all jumped to PokéBank.
    Antar likes this.
  3. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
    k, that explains it. I'll redo those tiers after I finish with UU and RU.
    perry likes this.
  4. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
  5. atomicllamas

    atomicllamas but then what's left of me?
    is a member of the Site Staffis a Super Moderatoris a Community Contributoris a Tiering Contributoris a Contributor to Smogon
    RU Co-Leader

    Joined:
    Apr 16, 2013
    Messages:
    4,387
    Thanks Antar.

    The Immortal can you implement these (and UUs drizzle ban) on the ru alpha ladder? Sorry to bother you again, but thanks in advance.
    Antar likes this.
  6. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
  7. MagikaripIsOP

    MagikaripIsOP

    Joined:
    Jul 22, 2013
    Messages:
    280
    Is it possible to get usage stats on teams? Like most common teams? I'd imagine the higher you get, the more you start seeing similar teams. I'd mostly be interested in the 1825, 17xx (for non ou) ranks
  8. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
    MagikaripIsOP no, I don't have any intention of providing that level of detail. It's not competitively useful (most common will still only be like 1 in 1000 at most), so it's just an opportunity to get lazy with teambuilding.
  9. Mijzelffan

    Mijzelffan

    Joined:
    Sep 27, 2010
    Messages:
    108
    Since pidgeotite and steelixite have been released yesterday they will technically fall under this month's usage stats, just with a pathetic amount of usage. Will this be used as an opportunity to have them immediatly be passed down to the lower tiers (where we all know they'll end up) or are they going to be kept in OU for another month until we have a full month of usage stats for them?
  10. Nailec

    Nailec

    Joined:
    Dec 5, 2016
    Messages:
    37
    I hope it's not too late to ask for the separated monotype reports of March. Or maybe they actually were generated last month and I missed them
  11. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
    Crud. Did I forget to upload them?
  12. Nailec

    Nailec

    Joined:
    Dec 5, 2016
    Messages:
    37
  13. Xayah

    Xayah We always have a plan
    is a Contributor to Smogon

    Joined:
    Nov 19, 2012
    Messages:
    705
  14. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
    So FYI, processing this month's logs is going super slowly, and I'm not exactly sure why. I'm currently copying the whole month of logs off of the Smogon sim server and onto my local machine, and I'm going to try to process them locally, which should be a bit faster. I'll keep everyone posted with regards to my progress.
  15. The Immortal

    The Immortal They Don't Want None
    is a member of the Site Staffis a Battle Server Administratoris a Smogon Social Media Contributoris a Programmeris a Forum Moderatoris a Live Chat Contributor Alumnusis a Tiering Contributor Alumnus
    Other Metas Leader

    Joined:
    Sep 27, 2010
    Messages:
    5,910
    I know the data is a lot and so processing it takes very long. However, tier changes occurring after 10 days into the month isn't very effective. I don't know what the solution is but maybe we need to come up with a better process?
  16. erisia

    erisia nyoen wnt an popsicel
    is a Smogon Media Contributoris a Site Staff Alumnusis a Forum Moderator Alumnusis a Community Contributor Alumnusis a Contributor Alumnus

    Joined:
    Nov 29, 2011
    Messages:
    1,938
    What I think might be a good idea is making the code for analysing the stats available to a small group of people (and general principles available to the public) so that we can try and decentralise the stats process a little bit. I sincerely appreciate the constant effort and excellent work of Antar's that allows us to even do this usage based tiering approach in the first place, but I do wonder if it's a bigger task than we should reasonably expect one person to do in their spare time for free. If nothing else, if we had say a member of each tier calculate their relevant stats, they could use their computers to work on each tier in parallel and they could make stats available as soon as possible. The stats page has grown bigger and bigger over the past few years with official OMs, legacy tiers, and even random metas like CC1v1 getting full stats now, so I reckon it's as good a time as any to look into this process further and make it more transparent in general.

    There's also the fact that we have literally no contingency plan if Antar has to take some time off doing stats for personal reasons lol.
    Last edited: Apr 9, 2017
  17. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
    Oh, it's not going to be 10 days. They're STILL transferring and I STILL can't run the stats directly on the server.

    Stats are just not going to happen this month until Zarel can fix whatever's going on with PS that's making disk performance so poor.
  18. Disjunction

    Disjunction Legacy
    is a member of the Site Staffis a Smogon Social Media Contributoris a Forum Moderatoris a Community Contributoris a Tiering Contributoris a Contributor to Smogon
    Moderator

    Joined:
    Mar 22, 2014
    Messages:
    1,403
    Is it at all possible to simply calculate just usage stats for the only three tiers (ou, uu, ru) that are actually reliant on said usage stats? Like, I doubt anyone is going to be upset if we stopped calculating battle spot/gen 1 random battle/cc1v1 or even gen 7 lc/dou/ubers if it meant our resources were going toward keeping our schedule on track for our lower tier development.
  19. Antar

    Antar
    is a Battle Server Administratoris a Programmeris a Super Moderatoris a Community Contributor
    Official Data Miner

    Joined:
    Feb 17, 2010
    Messages:
    3,885
    I don't think you have a sense for how bad the situation is. If I try to process OU logs on PS, those scripts get killed for exhausting system resources. In copying logs to my own machine, I'm maybe 10% complete, after running this for a week.

    Excluding randbats (the only non-usage-based tier that sees a significant enough number of battles to make a difference) might allow me to get the usage stats out a week or two sooner, but as it stands right now, even if I focused just on OU, we wouldn't be seeing usage stats this month.
    Ernesto and Disjunction like this.
  20. Zarel

    Zarel Not a Yuyuko fan
    is a member of the Site Staffis a Battle Server Administratoris a Programmeris a Pokemon Researcheris an Administrator
    Creator of PS

    Joined:
    Aug 16, 2011
    Messages:
    3,589
    tl;dr, y'all battled too much and broke the server

    I'm buying a newer more powerful server, but getting usage stats out of the old one is still going to be a huge problem...
  21. Joe Career

    Joe Career

    Joined:
    Aug 16, 2015
    Messages:
    85
    I know this is a stupid question and not really the place to ask it. But could we, like, let Beedrilite be used in UU already? It's been released for some time now and it would be expected to drop turn this month.
    MagikaripIsOP likes this.
  22. Nightingales

    Nightingales

    Joined:
    Dec 6, 2014
    Messages:
    1,321
    Soon as usage stats come out, it'll probably be dropped.
  23. Machineae

    Machineae

    Joined:
    Aug 26, 2011
    Messages:
    321
    What are the plans for NU and lower tiers come May? At this point in April I'm really hoping theres some sort of plan in place.
  24. Machineae

    Machineae

    Joined:
    Aug 26, 2011
    Messages:
    321
    Anything? Not even a "We've got no idea, the tier is fucked and probably won't come out"?
    avocado likes this.
  25. Zarel

    Zarel Not a Yuyuko fan
    is a member of the Site Staffis a Battle Server Administratoris a Programmeris a Pokemon Researcheris an Administrator
    Creator of PS

    Joined:
    Aug 16, 2011
    Messages:
    3,589
    I don't even know whose job it is to decide such things. I assume unless someone says otherwise, Antar will use the sampled stats and I'll make a tier out of it?

Users Viewing Thread (Users: 0, Guests: 0)