Programming Smogon / RMT Team Dump

#1
Hey guys,

I admit it, I'm one of the guys who always went to the forums for teams. The forums provide a great resource for someone like me, if you just want to hop on Showdown and play some fast games!

Lately however, I was getting kind of bored, trying to search for teams, as it seemed to be getting more difficult. Because of this problem, I thought about making my life a little bit easier and try to think of an automatic solution.

This is what I'm presenting you today!


So what am I talking about?

I created a program which goes through the "Smogon Metagames" and "Rate My Team" forums and all their subforums. In each thread of these subforums the program analyzes each post and if it finds a team hidden in a spoiler or in a pokepast.es link, it saves the team. For each team some metadata like likes and time of posts will be saved so each team can be ranked by the following formula:
this.Likes *
(1.0 /
(
(DateTime.Now.Subtract(this.PostDate).TotalMinutes / 60.0 / 24.0 / 365.0) * koeffScale + 1
)
);
Where koeffScale = 5, so that newer teams get way more attention

With this, I got around 12000 teams from Smogon and exported them into an importable Showdown format.


Show it!







Is it perfect?
No, of course not! There are many mistakes and problems, but most of the teams will work. If you encounter a problem, let me know and I will try and have a look at it!


Advice

Since there are so many teams, the filesize of the dump is 12 MB. Because of that, I advice you to download the dump and then import it into an incognito window of your browser, if you really want to have a look at it, since it otherwise will probably just crash your browser.


Enough of it, where do I get it?

The source: https://github.com/FullLifeGames/Smogon-Team-Crawler

Download the paste: https://drive.google.com/uc?authuser=0&id=1rjUVdzZWw8dqBi3Yt7CLLfyVe1tSE7Sc&export=download
The paste: https://drive.google.com/open?id=1rjUVdzZWw8dqBi3Yt7CLLfyVe1tSE7Sc


What if I just want a dump for a single tier?

Don't worry, I created a paste for each tier and you can access it from here:
https://drive.google.com/open?id=18gIrfuAXcxrEVm3FKj72r4BKG8l5DcRc
Or look here at the visualization: https://fulllifegames.com/Tools/SmogonDump/

 
Last edited:
#7
Yeah, so I enhanced some things and hit the limit:



https://github.com/FullLifeGames/Smogon-Team-Crawler/commit/56fd79270bae4b47fc14294f83af418e741c7dc6

What I did:

- enhanced team detection
- basically add gen 1 and gen 2 support
- fixed some bugs with the new design
- added pastebin / hastebin support
- extend on multiple team pastes

This brought us from ~7000 teams to 12055 teams, which is a big improvement.
I'm glad it now works again and I'm amazed by the better results to be honest.
(Downloadlinks in the main post are updated)
 
Last edited:
#8
#10
What could be great is a way to search for teams given 6 pokemons and a tier, to find the opponent's team directly from preview if it was ever posted somewhere.

Edit: Filtering by date would also be useful to find teams built with the latest bans of the tiers.

This is great !
 
Last edited:
#12
Very cool stuff, I'm a newb on this but would it be possible in your Smogondump's tools the ability to ctrl+f some 'mons redirecting at their sprites? For Example I typed Hippowdon, and while there are some teams with it on the Gen5ou section it doesn't give me a correlation, since there is only the sprite, I believe it could be very useful if you could type more than one 'mon in order (ex: Tyranitar Garchomp Skarmory Jellicent etc) on your search bar and find the team, kinda like you can do it on Showdown, especially on something like Usum who has too many teams.
Still, thank you for your hard work, I can't imagine how tiring this has to be, kudos to you, really.
 
#13
Very cool stuff, I'm a newb on this but would it be possible in your Smogondump's tools the ability to ctrl+f some 'mons redirecting at their sprites? For Example I typed Hippowdon, and while there are some teams with it on the Gen5ou section it doesn't give me a correlation, since there is only the sprite, I believe it could be very useful if you could type more than one 'mon in order (ex: Tyranitar Garchomp Skarmory Jellicent etc) on your search bar and find the team, kinda like you can do it on Showdown, especially on something like Usum who has too many teams.
Still, thank you for your hard work, I can't imagine how tiring this has to be, kudos to you, really.
Try the search again => I fixed the search bar I think.
Type in "Tyranitar, Garchomp, Skarmory, Jellicent" and press Enter.
 
#15
I wanted to talk about the "Statistics" tab which I added to the website!
Basically it shows how many times a Pokémon has been used and how many times a move has been used (and their relative percentage).
Here a little example how it looks:



(Also I worked a little bit on the sprites, so better representation of the Pokémon here)
 

Users Who Are Viewing This Thread (Users: 1, Guests: 0)

Top