Old album scraping scripts

sandshrewz

POTATO
is a Site Content Manager Alumnusis a Top Artist Alumnusis a Forum Moderator Alumnusis a Top Contributor Alumnusis a Top Smogon Media Contributor Alumnusis a Battle Simulator Moderator Alumnus
chaos / Hugendugen I tried making it using JavaScript / jQuery. Turns out that getting the images spams with a lot of GET request idk why :( even though I'm using regex to get the image src attribute now .-. stuff not included: ignoring images in quote tags because people can quote from other people and mess it up.

Currently it loads 10 pages worth of images and everytime you click the button it loads 10 more. Not sure what can be done about the image stuff without flooding with GET requests sooo :( anyway it's in http://www.smogon.com/album/albumtest might lag your internet a bit. (It brought me to 1.0Mbps when I used it fsr ._. maybe too spammy) !_! <_< >_> ^_^

Edit: did nexus edit those smileys in...
 
Last edited:

Toast++

Nexus is literally the worst.
is a Site Content Manager Alumnusis a Battle Simulator Admin Alumnusis a Programmer Alumnusis a Top Researcher Alumnusis a Top Smogon Media Contributor Alumnusis an Administrator Alumnus
I brought the massive amount of GETs to sandz' attention (~200-500 per load) and I'd be happy to look at it to try to filter that stuff out.

When the new forums were first put up, I could access a json feed for just about anything. Now I get a security error. This would, of course, help a ton with this project and at least a few others. Is it possible to bring that back?



Edit: This was resolved. We're down to like ~30. If there were a services, this could be improved.
 
Last edited:

Shiv

mostly harmless
is a Site Content Manager Alumnusis a Programmer Alumnusis a Forum Moderator Alumnusis a Smogon Discord Contributor Alumnusis a Battle Simulator Moderator Alumnusis a Two-Time Past WCoP Champion
I think Brain wrote them and I added stuff in if I remember right fyi.

Weren't the best written stuff tbh, but it did the job (atleast back then).
 

Users Who Are Viewing This Thread (Users: 1, Guests: 0)

Top