x-posting from a different venue since highly relevant.
As the person likely to end up implementing any bot measures, few thoughts. Not speaking as US/SS/whatever, just as someone who has handled building defenses against malicious users and bots for years now.
someone in other thread said:3. Handling Bots in Tours
I think the only way forward for tours, (outside of making all tours be centaur which I find horrific), is to make a significantly stronger anti-cheat function on SmogTours. My ideal for this would be a function that does three things:
- Locks the screen to SmogTours when a game is opened. The only way to move to another tab would be to forfeit the game. This is a pretty common strategy in a lot of testing software.
- Disables plugins. Yes, we will have to get along without showdex. I'm not entirely sure how practically implementable this is, but if it can happen, it would be great.
- Check if instances of the same IP are open on main PS or SmogTours. This, combined with the public registry of bots, could allow us to catch a lot of cheating attempts.
There are still ways around this, as there always are, but this would cover a shit ton of the "easy" ways to cheat. It also doesn't require much more on the part of players and doesn't violate privacy in any new and horrifying ways.
This is completely infeasible, I'm afraid, on both an implementation level and in a macro sense. In the technical sense, the list is long. In the broad scheme of things, Smogon/PS works for competitive play because it’s so easily accessible, and making that more difficult is going to drain the number of new people coming into the community incredibly quickly.
More broadly:
The registry idea has come up a lot, so it bears addressing, I think, to serve as a general bellwether for the ideas against bots. It would be cool, it might help for those who are well intentioned, but it's not going to solve the problem of malice (I include tours/ladder tour cheating in this). Software devs are of a sort that tend to not consider consequences - so you'll have a fair few well intentioned devs who join the registry, but it only takes one who cares a bit less about consequences than about making cool shit, and this is completely screwed. If someone makes a browser extension, for example, suddenly everyone is able to cheat maliciously and we have absolutely no way to block against it. In the more short term sense, there are a fair few malicious users out there with technical expertise, who can and have botted to damage the outcome of tests and tours.
some common methods for the know-it-alls
- IP detection - already sucks for proxies, entirely manual.
- captchas - easily solvable by bots nowadays, can just bypass by browser extension or merging connections.
- behavioral analysis - way too broad and anyone can add some timers to bypass it, see also browser extension. we can catch obvious bots doing obvious things, but that's still ultimately a manual and reactive measure.
- TLS cipher fingerprints - easily gimmicked around.
- screen lock - requires control a web app can't get without a custom browser.
- lockdown browser - see above.
- "well other games do it" - other games also have kernel level anticheat, like Easy Anti-Cheat and Riot Vanguard, and they both suck at their job and everyone hates them.
LIST NOT ALL INCLUSIVE, these are just the solutions that pop up on google so people don't miss the forest for the trees here.
it needs to be stressed: There is very little lasting effect we can make against these sorts of people. We can only ever handle the problem reactively, not proactively. As much as we can do with well-intentioned users, it's not going to fix the structural problems that any malicious user will be able to exploit. Reactive solutions will only take us so far, and will end up burning out the few users who have to moderate it largely by hand and eye. Thusly, we're going to get more out of looking at policy-level changes in how we do things, rather than hoping there's a technical solution to the problem. As the person who would be doing it, and who has done it for a long time now, I'm afraid to say: that solution is not coming.
The bot problem has been blue- and red-teamed into oblivion across the internet. It is a losing game. I can make many clever things, win small battles in the process, and ultimately still lose the war. What it boils down to is a game of cat and mouse, but the mouse is usually one step ahead. I can lay traps and some people will fall into them, but many will avoid them and many more will just start again knowing where the trap is.
In short: