Ignoring spectators does not ignore people joining and leaving a battle, nor does it ignore voiced users in room tours.
Both are incredibly distracting, though I understand why ignore spectators should not ignore voiced users. It would be cool if there was a way for what the voiced users say...