AI is listening in on gamer chat for toxic and abusive language

Artificial intelligence is being used to detect harassment in verbal communication in games and VR platforms, but such AI faces the challenge of keeping up with evolving extreme forms of speech.

To Jeremy Hsu

AI participates in game chat and monitors hate speech. Some of the world’s most popular games now use artificial intelligence to detect verbal harassment and hate speech in some of the world’s most popular games.

Called ToxMod, the service uses multiple AIs to transcribe and analyze verbal conversations between gamers and flag potential violations of community rules for the attention of human moderators. Developed by Massachusetts-based Modulate, ToxMod is designed for companies that operate games and…