Among gamers playing the top 15 games, roughly 70% have experienced online abuse. Project Detox is empowering the Gaming Safety team at Microsoft so that they can provide a safe environment to their customers worldwide. We are implementing an automated testing framework for their toxicity classifiers. After measuring model performances against each other and on different kinds of data, we have generated beautiful and intuitive reports which would enable the stakeholders to make data-driven decisions. All of this has been packaged into pipelines which would automate the process and eliminate manual work.