Discord admits AI moderation bug wrongfully banned users over harmless images

Discord has acknowledged that its AI moderation system mistakenly banned users due to a bug that flagged harmless images as inappropriate. The issue persisted since May, with an additional 200 users wrongly banned last weekend before the team identified and resolved the problem. This incident highlights the challenges in balancing automated moderation with the risk of false positives, emphasizing the need for more nuanced AI systems to avoid penalizing innocent users. The fix is crucial for maintaining user trust and ensuring a safe, welcoming community environment.