ThroughLine builds tool linking extremist ChatGPT users to support
ThroughLine, a New Zealand startup, is building a tool to spot ChatGPT users showing extremist tendencies and connect them with real support: think deradicalization help and mental health services.
It's their way of tackling concerns about AI being misused for spreading harmful ideas, expanding on their past work that linked people to crisis support for things like self-harm.
ThroughLine's chatbot offers mental health referrals
The tool would likely use a chatbot trained to respond to people showing signs of extremism, plus offer referrals to real-world mental health services when needed.
ThroughLine has a relationship with OpenAI (the folks behind ChatGPT) and getting advice from the Christchurch Call, an initiative born after the 2019 attacks in New Zealand.
founder Elliot Taylor says they want expert input instead of just relying on standard AI data.
The company maintains a network of helplines worldwide; now they're hoping this new step can make online spaces safer for everyone.