base rates

At a low base rate even a good classifier mostly flags teens who are fine. Decide what triggers an alert, who reviews it, what the parent sees and what the teen is told.

At a 0.05% base rate, a classifier that is right 99% of the time on safe messages still flags about twenty people who are fine for every one in danger. Build a ladder of responses that each fit their error rate.