Since 2016, social workers in one Pennsylvania county have relied on an algorithm to help determine which child welfare calls require further investigation. The Department of Justice is now banning the controversial Family Screening over concerns that using the algorithm may violate the Americans with Disabilities Act, which allegedly discriminates against family members with disabilities. The tool is reportedly being scrutinized.
Three anonymous sources breached non-disclosure agreements with the Department of Justice, civil rights attorneys have filed complaints against the AP since last fall, and prejudice purportedly built into Allegheny County’s family screening tool. I have identified that there is growing concern about While the full extent of the Justice Department’s alleged scrutiny is currently unclear, the Office for Civil Rights is investigating how the use of data-driven tools reinforces historical and systemic biases against people with disabilities. It sounds like you want to learn more about the possibilities.
The county has identified its predictive risk modeling tools as a priority resource for reducing human error for social workers who benefit from rapid algorithmic analysis of “hundreds of data elements for each individual involved in a child abuse allegation.” I’m explaining. This includes “data points related to disability in children, parents, and other members of local households,” Allegheny County told her AP. Contributes to an overall risk score that helps you decide if you should evict.
The county told The Associated Press that social workers can override the tool’s recommendations and that the algorithm has been updated “several times” to remove disability-related data points, but critics I am concerned that screening tools are still automating discrimination. This is of particular concern because Pennsylvania’s algorithms have impacted similar tools used in California and Colorado. AP reports. Oregon has stopped using family screening tools over similar concerns that algorithms may be exacerbating racial bias in child welfare data.
The Justice Department has not yet commented on the alleged interest in the tool, but the AP reports that the Justice Department’s scrutiny could turn moral arguments against the use of child welfare algorithms into legal arguments. Did.
Traci LaLiberte, a child welfare and disability expert at the University of Minnesota, told the AP that it was unusual for the Department of Justice to get involved in child welfare issues. It would have to rise to a very serious level of concern to participate.”
Ars couldn’t reach the developers of the algorithm or the Allegheny County Department of Social Services for comment, but county spokesman Mark Bertolet told AP that the agency has an interest in the screening tool. I said I wasn’t aware of that.
Child Abuse Prediction Issues
Allegheny County said on its website that the family screening tool was developed in 2016 to “enhance the child welfare telephone screening decision-making process with the sole goal of improving child safety.” said to have been developed in That year, the county reported that before using the algorithm, child protective services investigated 48% of the lowest-risk cases due to human error, while missing 27% of the highest-risk cases. Did. A 2016 external ethical analysis supported the county’s use of the algorithm as “necessarily imperfect,” but a relatively accurate and transparent approach to assessing risk rather than relying solely on clinical judgment. It is a method.
“By using technology to collect and evaluate all relevant information available, we can improve the basis for these critical decisions and reduce variability in staff decision-making,” the county said on its website. I thought, ”he promised to further improve the model. A tool analysis was performed.
The county told AP that a risk score alone would not initiate an investigation, but the county’s website states, “If your score is at the highest level and meets the ‘mandatory screening-in’ threshold, We need to look into the phone allegations.” Critics have suggested that families with disabilities are more likely to be studied, as disability-related data points contribute to its score.
In the same year that the Family Screening Tool was introduced, the Christopher & Dana Reeve Foundation and the National Council on Disabilities launched a tool to help parents with disabilities know their rights when fighting child welfare issues in court. Released the kit.
“Courts have determined that many of the 4.1 million parents with disabilities in the United States are not good parents simply because they have a disability,” the group wrote in its introduction to the toolkit. “In fact, as of 2016, 35 states still state that if you have a disability, you can lose your right to parent without hurting or neglecting your child.”
Allegheny County told the Associated Press that it is not surprising that parents with disabilities need additional support and services. However, neither the county’s ethics analysis nor the FAQs directly discuss how the tool could hurt these families.
Ars couldn’t reach LaLiberte for additional comment, but she told the AP that her research revealed that parents with disabilities are already covered by the child welfare system. She says that incorporating disability-related data points into algorithms instructs social workers to consider “traits that people cannot change,” rather than assessing problem behavior exclusively. He suggested that it was seemingly inappropriate.
