How to prevent more Hart cases

Hart family
Image: katu.com

In my last post, I discussed the tragic case of the six children adopted by Jennifer and Sarah Hart. The entire family perished in the crash of their SUV off a cliff in California on March 26. Multiple system gaps resulted in the failure to rescue these children before their tragic death. Below are some suggestions for filling these gaps so that children do not continue to suffer and die in abusive homes.

  1. Improve Vetting of Potential Adoptive Families. The second set of Hart children were adopted despite the fact that the parents were investigated for abuse of one of the first set of children. Moreover, Minnesota staff told Oregon DHS staff that Texas arranged many adoptions through a particular agency, even when not supported by Minnesota’s child welfare agency. We need to know more about how adoptions could be organized against the wishes of the child welfare agency in the adoptive child’s state, and whether such adoptions continue to occur.
  2. Monitor adoption subsidy recipients. The Harts received almost $2,000 a month in adoption subsidies–money that clearly enabled them to live. All agencies paying adoption subsidies should verify periodically that the children are alive and well and still living in the adoptive home.  Submission of an annual doctor visit report, and/or an annual visit by a social worker could be used for such verification.
  3. Regulate homeschooling. The Harts removed all their children from school after their child abuse case was closed in Minnesota. The Coalition for Responsible Home Education (CRHE), an advocacy group for homeschooled children, recommends barring from homeschooling parents convicted of child abuse, sexual offenses, or other crimes that would disqualify them from employment as a school teacher. CRHE also recommends flagging other at-risk children (such as those with a history of CPS involvement) for additional monitoring and support and requiring an annual assessment of each homeschooled child by a mandatory reporter.
  4. Adopt universal mandatory reporting and educate the public about reporting child maltreatment. The Harts’ neighbors in Washington witnessed clear indicators of maltreatment months before the family went off a cliff. If they had reported their observations earlier, the children might have been saved. However, Minnesota and Oregon reporters were more conscientious, and the children were failed by CPS; hence the next recommendation.
  5. Revamp the investigative process. We have seen that social workers in Minnesota and Oregon had a very clear idea of the dynamics of the Hart household, and how the parents manipulated professionals to shift all blame to the children. Nevertheless they were not able to act on this knowledge to protect the children. There are several reasons that arise from the characteristics of child protective services in most or all states. First, action such as opening an in-home case or removing a child is contingent on the abuse allegation being confirmed. But that is very difficult to do, especially when children deny the abuse, as abused children often do. It is likely that many actual cases of abuse are not substantiated. Research has found little or no difference in future reports of maltreatment of children who were the subject of substantiated or unsubstantiated reports.  We need to move away from substantiation as a trigger for action to protect children.  Another problem is the bizarre distinction between risk and safety which is made in most or all CPS systems. That children could be labeled “safe” even when  at risk, as happened in Oregon, is obviously ridiculous. This false distinction has contributed to the deaths of Adrian Jones in Kansas, Yonatan Aguilar in California, and doubtless hundreds of other children around the country.
  6. Establish stricter criteria for case closure. In Minnesota, one or two cases were opened and the Harts were required to participate in services. We know in retrospect that none of the services worked to change the Harts’ parenting style. It appears that the parents continued their pattern of abuse and food deprivation while the services were being provided. State and local agencies need to revise their criteria for case closure to make sure that they are not leaving the children in the same unsafe situation they were in before the case opened. Agencies must be required to do a rigorous assessment of the children’s safety, which includes checking in with all service providers as well as the children and other professionals who have contact with them.
  7. Encourage doctors to err in the direction of protecting children. The similar response from doctors in Minnesota and Oregon to these malnourished children (saying that they don’t know if there is a reason for concern because lack of historical data) suggests a pattern of reluctance by medical professionals even to express concern that abuse or neglect may be occurring. For a doctor to say that he or she has no concerns because of the lack of information is backwards. Pediatricians need to express concern until given reason to believe otherwise. The American Academy of Pediatrics should issue guidance to this effect, but this needs to be followed up by consequences for doctors who fail to protect their patients.

The Hart children can be seen as victims of a “perfect storm”–adoption by unqualified parents, home schooling, neighbors who failed to report, history not shared between states, and inadequate investigations.  But it only takes one system failure to kill a child or scar one for life. All of these systemic gaps must be addressed, so that all children can have a real childhood and grow to be happy, productive adults.

This post was updated based on new records from Minnesota discussed in a later post on April 27, 2018

A potentially lifesaving algorithm in Allegheny County, PA

broken arm
Image: New York Times

In August 2016, Allegheny County Pennsylvania (which includes Pittsburgh)  became the first US jurisdiction to use a predictive algorithm to screen every call to the child abuse and neglect hotline. In a brilliant article for the New York Times Magazine,  science writer Dan Hurley clearly explains how the tool works and how it changes current practice. Hurley’s account suggests that Allegheny’s experience is a hopeful one for the county and for children nationwide.

Hurley introduces the Allegheny Family Screening Tool, an algorithm developed by leading child welfare researchers in concert with DHS policymakers. To develop the algorithm, the authors analyzed all referrals made to the county child abuse hotline between April 10 and April 2014. For each referral, the authors combined child welfare data with data from the county jail, juvenile probation, public welfare, and behavioral health programs  to develop a model predicting the risk of an adverse outcome for each child named on each referral. (A more technical description is provided by the authors here.) The end product was an algorithm that calculates a risk score between 1 and 20 for each child included in a referral.

The policymakers and developers chose to use the algorithm to supplement, not supplant, the clinical judgment of hotline workers. Only if the score exceeds a certain threshhold does it trigger a mandatory investigation; below that level the risk score it provides another piece of data to help the hotline worker decide whether to assign the case for investigation.

Among the most important takeaways from Hurley’s article are the following:

  1. Before the development of the new algorithm, Allegheny County had experienced a series of tragedies in which children died after maltreatment reports had been made to the hotline but screened out. The problem was not incompetence or poor training. Hotline workers simply cannot within the 30 minutes to one hour allowed for decision making investigate all the historical data on all family members from numerous agencies with which they may have had contact.
  2. Evaluation data shared with the reporter show that implementation of the Allegheny County Screening Tool resulted in more high-risk cases being screened in and more low-risk cases being screened out. Hurley provides a real case example. A teacher reported that a three-year-old child witnessed a man dying of an overdose in her home. Department records showed numerous reports to the hotline dating back to 2008 about this family, including allegations of sexual abuse, domestic violence, parental substance abuse, inadequate food, physical care, hygiene and medical neglect. Nevertheless, the hotline worker was poised to screen out the case as low risk. The tool, however, calculated a risk rating of 19 out of 20, causing an investigator to go out to the home. Eventually, the mother was found to be unable to care for the children due to her continuing drug abuse, and they were placed with family members, where they are doing well.
  3. County officials were astute in awarding the contract to develop a predictive algorithm. Several other jurisdictions have gone with private companies such as Eckerd Connects and its for-profit partner Mindshare, which has a predictive analytics tool called Rapid Safety Feedback (RSF). The details of RSF are closely held by the companies, and the state of Illinois recently terminated its contract  because the owners refused to share its details, even after the algorithm failed to flag some children who later died. The Allegheny Family Screening Tool is owned by the county. Its workings are public and have been published in academic journals. Moreover, its developers, Emily Putnam-Hornstein and Rhema Vaithianathan are acknowledged as the worldwide leaders in their field, with extensive publications and experience in doing similar work.
  4. County officials were also astute in developing and rolling out their model. They held public meetings before implementing the tool, giving advocates a chance to interact with the researchers and policymakers. Choosing to use the tool at the hotline stage rather than a later step such as investigation made it less threatening as the tool is not being used as input on whether to remove the child, simply whether to investigate. In addition, the county commissioned an ethics investigation by two experts before implementing the tool. The reviewers concluded that not only was the tool ethical but that it might be unethical to fail to implement it. The concluded that “It is hard to conceive of an ethical argument against use of the most accurate predictive instrument,”
  5. Many opponents of predictive analytics argue that it institutionalizes racial bias by incorporating data that is itself biased. Supporters have argued that predictive algorithms reduce bias by adding objective algorithms to subjective worker judgments. Preliminary data from Pittsburgh supports the proponents, suggesting that the algorithm has resulted in more equal treatment of black and white families.
  6. Other jurisdictions are already emulating Allegheny County. Douglas County, Colorado has already commissioned Putnam-Hornstein and Vaithianathan to develop an algorithm and California has contracted with them for preliminary statewide work.

Given the Allegheny County algorithm’s promising results, one cannot help wondering whether a similar algorithm should be used at later stages of a case as well. A similar tool could be very useful in aiding investigators in making a decision about the next step in a case. Such a proposal would of course trigger an outcry if used to decide whether to remove a child from home. But like the Allegheny County screening tool, such an algorithm can be used to supplement clinical judgment rather than replace it. Policymakers need not set any level that would trigger a mandatory removal. However, they could set a risk level that requires opening a case, be it out-of-home or in-home. Many children in many states have died when agencies failed to open a case despite high risk scores on existing instruments. Algorithms can also be used to monitor ongoing in-home cases, as Rapid Safety Feedback has demonstrated. Perhaps if and when predictive algorithms are proven to be effective at protecting children they will be integrated into multiple stages and decision points, like the actuarial risk assessments that many states use today.

Identifying the children most at risk of harm by their parents or guardians has been one of the knottiest problems of child welfare. Allegheny County’s experience, as portrayed by Dan Hurley’s excellent article, provides hope that emerging predictive analytics techniques can improve government’s ability to identify these most vulnerable children and keep them safe.