Oregon dropping AI 道具 used in child 乱用 事例/患者s

Child 福利事業 公式の/役人s in Oregon will stop using an algorithm to help decide which families are 調査/捜査するd by social 労働者s, 選ぶing instead for a new 過程 that 公式の/役人s say will make better, more 人種上 equitable 決定/判定勝ち(する)s.

The move comes weeks after an Associated 圧力(をかける) review of a separate algorithmic 道具 in Pennsylvania that had 初めは 奮起させるd Oregon 公式の/役人s to develop their model, and was 設立する to have flagged a disproportionate number of 黒人/ボイコット children for "義務的な" neglect 調査s when it first was in place.

Oregon's Department of Human Services 発表するd to staff 経由で email last month that after "広範囲にわたる 分析" the 機関´s hotline 労働者s would stop using the algorithm at the end of June to 減ずる 不平等s 関心ing which families are 調査/捜査するd for child 乱用 and neglect by child 保護の services.

"We are committed to continuous 質 改良 and 公正,普通株主権," Lacey Andresen, the 機関's 副 director, said in the May 19 email.

Jake Sunderland, a department 広報担当者, said the 存在するing algorithm would "no longer be necessary," since it can´t be used with the 明言する/公表する´s new 審査 過程. He 拒絶する/低下するd to 供給する その上の 詳細(に述べる)s about why Oregon decided to 取って代わる the algorithm and would not (a)手の込んだ/(v)詳述する on any 関係のある 不平等s that 影響(力)d the 政策 change.

---

FILE - Sen. Ron Wyden, D-Ore., speaks during a Senate Finance Committee hearing on Oct. 19, 2021, on Capitol Hill in Washington. Child welfare officials in Oregon will stop using an algorithm to help decide which families are investigated by social workers, opting instead for an entirely new process tha
t officials said will make more racially equitable decisions. Wyden said he had long been concerned about the algorithms used by his state's child welfare system and reached out to the department again following an AP story to ask questions about racial bias - a prevailing concern with the growing use of artificial intelligence tools in child protective services. (Mandel Ngan/Pool Photo via AP, File)

FILE - Sen. Ron Wyden, D-鉱石., speaks during a 上院 財政/金融 委員会 審理,公聴会 on Oct. 19, 2021, on (ワシントンの)連邦議会議事堂 Hill in Washington. Child 福利事業 公式の/役人s in Oregon will stop using an algorithm to help decide which families are 調査/捜査するd by social 労働者s, 選ぶing instead for an 完全に new 過程 that 公式の/役人s said will make more 人種上 equitable 決定/判定勝ち(する)s. Wyden said he had long been 関心d about the algorithms used by his 明言する/公表する's child 福利事業 system and reached out to the department again に引き続いて an AP story to ask questions about racial bias - a 勝つ/広く一帯に広がるing 関心 with the growing use of 人工的な 知能 道具s in child 保護の services. (Mandel Ngan/Pool Photo 経由で AP, とじ込み/提出する)

This story, supported by the Pulitzer 中心 for 危機 報告(する)/憶測ing, is part of an 現在進行中の Associated 圧力(をかける) series, "跡をつけるd," that 調査/捜査するs the 力/強力にする and consequences of 決定/判定勝ち(する)s driven by algorithms on people´s everyday lives.

---

Hotline 労働者s´ 決定/判定勝ち(する)s about 報告(する)/憶測s of child 乱用 and neglect 示す a 批判的な moment in the 調査s 過程, when social 労働者s first decide if families should 直面する 明言する/公表する 介入. The 火刑/賭けるs are high - not …に出席するing to an 主張 could end with a child´s death, but scrutinizing a family´s life could 始める,決める them up for 分離.

From California to Colorado and Pennsylvania, as child 福利事業 機関s use or consider 器具/実施するing algorithms, an AP review identified 関心s about transparency, reliability and racial 不平等s in the use of the 科学(工学)技術, 含むing their 可能性のある to harden bias in the child 福利事業 system.

U.S. Sen. Ron Wyden, an Oregon 民主党員, said he had long been 関心d about the algorithms used by his 明言する/公表する´s child 福利事業 system and reached out to the department again に引き続いて the AP story to ask questions about racial bias - a 勝つ/広く一帯に広がるing 関心 with the growing use of 人工的な 知能 道具s in child 保護の services.

"Making 決定/判定勝ち(する)s about what should happen to children and families is far too important a 仕事 to give untested algorithms," Wyden said in a 声明. "I´m glad the Oregon Department of Human Services is taking the 関心s I raised about racial bias 本気で and is pausing the use of its 審査 道具."

Sunderland said Oregon child 福利事業 公式の/役人s had long been considering changing their 調査s 過程 before making the 告示 last month.

He 追加するd that the 明言する/公表する decided recently that the algorithm would be 完全に 取って代わるd by its new program, called the Structured 決定/判定勝ち(する) Making model, which 提携させるs with many other child 福利事業 裁判権s across the country.

Oregon´s Safety at 審査 道具 was 奮起させるd by the 影響力のある Allegheny Family 審査 道具, which is 指名するd for the 郡 surrounding Pittsburgh, and is 目的(とする)d at 予報するing the 危険 that children 直面する of winding up in foster care or 存在 調査/捜査するd in the 未来. It was first 器具/実施するd in 2018. Social 労働者s 見解(をとる) the 数値/数字による 危険 得点する/非難する/20s the algorithm 生成するs - the higher the number, the greater the 危険 - as they decide if a different social 労働者 should go out to 調査/捜査する the family.

But Oregon 公式の/役人s tweaked their 初めの algorithm to only draw from 内部の child 福利事業 data in calculating a family´s 危険, and tried to deliberately 演説(する)/住所 racial bias in its design with a "fairness 是正."

In 返答 to Carnegie Mellon University 研究員s´ findings that Allegheny 郡´s algorithm 最初 flagged a disproportionate number of 黒人/ボイコット families for "義務的な" child neglect 調査s, 郡 公式の/役人s called the 研究 "hypothetical," and 公式文書,認めるd that social 労働者s can always 無視/無効 the 道具, which was never ーするつもりであるd to be used on its own.

Wyden is a 長,指導者 sponsor of a 法案 that 捜し出すs to 設立する transparency and 国家の oversight of ソフトウェア, algorithms and other 自動化するd systems.

"With the 暮らしs and safety of children and families at 火刑/賭ける, 科学(工学)技術 used by the 明言する/公表する must be equitable -- and I will continue to 監視者," Wyden said.

The second 道具 that Oregon developed - an algorithm to help decide when foster care children can be 再統合するd with their families - remains on hiatus as 研究員s rework the model. Sunderland said the 操縦する was paused months ago 予定 to 不十分な data but that there is "no 期待 that it will be unpaused soon."

In 最近の years while under scrutiny by a 危機 oversight board ordered by the 知事, the 明言する/公表する 機関 - 現在/一般に 準備するing to 雇う its eighth new child 福利事業 director in six years - considered three 付加 algorithms, 含むing 予報する ive models that sought to 査定する/(税金などを)課す a child´s 危険 for death and 厳しい 傷害, whether children should be placed in foster care, and if so, where. Sunderland said the child 福利事業 department never built those 道具s, however.

___

Follow Sally 売春婦 and Garance Burke on Twitter at @_sallyho and @garanceburke.

___

接触する AP´s 全世界の investigative team at Investigative@ap.org or https://www.ap.org/tips/

FILE - Sen. Ron Wyden, D-Ore., speaks during a news conference, on Dec. 15, 2021, on Capitol Hill in Washington. Child welfare officials in Oregon will stop using an algorithm to help decide which families are investigated by social workers, opting instead for an entirely new process that officials said will make more racially equitable decisions. Wyden said he had long been concerned about the algorithms used by his state's child welfare system and reached out to the department again following an AP story to ask questions about racial bias - a prevailing concern with the growing use of artificial intelligence tools in child protective services. (AP Photo/Jacquelyn Martin, File)

FILE - Sen. Ron Wyden, D-鉱石., speaks during a news 会議/協議会, on Dec. 15, 2021, on (ワシントンの)連邦議会議事堂 Hill in Washington. Child 福利事業 公式の/役人s in Oregon will stop using an algorithm to help decide which families are 調査/捜査するd by social 労働者s, 選ぶing instead for an 完全に new 過程 that 公式の/役人s said will make more 人種上 equitable 決定/判定勝ち(する)s. Wyden said he had long been 関心d about the algorithms used by his 明言する/公表する's child 福利事業 system and reached out to the department again に引き続いて an AP story to ask questions about racial bias - a 勝つ/広く一帯に広がるing 関心 with the growing use of 人工的な 知能 道具s in child 保護の services. (AP Photo/Jacquelyn ツバメ, とじ込み/提出する)

Sorry we are not 現在/一般に 受託するing comments on this article.