Thursday, January 2, 2025

CDAO Sponsors Crowdsourced AI Assurance Pilot in the Context of Military Medicine

Left
Release
View Online
IMMEDIATE RELEASE
CDAO Sponsors Crowdsourced AI Assurance Pilot in the Context of Military Medicine
Jan. 2, 2025

The Chief Digital and Artificial Intelligence Office (CDAO) has successfully concluded a Crowdsourced AI Red-Teaming (CAIRT) Assurance Program pilot focused on the use of Large-Language Model (LLM) chatbots in the context of military medicine. The CAIRT program supports the Department of Defense (DoD) in generating grassroots, crowdsourced approaches to AI Assurance and AI Risk Mitigation. Through crowdsourcing, projects are able to elicit a large volume of data and involve a wide variety of stakeholders.

This CAIRT LLM pilot was conducted by Humane Intelligence, a tech company building a community of practice around algorithmic evaluations, in collaboration with the Defense Health Agency (DHA) and the Program Executive Office, Defense Healthcare Management Systems (PEO DHMS). Through red-teaming methodology―using adversarial techniques to internally test system robustness―Humane Intelligence was able to effectively detect specific system vulnerabilities. Additionally, red-teaming attracts participants who want to engage with new technologies and, as possible future beneficiaries, gain the opportunity to contribute to improving the systems. Previously, in the spring of 2024, the CDAO held a valuable red-teaming CAIRT exercise utilizing a financial bounty.

In the latest pilot program, Humane Intelligence utilized crowdsourced red-teaming for two prospective use cases in the context of military medicine:  clinical note summarization and a medical advisory chatbot. Over 200 participants, including clinical providers and healthcare analysts from DHA, the Uniformed Services University of the Health Sciences, and the Services, participated in the exercise, which compared three popular LLMs. The exercise uncovered over 800 findings of potential vulnerabilities and biases related to employing these capabilities in these prospective use cases. This exercise will result in repeatable and scalable output via the development of benchmark datasets, which can be used to evaluate future vendors and tools for alignment with performance expectations. Furthermore, these findings will play a crucial role in shaping DoD policies and best practices for responsible use of Generative AI (GenAI), ultimately improving military medical care. If, when fielded, these prospective use cases comprise covered AI defined in OMB M-24-10, they will adhere to all required risk management practices.

"Since applying GenAI for such purposes within the DoD is in earlier stages of piloting and experimentation, this program acts as an essential pathfinder for generating a mass of testing data, surfacing areas for consideration, and validating mitigation options that will shape future research, development, and assurance of GenAI systems that may be deployed in the future," remarked CDAO's lead for this initiative, Dr. Matthew Johnson.

As the recent pilot and others have revealed, continued testing of LLMs and AI systems through the CAIRT Assurance Program will be critical to accelerating the CDAO's AI Rapid Capabilities Cell, improving GenAI mission effectiveness, and contributing to justified confidence across DoD use cases.

About the CDAO

The CDAO became operational in June 2022 and is dedicated to integrating and optimizing AI capabilities across the DoD. The office is responsible for accelerating the DoD's adoption of data, analytics, and AI, enabling the Department's digital infrastructure and policy adoption to deliver scalable AI-driven solutions for enterprise and joint use cases, safeguarding the nation against current and emerging threats.

For more information about the CDAO, please visit our website at ai.mil. You can also connect with the CDAO on LinkedIn (@ DoD Chief Digital and Artificial Intelligence Office) and X, formally known as Twitter (@dodcdao). Additional updates and news can be found on the CDAO Unit Page on DVIDS.

Right

Press Advisories   Releases   Transcripts

Speeches   Publications   Contracts

 

ABOUT   NEWS   HELP CENTER   PRESS PRODUCTS
Facebook   Twitter   Instagram   Youtube

Unsubscribe | Contact Us


This email was sent to stevenmagallanes520.nims@blogger.com using GovDelivery Communications Cloud on behalf of: U.S. Department of Defense
1400 Defense Pentagon Washington, DC 20301-1400

DOD Featured Photos

Left
Photos
Float Flowers
Army Brig. Gen. Antoinette R. Gant places a rose on the Army Rose Parade float in Pasadena, Calif., ... Photo Details >
Through the Window
The Virginia-class attack submarine USS Texas prepares to conduct sea trials after departing Portsmo... Photo Details >

 

Right

 

ABOUT   NEWS   HELP CENTER   PRESS PRODUCTS
Facebook   Twitter   Instagram   Youtube

Unsubscribe | Contact Us


This email was sent to stevenmagallanes520.nims@blogger.com using GovDelivery Communications Cloud on behalf of: U.S. Department of Defense
1400 Defense Pentagon Washington, DC 20301-1400

DOD Featured Photos

Left
Photos
Marching On
A Coast Guard company marches at U.S. Coast Guard Training Center Cape May, N.J., Dec. 10, 2024. As ... Photo Details >

 

Right

 

ABOUT   NEWS   HELP CENTER   PRESS PRODUCTS
Facebook   Twitter   Instagram   Youtube

Unsubscribe | Contact Us


This email was sent to stevenmagallanes520.nims@blogger.com using GovDelivery Communications Cloud on behalf of: U.S. Department of Defense
1400 Defense Pentagon Washington, DC 20301-1400

Materials from the Open Ocean December 2024 Annual Meeting Now Available

Having trouble viewing this email? View it as a Web page.

OO TIG post-mtg header

Materials from the Open Ocean December 2024 Annual Meeting Now Available

The Open Ocean Trustee Implementation Group held our annual meeting on December 11, 2024, where we provided updates to the public on our restoration efforts. The presentation included an update on our recent restoration planning, including Draft Restoration Plan 4 which was released in October, as well as the work underway on our first joint restoration plan with the Louisiana Trustees to restore the Chandeleur Islands.

We also provided updates on the progress of numerous ongoing restoration projects and monitoring and adaptive management activities. We concluded the webinar by taking questions from attendees.

Learn more and view the materials at the Open Ocean Trustee Implementation Group's latest Gulf Spill Restoration news update >>


This email was sent to stevenmagallanes520.nims@blogger.com using GovDelivery Communications Cloud, on behalf of: NOAA Fisheries · 1315 East-West Highway · Silver Spring, MD · 20910 GovDelivery logo

RE: 2nd attempt !

Hi

I knew the NEW Guardian Tactical Frame would be a hit, but I never would have imagined we'd sell out over 95% of stock yesterday! This means if you want one or even think you might- better get it today before someone else beats you to it….

Get one now ( before they sell out) for $59 less than everyone else had to pay. Limit 3 per customer for this special offer-no exceptions...

Take Care 
Joe
 
P.S: Remember…I'm also going to upgrade (YOURS FREE) your unit with our newest Bluetooth/Key Card locking system for faster access and a jaw dropping presentation that will leave your family and close friends speechless. But you must hurry to be among the lucky few to get in on this special offer. CLICK HERE

 



You received this email from Tactical Traps. If you would like to unsubscribe, click here.

U.S. Attorneys News News Update

U.S. Department of Justice

Offices of the United States Attorneys

 
You are subscribed to U.S. Attorneys News news updates. This information has recently been updated, and is now available.

01/02/2025 07:00 AM EST

A look back at the General Crimes Unit's notable achievements in 2024.
 

Asset Forfeiture News Update

U.S. Department of Justice

Offices of the United States Attorneys

 
You are subscribed to Asset Forfeiture news updates. This information has recently been updated, and is now available.

01/02/2025 07:00 AM EST

The USAO for the Northern District of Ohio forfeited $7,701,470 in criminal assets for fiscal year 2024. The total forfeited assets were from investigations throughout the District's 40 northern counties in the state of Ohio. 
 

USAO - Ohio, Northern News Update

U.S. Department of Justice

Offices of the United States Attorneys

 
You are subscribed to USAO - Ohio, Northern news updates. This information has recently been updated, and is now available.

01/02/2025 07:00 AM EST

A look back at the General Crimes Unit's notable achievements in 2024.
 

New Year, New Gear πŸ’ͺ

Bags to help you crush your goals ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏  ͏ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­

Page List

Blog Archive

Search This Blog

This is your final chance.

You won't miss this opportunity to enter Trump's Contest, right?  ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ...