To The Moon

Nvidia launches new tool to keep AI agents from going rogue

$NVIDIA(NVDA)$  

Chris Isidore

UPDATED 14 MIN AGO

Nvidia CEO Jensen Huang speaks during the ...

Chipmaker Nvidia said Monday it is introducing a new software platform to address concerns about artificial intelligence agents that have “gone rogue” and operated outside human control.

“Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform,” Nvidia CEO Jensen Huang wrote in a post on X Monday.

Nvidia (NVDA) says its technology will enable companies to monitor every action undertaken by an AI agent, as well as enforce policies.

RELATED ARTICLE

ROGUE OPENAI AGENTS TARGETED US GOVERNMENT WEBSITES, INCLUDING THE COMMERCE DEPARTMENT AND SECURITIES AND EXCHANGE COMMISSION. THOMAS FULLER/SOPA IMAGES/LIGHTROCKET/GETTY IMAGES

Rogue OpenAI agents targeted three separate US government websites

3 MIN READ

“AI’s extraordinary potential for society will only be realized if we solve AI safety,” Huang added in a statement. “As we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI safety.”

The announcement comes in the wake of a series of incidents in which AI systems hacked into both corporate and government systems without being told to do so. Top AI executives, like OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei, have repeatedly called for international regulations to constrain the systems, and some researchers have warned that AI may even present a threat to human life.

But Huang has dismissed those concerns, calling any existential threat overblown, and said last week that any regulations should promote the growth of the AI industry, not hinder it.

“If they believe their company is out of control, then get the company under control,” Huang told CNN’s Anderson Cooper Friday.

WATCH CNN

CNN

Trump dismisses concerns about AI ‘going rogue’

Nvidia also announced Monday that it will buy back an additional $150 billion worth of its shares, on top of an $85 billion share repurchase it already had underway. The company said this would be the largest single corporate share repurchase ever. Apple previously held the record with a $110 billion repurchase announced in 2024.

Companies typically announce repurchases to support their stock price when it is under pressure. Nvidia has a market cap of $5.4 trillion, making it the most valuable company on the planet.

“Our cash generation gives us the capacity to invest in the technologies that advance this transformation and return capital to shareholders,” said the company in a statement. “This authorization reflects our confidence in the long-term opportunity ahead.”

Shares of Nvidia were only slightly higher in pre-market trading on the news.

This is a developing story and will be updated.

Up next

Rogue OpenAI agents targeted three separate US government websites

3 MIN READ

Parents confront a new fear: Could AI end humanity before their kids grow up?

9 MIN READ

AI agents promise to do everything for you. There may be a big wrinkle in that plan

5 MIN READ

Europe’s next-gen fighter jet is dead. What does that mean for the continent’s security ambitions?

6 MIN READ

Why the AI boom makes inflation harder to tame

6 MIN READ

The best indoor home security cameras in 2026, tried and tested

15 MIN READ

Most popular

Trump stirs new storm by posing as strongman in taxpayer-funded video

White House airs another government-funded ad, this time with Trump warning of ‘final battle’

SpaceX’s massive Starship is finally going to orbit — and the effects could be seismic

I started fact-checking Trump 10 years ago. Here are 15 things I’ve learned

He executed death row prisoners. Then they came back to haunt him

AEW wrestling star Benjamin Satterley, known as Pac, dies at 40

Blanche says ‘one-sided news’ is a national security issue worthy of barring press

South Korea demands apology from Ukraine over disclosure of North Korean POW transfer

UK police arrest five men on suspicion of terror offenses near air base used by US forces

How to make – and keep – friends as a grownup, according to science

Sign in

Live TV

Listen

Watch

World

US Politics

Business

Markets

Health

Entertainment

Tech

Style

Travel

Sports

Science

Climate

Weather

Ukraine-Russia War

Israel-Hamas War

Features

Watch

Listen

Games

About CNN

Business

FOLLOW CNN

DOWNLOAD THE CNN APP

Most stock quote data provided by BATS. US market indices are shown in real time, except for the S&P 500 which is refreshed every two minutes. All times are ET. Factset: FactSet Research Systems Inc. All rights reserved. Chicago Mercantile: Certain market data is the property of Chicago Mercantile Exchange Inc. and its licensors. All rights reserved. Dow Jones: The Dow Jones branded indices are proprietary to and are calculated, distributed and marketed by DJI Opco, a subsidiary of S&P Dow Jones Indices LLC and have been licensed for use to S&P Opco, LLC and CNN. Standard & Poor’s and S&P are registered trademarks of Standard & Poor’s Financial Services LLC and Dow Jones is a registered trademark of Dow Jones Trademark Holdings LLC. All content of the Dow Jones branded indices Copyright S&P Dow Jones Indices LLC and/or its affiliates. Fair value provided by IndexArb.com. Market holidays and trading hours provided by Copp Clark Limited.

Terms of Use

Privacy Policy

Manage Cookies

Ad Choices

Advertise With Us

Accessibility & CC

About

Newsletters

Transcripts

Sitemap

© 2026 Cable News Network. A Warner Bros. Discovery Company. All Rights Reserved.

CNN Sans ™ & © 2016 Cable News Network.