Generative disinfo is real — you’re just not the target, warns deepfake tracking nonprofit

Date:

Share post:


Many feared that the 2024 election would be affected, and perhaps decided, by AI-generated disinformation. While there was some to be found, it was far less than anticipated. But don’t let that fool you: the disinfo threat is real — you’re just not the target.

So at least says Oren Etzioni, an AI researcher of long standing, whose nonprofit TrueMedia has its finger on the generated disinformation pulse.

“There is, for lack of a better word, a diversity of deepfakes,” he told TechCrunch in a recent interview. “Each one serves its own purpose, and some we’re more aware of than others. Let me put it this way: for every thing that you actually hear about, there are a hundred that are not targeted at you. Maybe a thousand. It’s really only the very tip of the iceberg that makes it to the mainstream press.”

The fact is that most people, and Americans more than most, tend to think that what they experience is the same as what others experience. That isn’t true for a lot of reasons. But in the case of disinformation campaigns, America is actually a hard target, given a relatively well -nformed populace, readily available factual information, and a press that is trusted at least most of the time (despite all the noise to the contrary).

We tend to think of deepfakes as something like a video of Taylor Swift doing or saying something she wouldn’t. But the really dangerous deepfakes are not the ones of celebrities or politicians, but of situations and people that can’t be so easily identified and counteracted.

“The biggest thing people don’t get is the variety. I saw one today of Iranian planes over Israel,” he noted — something that didn’t happen but can’t easily be disproven by someone not on the ground there. “You don’t see it because you’re not on the Telegram channel, or in certain WhatsApp groups — but millions are.”

TrueMedia offers a free service (via web and API) for identifying images, video, audio, and other items as fake or real. It’s no simple task, and can’t be completely automated, but they are slowly building a foundation of ground truth material that feeds back into the process.

“Our primary mission is detection. The academic benchmarks [for evaluating fake media] have long since been plowed over,” Etzioni explained. “We train on things uploaded by people all over the world; we see what the different vendors say about it, what our models say about it, and we generate a conclusion. As a follow up, we have a forensic team doing a deeper investigation that’s more extensive and slower, not on all the items but a significant fraction, so we have a ground truth. We don’t assign a truth value unless we’re quite sure; we can still be wrong, but we’re substantially better than any other single solution.”

The primary mission is in service of quantifying the problem in three key ways Etzioni outlined:

  1. How much is out there? “We don’t know, there’s no Google for this. You see various indications that it’s pervasive, but it’s extremely difficult, maybe even impossible to measure accurately.”
  2. How many people see it? “This is easier because when Elon Musk shares something, you see, ’10 million people have seen it.’ So the number of eyeballs is easily in the hundreds of millions. I see items every week that have been viewed millions of times.”
  3. How much impact did it have? “This is maybe the most important one. How many voters didn’t go to the polls because of the fake Biden calls? We’re just not set up to measure that. The Slovakian one [a disinfo campaign targeting a presidential candidate there in February] was last minute, and then he lost. That may well have tipped that election.”

All of these are works in progress, some just beginning, he emphasized. But you have to start somewhere.

“Let me make a bold prediction: over the next 4 years we’re going to become much more adept at measuring this,” he said. “Because we have to. Right now we’re just trying to cope.”

As for some of the industry and technological attempts to make generated media more obvious, such as watermarking images and text, they’re harmless and maybe beneficial, but don’t even begin to solve the problem, he said.

“The way I’d put it is, don’t bring a watermark to a gun fight.” These voluntary standards are helpful in collaborative ecosystems where everyone has a reason to use them, but they offer little protection against malicious actors who want to avoid detection.

It all sounds rather dire, and it is, but the most consequential election in recent history just took place without much in the way of AI shenanigans. That is not because generative disinfo isn’t commonplace, but because its purveyors didn’t feel it necessary to take part. Whether that scares you more or less than the alternative is quite up to you.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

AI pioneer Francois Chollet leaves Google

Francois Chollet, a leading figure in the AI world, is leaving Google after close to a decade....

Amazon’s telehealth platform adds low-cost plans for hair loss, skin care, and more

Amazon One Medical is expanding its telehealth services with the launch of upfront and low-cost treatment plans...

Sales tax automation startup Kintsugi doubled its valuation this year

A 2018 Supreme Court ruling eliminated the requirement that an e-commerce retailer needed a physical location in...

Snapchat will soon be able to alert parents when their teen leaves or arrives at certain locations

Snapchat is bringing enhanced location sharing to Family Center, its parental controls hub, the company announced Thursday. Users...

PayPal once again lets you pool money from others to pay for things together

PayPal is launching a few features that let users in groups pool money with friends or family,...

US confirms China-backed hackers breached telecom providers to steal wiretap data

The U.S. government has confirmed that hackers with links to China breached multiple U.S. telecommunication service providers...

Tessl raises $125M at at $500M+ valuation to build AI that writes and maintains code

Many startups and larger tech companies have taken a crack at building artificial intelligence to code software....

Atlas.co wants its web-based mapping tool to be the Figma of geospatial data

Startup inspiration can strike anywhere. But for Atlas.co*, a freemium browser-based, real-time mapping tool that’s being built...