This generative AI startup is strapping cameras to people’s backs

Date:

Share post:


A startup is training an AI system that it claims will enable creators to generate cinematic worlds, with complete control over the scenery, characters, lighting, and motion. How? By having humans strap cameras to their backs and hike around the world.

Odyssey, founded by self-driving pioneers Oliver Cameron and Jeff Hawke (Cameron was previously the VP of product at Cruise), says it’s created an “advanced camera capture system” that can collect data just about anywhere a person can reach. Weighing about 25 pounds, the system packs six cameras, two lidar sensors, and an inertial measurement unit.

Bearing a resemblance to Google’s Street View Trekker, the system can capture its surroundings in “3.5K resolution” and 360 degrees, with “physics-accurate” depth information metadata attached.

So what’s the point? Well, Odyssey says it’s taking data from the system and feeding it through algorithms to “capture the fine details that make up our world.” Essentially, the company’s generating digital reconstructions of real-world scenes a la Meta’s Hyperscape project — scenes with forests, caves, trails, beaches, glaciers, parks, buildings, and so on.

One of Odyssey’s recreated scenes. Image Credits:Odyssey

Now, it’s not totally clear how these reconstructions will translate to better generative tools for creatives. Cameron and Hawke have previously said that Odyssey has developed several generative AI models that create layers of visual detail, including object geometry, lighting, and motion, and then combine these into a single virtual “world” to create desired scenes.

Even the best “world models” today have limitations, however — and Odyssey doesn’t claim to have solved all these. Nevertheless, it’s securing cash to forge ahead.

Odyssey today announced that it raised $18 million in a Series A funding round led by EQT Ventures with participation from GV and Air Street Capital. The new money, which brings the company’s total raised to $27 million, will be put toward scaling up Odyssey’s data collection operations in California.

Odyssey plans to expand its data collection to other states and countries in the future — with privacy protections in place, one would hope. (Google’s Street View team, for one, has found itself in the crosshairs of regulators for capturing images of public places that violated bystanders’ privacy.)

“We think it will be impossible for generative models to generate Hollywood-grade worlds that feel alive without training on a vast volume of rich, multimodal real-world 3D data,” the company wrote in a post on its blog. “We believe an advanced generative world-building model will unlock a better way to create film, games, and more.”



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

PayPal once again lets you pool money from others to pay for things together

PayPal is launching a few features that let users in groups pool money with friends or family,...

US confirms China-backed hackers breached telecom providers to steal wiretap data

The U.S. government has confirmed that hackers with links to China breached multiple U.S. telecommunication service providers...

Tessl raises $125M at at $500M+ valuation to build AI that writes and maintains code

Many startups and larger tech companies have taken a crack at building artificial intelligence to code software....

Atlas.co wants its web-based mapping tool to be the Figma of geospatial data

Startup inspiration can strike anywhere. But for Atlas.co*, a freemium browser-based, real-time mapping tool that’s being built...

ePlane looks to ride the Indian government’s interest in air taxis with new $14M round

Soaring private vehicle ownership and declining use of public and non-motorized transport have created mounting traffic congestion...

Apple faces UK ‘iCloud monopoly’ compensation claim worth $3.8 billion

U.K. consumer rights group ‘Which?’ is filing a legal claim against Apple under competition law on behalf...

What’s DOGE? Musk’s new political appointment under Trump is a crypto joke

President-elect Donald Trump announced on Tuesday that one of his top donors, Elon Musk, will co-lead the...

Apple’s AI-powered Final Cut Pro 11 is now available

It’s been 13 years since Apple released Final Cut X. That’s just over half of the video-editing...