Doly lets you generate 3D product videos from your iPhone

Date:

Share post:


AniML, the French startup behind a new 3D capture app called Doly, wants to create the PhotoRoom of product videos, sort of. If you’re selling sneakers on an online marketplace or need to create Instagram ads for your direct-to-consumer wares, Doly helps you generate 3D models with your phone and turn them into professional-looking product videos.

While video creation is notoriously hard, generating a 3D model is even harder. That’s why the AniML team has focused on simplifying the experience. They want to turn 3D capture into a mainstream technology, starting by packaging it into an iPhone app.

Here’s how 3D capture with Doly works: The user points their phone camera at the product and physically moves around it to capture it in 3D. Behind the scenes, the app grabs still images and sends them to the cloud. AniML has built a reconstruction pipeline using something called Gaussian splatting to turn these images into a realistic 3D model.

3D models are traditionally created with a collection of points in 3D space, some 2D texture projected on top of these surfaces and lighting effects. Gaussian splatting is an entirely new rendering pipeline that involves estimating a 3D point cloud from a set of 2D images using a pre-trained AI model.

“Our starting point was a technological finding: AI had just arrived in the 3D world. So people at Facebook, but even more at Google, were doing research and wrote a fairly important research paper on something called NeRF,” AniML co-founder and CEO, Rémi Rousseau, told TechCrunch. “It’s a new paradigm in which you try to reconstruct 3D by letting machine learning do the job.”

“You’re no longer working in polygon-based 3D, but now you’re in neural-based 3D,” he added.

Gaussian splatting isn’t exactly the same as NeRF, but it’s a sort of descendant 3D modelling technology, as Rousseau tells it.

So that’s the technical part. AniML then focused on finding a use case that could grab users from day one. E-commerce companies were the obvious choice for a creation tool for 3D models.

What else does the app offer? After capturing a 3D model, Doly users can browse a template library to choose a 3D scene for their object to be integrated into. This can be a simple 3D rotation with a plain background or something more dramatic, in terms of marketing staging, such as the camera slowly approaching the object and switching to different angles.

If a customer likes the result, they have the option to buy the video from the app and download it for use elsewhere.

Image Credits: AniML

Rousseau previously founded two VR companies — including Mimesys, a startup that was acquired by Magic Leap in 2019. His co-founder Pierre Pontevia also has an interesting track record as he sold a company to the 3D tools giant Autodesk; and another to the 3D content development platform, Unity.

So far AniML has raised $2 million, with Adjacent leading the seed round. The startup also participated in AI Grant, the startup accelerator led by Nat Friedman and Daniel Gross. Also investing are Kima Ventures and several angel investors, including Julien Chaumond from Hugging Face; Nicolas Steegman and François Lagunas who previously founded Stupeflix; Alban Denoyel of Sketchfab fame; Bertrand Schmitt; Thibaud Elziere; and Vincent Nallatamby. We’re also told Bpifrance contributed to a portion of this round with a grant.

It will be interesting to see whether big brands, second-hand resellers and other e-commerce professionals embrace 3D rendered videos for upcoming campaigns and online listings. But it’s already nice to see that you might not need a professional video recording studio to create compelling product visuals thanks to artificial intelligence.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

Meta plans to bring generative AI to metaverse games

Meta plans to bring more generative AI tech into games, specifically VR, AR and mixed reality games,...

News outlets are accusing Perplexity of plagiarism and unethical web scraping

In the age of generative AI, when chatbots can provide detailed answers to questions based on content...

Computing and shielding startups join forces to put AI-capable chips in space

Sophisticated spacecraft often run on shockingly outdated computing systems: consider that the Perseverance rover runs on a...

Industry Ventures raises a $900M fund for investing in small, early-stage VCs and their breakout startups

The venture fundraising trend in 2024 is fairly clear by now: Large, established VC firms are continuing...

Indian edtech Unacademy cuts another 250 jobs

Indian edtech giant Unacademy is laying off about 250 employees, the latest in a series of layoffs...

Apple adds support for new languages across lock screen, keyboard and search on iOS 18

Apple unveiled iOS 18 last month at its Worldwide Developer Conference (WWDC). Since then, the company has...

Anthropic looks to fund a new, more comprehensive generation of AI benchmarks

Anthropic is launching a program to fund the development of new types of benchmarks capable of evaluating...

Senators urge Synapse’s owners, partners, and VC backers to restore customers’ access to their money

A group of senators has banded together to urge Synapse’s owners and bank and fintech partners to...