3D Capture
The Gaussian Splatting Plugin enables Lens Studio creators to transform real-world objects into high-quality 3D assets through a video-to-3D conversion process. By capturing a 30-second video, users can reconstruct an object, generating a .PLY
file that can be imported directly into Lens Studio for use in augmented reality (AR) experiences. This tool opens new creative opportunities for Lens creators by allowing them to integrate real-world objects into their lenses.
Getting Started
Launching 3D Capture Plugin
-
Navigate to the GenAI Suite in the top right corner of Lens Studio.
-
In the panel, select
Gaussian Splatting
.
User Interface Overview
-
Create new Asset Toolbar: Contains tools for creating Gaussian Splatting Models:
-
Gallery: Displays all assets you created and their statuses.
-
Search: Allows to search through the created assets.
Creating a 3D Asset with 3D Capture Plugin
Upload your video
-
Pre-record a video: Capture an object you want to reconstruct on a video (30 seconds recommended).
-
Upload a video: Upload the pre-recorded video reference into a plugin.
Object selection
-
Input a text prompt: Upon uploading, specify the object you wish to reconstruct with a text prompt to improve identification accuracy.
-
Confirm the object selection: Review the video preview. A yellow bounding box highlights the object based on your entered text prompt, which you can adjust at this step (press
Regenerate
when ready).
Generation
-
Press
Generate
when you are ready. -
Check upon the Status bar for info.
-
Once the generation is complete and the asset is ready you can preview your asset.
Delete 3D Asset
- You can also delete the asset
Create a Lens
Import to Project
-
Press
Import to Project
button to start creating a Lens with your Gaussian Splatting 3D asset.