Export Gaussian Splats from Polycam to Unreal Engine

Learn how to export Gaussian splats from Polycam and import them into Unreal Engine for real-time rendering in interactive scenes, games, and cinematic projects.

Requirements

Download Gaussian Splats from Polycam 0:28

1Choose Your Splat

Browse Polycam to find one or more Gaussian splats that you'd like to use in your Unreal Engine project. Once you've found the perfect scan, proceed to download the necessary files.

2Download PLY Format

Download the splat in PLY format from Polycam. This file contains the Gaussian splat data that will be used for rendering in Unreal Engine. Save this file to an easily accessible location on your computer.

3Download GLTF Format

Also download the GLTF version of the same scan. You'll need this later to create collision geometry, as Gaussian splats themselves don't have physical collision properties.

Process Splats with Super Splat Editor 0:41

Before importing your Gaussian splats into Unreal Engine, you'll need to process them through Super Splat Editor. This free web-based tool allows you to clean up and prepare your splats for optimal performance in Unreal.

1Load Your Splat

Navigate to Super Splat Editor in your web browser and upload the PLY file you downloaded from Polycam. The editor will load and display your Gaussian splat.

2Select Desired Geometry

Use the circle selection tool or box select tool to highlight the parts of the splat you want to keep. These selection tools make it easy to isolate specific areas of your scan.

3Invert and Remove

After selecting the geometry you want to keep, invert the selection to highlight everything you don't want. Then delete the inverted selection to remove unwanted parts of the scan. This cleaning process improves performance and visual quality in Unreal Engine.

4Export Processed Splat

Go to File → Export Splat and keep all default settings as they are. This ensures your splat is properly formatted for Unreal Engine. The exported file will be ready for import into your project.

Set Up Unreal Engine 1:37

1Install Epic Games Launcher

If you haven't already, download and install the Epic Games Launcher. This is the official platform for downloading and managing Unreal Engine installations.

2Download Unreal Engine 5.3.2

From the Epic Games Launcher, navigate to the Unreal Engine tab and select version 5.3.2 for download. This specific version is required for proper Luma AI plugin compatibility.

3Add Luma AI Plugin

Visit fab.com and search for the Luma AI plugin. Click "Add to Library" to make it available for installation. This free plugin handles all the technical aspects of rendering Gaussian splats in Unreal Engine.

4Install Plugin to Project

Open your fab library, find the Luma AI plugin, and install it to Unreal Engine 5.3.2. The plugin will be available when you create or open projects in this engine version.

Create Your Unreal Project 2:10

1Launch New Project

Open Unreal Engine 5.3.2 and create a new project. For this tutorial, you can use the Third Person template, which provides a ready-made scene with a character controller that's perfect for testing interactive Gaussian splats.

2Enable Luma AI Plugin

When Unreal Engine loads, a popup will notify you that new plugins are available. Search for "Luma AI" and ensure the plugin has a checkmark next to it indicating it's enabled.

If this is your first time installing the plugin, you'll need to restart the Unreal Editor for the changes to take effect. After restarting, confirm the plugin is properly installed by searching for it again.

Import Gaussian Splat 2:37

1Clean Up Template Scene

Delete a few objects from the template scene to make room for your Gaussian splat. This creates a cleaner workspace and helps you focus on your imported content.

2Drag and Drop PLY File

Drag and drop the processed PLY file from Super Splat Editor directly into the Content Browser in Unreal Engine. The Luma AI plugin will automatically generate the necessary blueprints to render your Gaussian splat.

3Add Splat to Level

Locate the generated blueprint in your Content Browser and drag it into your level viewport. Your Gaussian splat will now appear in the scene, ready for positioning and scaling.

Add Collision Geometry 3:21

If you press play at this point, you'll notice your character actor falls right through the Gaussian splat. This is because Gaussian splats are not meshes and don't have collision properties. However, we can add collisions using a clever workaround with the GLTF file.

1Import GLTF Mesh

Drag and drop the GLTF version of your Gaussian splat into the Content Browser. This creates a static mesh object that we can use for collision detection.

2Configure Collision Settings

Double-click the GLTF mesh object to open the mesh editor. In the details panel, search for "collision" in the search bar.

3Set Collision Complexity

Under "Collision Complexity," change the setting to "Use Complex Collision as Simple." This tells Unreal to use the detailed mesh geometry for collision detection instead of simplified collision boxes.

4Position and Align Mesh

Drag the GLTF mesh into your level and use the Move, Rotate, and Scale tools to align it with your Gaussian splat as accurately as possible. This may require some trial and error to get the alignment perfect.

5Hide Static Mesh in Game

Select the GLTF mesh in the viewport, then in the Details panel search for "game." Under the Rendering section, check the box for "Actor Hidden in Game." This ensures the mesh provides collision but remains invisible during gameplay.

Create Cinematic Sequences 5:01

Beyond interactive scenes and games, Unreal Engine's powerful cinematic tools allow you to create stunning camera animations and rendered sequences with your Gaussian splats.

1Add Cine Camera Actor

Place a Cine Camera Actor in your level from the Modes panel. This specialized camera provides professional filmmaking controls and can be animated along paths.

2Set Camera Positions

Create a sequence by setting keyframe parameters for the camera's starting and ending positions. You can define camera moves, focal length changes, and other cinematic properties.

3Render Your Cinematic

Use Unreal's Sequencer tool to preview and render your camera animation. The combination of Gaussian splats and cinematic camera work creates photorealistic animated sequences.

Troubleshooting Tips

• Plugin Not Showing: Restart Unreal Editor after installing the Luma AI plugin for the first time
• Splat Not Importing: Verify you exported from Super Splat Editor with default settings
• Character Falls Through: Double-check that complex collision is enabled and the GLTF mesh is properly aligned with the splat
• Poor Performance: Remove more geometry in Super Splat Editor before exporting to reduce polygon count
• Mesh Alignment Issues: Use the grid snapping and rotation tools in Unreal to fine-tune mesh placement
• Wrong Engine Version: Ensure you're using Unreal Engine 5.3.2 specifically for plugin compatibility