Recently we at Canopy Creative have massively adopted 3D gaussian splatting technology into our 3D workflow, expediating 3D production on projects at Canopy, Increasing quality whilst reducing cost.
The Potential of 3D Gaussian Splatting for Canopy Creative
3D Gaussian Splatting, a revolutionary rasterization technique, has significantly enhanced Canopy Creative's service offerings.
This technology enables real-time rendering of photorealistic scenes from limited image samples, making it ideal for various applications in interactive media that involve 3D Scanning or Capture.
Use Case Opportunities
1. Enhanced 3D Visualization and Design:
Canopy Creative's core services in 3D art can be greatly augmented by 3D Gaussian Splatting. This technology's ability to create detailed and realistic 3D models from images allows the studio to produce more intricate and lifelike visualizations, setting new standards in 3D design and rendering.
2. Immersive Experiences in VR and AR:
Given Canopy Creative's focus on VR and AR, 3D Gaussian Splatting could be used to develop more dynamic and engaging virtual environments. This would enhance the user experience in applications ranging from interactive gaming to virtual tours, aligning perfectly with the studio's ambition to empower brands with immersive technologies.
3. Real-Time Rendering for Interactive Media:
The recent speed and efficiency improvements to 3D Gaussian Splatting technologies makes it ideal for real-time applications. This is a game-changer for Canopy Creative in areas like live event visualization, interactive media installations, and real-time scenes and games, where immediate rendering of complex scenes is crucial.
4. Creative and Marketing Applications:
We're incorporating 3D Gaussian Splatting into projects to create unique marketing and advertising experiences. For example, the technology's ability to render dynamic 3D scenes could be used for innovative product showcases or interactive digital advertisements in both traditional and emerging contexts.
5. Expanding into New Markets:
By integrating 3D Gaussian Splatting, Canopy Creative is expanding its services into new markets such as architectural visualization, product design, and digital art installations. This technology's versatility opens up numerous possibilities for creative exploration and commercial applications.
Incorporating 3D Gaussian Splatting into its repertoire will propel us at Canopy Creative even further as a leader in innovative media solutions.
By leveraging this technology, Canopy Creative can offer their clients unparalleled visual fidelity and interactivity, aligning with their commitment to creating visually stunning designs and custom software solutions that exceed expectations. This strategic move would not only keep pace with technological trends but also position our clients as innovators in the adoption of immersive technologies within their respective industries.
Tips on Creating Gaussian Splats Using Luma Labs and Spline
For Canopy Creative, a studio specializing in next-generation interactive media and custom software solutions, incorporating 3D Gaussian Splatting can enhance their offerings in 3D art and immersive technologies.
Luma Labs offers a streamlined process for creating Gaussian splats. Here's a step-by-step guide on how to use this application effectively for someone new to 3d.
1. Creating a Splat:
- Use a mobile app like Luma Labs to create a splat. This can be done from a recorded video from your phone or camera. Simply walk slowly around a subject keeping it in view the entire time, try to capture as much detail in a short video (60 to 90 seconds) whilst maintaing a smooth movement.
- you can also upload to luma labs directly by signing up here.
- For Luma users: Download the Gaussian Splat file from the Luma web app (note: do not download the .ply file from their mobile app).
2. Importing into Spline:
- Drag and drop the .ply file into Spline’s editor, with a maximum file size of 480MB. This will allow you to start adjusting how the splats look in your Spline scene.
- sign up and access spline here.
3. Tips for Improving Your Scene:
- Use a custom Perspective camera with a Far value.
- Adjust the rotation of imported splats using the transform controls.
- Animate your Splat object with transitions.
- Experiment with Post-processing to adjust the splat's look and feel (note: post-processing effects can reduce performance).
4. Cropping Your Splats:
- Select the Splat in Spline.
- In the right sidebar, find the “Crop Areas” section and click on the “+” icon to create a new crop area.
- Choose the type (Box or Sphere), adjust the center, size, and rotation of the crop area.
- This step is crucial for optimization and aesthetic purposes.
5. Optimizing Splats:
- Ensure splats are focused on content and exclude unnecessary details.
- Import splats no bigger than 300MB; smaller file sizes (around 5 MB) are preferable for better performance.
- Reduce visible Splat points using crop areas in Spline for optimal performance.
6. Mobile Performance Considerations:
- Keep splats simple and use cropping areas to reduce the number of splats.
- Avoid combining splats with complex 3D scenes or materials.
- This feature is still experimental, so ongoing updates are expected to improve mobile support.
For Canopy Creative, utilizing Luma Labs for 3D Gaussian Splatting has opened up new avenues in 3D visualization, VR/AR experiences, and interactive media. By following this guide, you too can efficiently incorporate this technology into projects, enhancing capability to deliver high-quality, innovative solutions.
Spline is a great tool for introducing 3D to new people, here at Canopy our pipeline is more complex, utilizing luma labs for processing, our Gaussian scans thus far have ended up in Unreal Engine, Houdini and even on the 3d printer.
To learn more or if you are interested in utilizing 3d Gaussian Splatting technology, contact our friendly Canopy Creative team to begin your journey today.