Insights, workflows and technical explorations across 3D production, ArchViz, AI-assisted pipelines and next-generation CG tools.

Posted on by — Leave a comment

Updated Insights into 3D Gaussian Splatting Techniques for Real-Time Rendering

3D Gaussian Splatting for Real-time Rendering

Introduction

The 3D graphics industry is experiencing a transformation thanks to groundbreaking techniques like 3D Gaussian Splatting (3DGS). Traditionally, creating highly realistic 3D scenes demanded extensive computing resources and required powerful hardware for real-time rendering, limiting access for many artists and developers. However, 3DGS represents an innovative shift, utilizing translucent ellipsoids (“Gaussian splats”) to efficiently represent objects and scenes, allowing for real-time rendering with photorealistic quality.

This article will guide you through the basics of Gaussian Splatting, explore the technical processes involved, and examine its integration in today’s leading software.

What is 3D Gaussian Splatting?

Unlike traditional 3D models based on polygons, 3D Gaussian Splatting represents scenes as clouds of ellipsoids, each known as a “Gaussian splat.” These splats are tiny, semi-transparent 3D objects with properties such as position, color, size, and opacity. By layering these splats together, 3DGS recreates lifelike visuals from any angle, and its unique approach enables high-quality rendering without the computational demands of detailed polygon meshes or complex neural networks.

In practice, this means that 3DGS can render images and animations with a photorealistic quality at speeds suited for interactive applications, from virtual reality (VR) environments to augmented reality (AR) simulations.

3D Gaussian Splatting
3D gaussian splatting - bicycle

How Does It Work?

Creating a scene with 3D Gaussian Splatting involves a series of sophisticated steps, integrating various machine learning techniques and optimization algorithms to ensure that rendered scenes are accurate and visually coherent.

  1. Structure from Motion (SfM): This technique is similar to photogrammetry where multiple images of a scene are captured from different angles to generate a 3D point cloud using software like COLMAP.
  2. Gaussian Transformation: Each point in this cloud is converted into a Gaussian splat with defined parameters.
  3. Differentiable Rasterization: The splats are projected onto a 2D plane for rendering, mimicking how a camera perceives them.
  4. Optimization: Techniques like Stochastic Gradient Descent (SGD) are used to refine the accuracy of the splats.

This structured approach allows 3D Gaussian Splatting to represent complex scenes with lifelike depth, colors, and transparency, while keeping computational demands relatively low.

Here’s a video about 3D Gaussian Splatting from SIGGRAPH 2023:

Benefits and Limitations of 3D Gaussian Splatting

Key Benefits:

  • Efficiency: Requires less storage and processing power compared to dense polygon meshes.
  • Realism: Replicates complex lighting effects, including reflections and depth, with a high degree of accuracy.
  • Speed: Suited for real-time rendering, making it ideal for VR and AR applications.
  • Scalability: Efficiently manages large scenes without sacrificing performance.

Challenges and Limitations:

  • Memory Requirements: While optimized, large-scale scenes can still demand substantial memory resources.
  • Fine Detail Representation: Ultra-fine details may not be captured as precisely as traditional models.
  • Editing Limitations: Adjusting and manipulating Gaussian splat models is less flexible than editing standard 3D models with polygons.

3D Temporal Gaussian Splatting: Extending to Dynamic Scenes

An exciting extension of 3D Gaussian Splatting is 3D Temporal Gaussian Splatting (3DTGS), which incorporates a time component to handle dynamic scenes. This allows for the real-time rendering of high-resolution, dynamic environments. 3DTGS represents motion by modeling shape and position deformations across different timestamps, using a predictive framework to track the movement of each splat.

The technique is sometimes referred to as 4D Gaussian splatting, although most implementations still use 3D Gaussian primitives, simply adding time as a parameter for optimization. Achievements of this approach include the ability to maintain high rendering quality even as dynamic scenes evolve in real time, showcasing potential applications in film, autonomous driving simulations, and other media.

Applications of 3D Gaussian Splatting

3D Gaussian Splatting has been successfully adapted across various domains in computer vision and graphics. The technique’s flexibility allows it to be used for a wide range of applications, from dynamic scene rendering to autonomous driving simulations and even 4D content creation.

  • Text-to-3D using Gaussian Splatting: This application uses 3DGS to convert text descriptions directly into 3D models, making it a powerful tool for rapid 3D creation from textual input.
  • Autonomous Driving Simulations: 3DGS is used to generate realistic, novel views of a scene for autonomous driving, improving the simulation of sensor data for vehicle systems.
  • SuGaR: This method allows for the rapid extraction of precise meshes from 3D Gaussian splats, aiding in the conversion of splat-based representations into mesh-based ones for further manipulation.
  • SplaTAM: A technique applying 3D Gaussian-based radiance fields to Simultaneous Localization and Mapping (SLAM), which enhances real-time environment mapping with high optimization capabilities.
  • 4D Content Creation: 3DGS is also used to generate 4D content, enabling the creation of time-varying 3D models, ideal for animation and simulation purposes.

These applications demonstrate the broad potential of 3D Gaussian Splatting in transforming how we create and interact with dynamic 3D environments.

3D Gaussian Splatting in Modern Tools

With its growing popularity, 3D Gaussian Splatting has been incorporated into a range of software solutions, each leveraging the method’s benefits for various types of projects. Below are several key applications:

1. NVIDIA NeRF (Neural Radiance Fields)

NVIDIA’s Instant NeRF is a well-known application of 3DGS principles. NeRFs use neural networks to render complex environments from multiple images, capturing intricate lighting and textures. NVIDIA’s solution enables real-time rendering, which is especially useful for VR and AR applications, where high realism and fast processing are paramount.

Advantages: Optimized for immersive applications; effective for creating volumetric captures that interact well with lighting and motion.

2. Luma AI and Polycam

Luma AI and Polycam have integrated 3D Gaussian Splatting into their platforms, providing accessible ways to capture and render 3D models. Luma AI focuses on high-quality model creation through a web-based interface, while Polycam allows users to capture environments and create models using mobile devices. These tools open up 3DGS to a broader audience, from beginner 3D artists to professionals seeking quick scene representations.

Advantages: User-friendly interfaces for model creation; supports web-based, high-quality 3D visualizations.

3. Nerfstudio

Nerfstudio is an open-source toolkit for advanced users interested in creating, visualizing, and training 3DGS models. Offering command-line controls and extensive customization options, it allows technical users to experiment with and refine their Gaussian splatting models. Nerfstudio is highly flexible and suited for users comfortable with coding and experimenting.

Advantages: Open-source with high customizability; ideal for researchers and developers seeking a customizable, advanced platform.

4. PlayCanvas and Gauzilla

For those aiming to integrate 3DGS in web applications, PlayCanvas (through SuperSplat) and Gauzilla offer convenient tools. PlayCanvas, a web-based rendering engine, supports Gaussian splats with real-time performance in browsers, while Gauzilla, written in Rust, uses WebAssembly for smooth browser-based rendering.

Advantages: Optimized for web-based rendering; allows for interactive applications directly in web browsers.

5. V-Ray 7

As the first commercial ray tracer to support 3D Gaussian Splatting, V-Ray 7 integrates 3DGS directly with its powerful ray-tracing capabilities. Artists and designers using V-Ray 7 can place Gaussian splats in real-world environments, blending them with 3D models for highly realistic, dynamic compositions. V-Ray is particularly valuable in film, animation, and design fields, where achieving photorealism is critical.

Advantages: Photorealistic integration with ray tracing; ideal for high-end production environments needing realistic visuals.

6. Unreal Engine

Unreal Engine has started exploring the use of 3D Gaussian Splatting, though native integration remains limited and experimental. Currently, the engine allows for Gaussian Splatting through custom techniques and adaptations, often relying on external scripts or community-developed shaders. While Epic Games has not yet released official support, there are plugins and tools in development that let interested users experiment with this technology, particularly for projects that require advanced optimization of complex scenes and real-time visualization.

Advantages: Faster rendering speeds and efficient handling of highly detailed scenes.

The Future of 3D Gaussian Splatting

3D Gaussian Splatting is still developing, and improvements are underway to enhance its rendering quality, versatility, and accessibility. Expected advancements include GPU compatibility, shadow rendering support, and additional rendering options for high-quality photorealism. As more software begins to integrate 3DGS, it will likely become a foundational technology in 3D graphics, supporting use cases across film, virtual and augmented reality, simulations, and beyond.

Conclusion

3D Gaussian Splatting offers an innovative approach to 3D rendering, merging quality with efficiency. This makes it an exciting development for anyone interested in creating immersive, interactive digital worlds. With its increasing presence in leading platforms and applications, 3DGS is transforming workflows in industries that demand high-quality visuals and quick rendering times.

For 3D artists, designers, and developers, the time to explore 3D Gaussian Splatting is now. This method opens up new possibilities for creating, experiencing, and interacting with digital scenes in ways previously considered out of reach.

Sources:

Share
Posted on by — Leave a comment

“Ballerina”. A personal challenge to try 3dsMax + UE5 workflow for quick photorealistic rendering

Ballerina animation - 3ds Max - Unreal Engine

Hello, everyone! Today, I want to share an exciting project where I tested a new workflow using 3ds Max and Unreal Engine. After years of handling every part of production in 3ds Max—from modeling, materials, and lighting to final rendering—I was eager to explore Unreal Engine as a tool for shading, lighting, and rendering. My goal? To speed up my workflow and create photorealistic animations faster than ever. Here’s how the experiment went, step-by-step, and what I discovered along the way.

Project Idea: A Stone Sculpture Ballet Dancer in Nature

For this test, I wanted a small but impactful project that could showcase the capabilities of Unreal Engine 5 for photorealistic rendering in a 3ds Max-based workflow. I envisioned a scene featuring a ballerina sculpted entirely from stones, surrounded by a sunny, natural environment. The camera would move around the sculpture in a gentle spiral, gradually revealing the dancer’s form to the viewer. I wanted to capture ambient sound, subtle musical elements, and finish the entire project within a set timeframe. Here’s how it went down!

Step-by-Step Workflow

Step 1: Learning Unreal Engine Basics

I started by taking an excellent free course on UE5 filmmaking. My goal was to get a solid understanding of Unreal’s photorealistic rendering, material, and lighting capabilities. This foundation was essential to maximize Unreal’s features in my workflow.

Step 2: Writing the Animation Script

Next, I wrote a simple script for the animation (similar to the description above) to keep everything organized. Instead of adding complex animation to the subject, I decided to focus on camera movement around the sculpture to keep the project manageable and stay focused on the new workflow—3ds Max for modeling and animation, and Unreal for shading, lighting, and rendering.

Step 3: Gathering Resources for Modeling the Sculpture

For the dancer model, I used Mixamo to find a 3D mannequin in a ballet pose. I also sourced high-quality photorealistic PBR stone models from Sketchfab to use as the building blocks for the sculpture.

Step 4: Constructing the Stone Sculpture in 3ds Max with TyFlow

To build the sculpture, I used the mannequin from Mixamo as a container, essentially like a mold for placing the stones. I needed a way to “fill” this form with stones, so I turned to TyFlow, a particle simulation plugin for 3ds Max. TyFlow allowed me to quickly set up the stone arrangement to follow the form of the dancer, giving it an organic, lifelike look. I learned the basics from a simple tutorial, which was enough to achieve the effect I wanted.

Step 5: Camera Animation with Spiros in 3ds Max

Creating a complex, spiral camera motion around the sculpture was key to this animation. I wanted full control over the distance and movement of the camera, so I used my own Spiros plugin for 3ds Max. Spiros let me create a logarithmic spiral path for the camera with the exact flexibility and control I needed. I then applied a “path constraint” to the camera and animated both the camera and its target. I also adjusted the animation’s timing and pace to sync well with ballet music, adding to the fluidity of the final result.

Ballerina stone sculpture animation 3ds Max and Spiros plugin

Step 6: Exporting Models and Camera to Unreal Engine

With the model and animation ready, it was time to export to Unreal Engine. I first exported the dancer model as an FBX and imported it into Unreal, where the PBR stone textures needed minimal adjustment—they already looked great. For the camera, I used the tutorial “How to Transfer 3ds Max Animated Camera to Unreal Engine 5” along with the “Unreal Engine 4 – Camera Animation Exporter” script. This combo allowed me to successfully export and integrate the camera animation into Unreal.

Step 7: Setting Up the Scene in Unreal with Quixel Bridge and Polyhaven

In Unreal, I found a stone pedestal model in Quixel Bridge that worked perfectly for the dancer’s base. For the background, I chose a high-resolution park HDRI from Polyhaven. The HDRI provided realistic global lighting and created a natural environment that made the sculpture feel truly embedded in its surroundings. I experimented with a few different HDRIs and settings until I was satisfied with the look.

Step 8: Visual Effects and Final Render in Unreal Engine

I then added some visual effects to the camera in Unreal Engine: autofocus on the tracked actor, bloom, lens flare, and motion blur—all of which contributed to a polished, cinematic feel. After a quick test render, I moved on to the final render. Unreal’s rendering speed was astonishing, completing the 705 frames of animation (1920×823 resolution) in just 50 seconds. The quality and efficiency of Unreal’s renderer completely exceeded my expectations.

Step 9: Post-Production in After Effects

Finally, I added sound effects and music in After Effects for the finishing touches. Ambient sounds of birds, soft ballet music, and some brief closing credits completed the piece.

Ballerina animation - 3dsMax - TyFlow - Unreal Engine

Final Thoughts: Is This Hybrid Workflow Worth It?

This project showed me that a 3ds Max + Unreal Engine workflow is not only feasible but also highly efficient for photorealistic animation. Unreal provided the speed and quality I was hoping for in a renderer, making it an excellent option for projects with tight deadlines. I’ll definitely keep exploring this hybrid approach for future work!

If you’re thinking about using Unreal for rendering in a 3ds Max pipeline, give it a shot! You might just be amazed at the results.

Share
Posted on by — Leave a comment

Showcaser for 3ds Max: Create Stunning Animated Presentations with Ease

Showcaser 3ds Max plugin

Showcaser 3ds Max plugin

Creating animated presentations in 3ds Max has never been easier. Showcaser is a powerful plugin designed to help 3ds Max users create professional-quality animations of scenes, products, or models with minimal setup. Whether you’re showcasing a complex scene assembly or focusing on a single model, Showcaser offers a streamlined way to bring your 3D work to life.

Why Showcaser?

Showcaser is perfect for users who want to animate their 3D designs quickly without needing in-depth animation skills. With a few clicks, you can go from a static scene to an impressive animated sequence. Its simple interface lets you arrange objects in a preferred animation order, adjust parameters, and instantly generate keyframes for position, rotation, and scale.

Showcaser offers two main animation modes:

  1. Scene Animation Mode: Animate an entire scene as it assembles, with each object appearing in sequence until the scene is complete.
  2. Model Animation Mode: Ideal for presenting products or models, Showcaser sequentially reveals each element on screen, adding entry and exit animations for a dynamic presentation.

For added flexibility, Showcaser supports both standard 3ds Max objects and third-party plugins, including proxies, making it an adaptable choice for all types of users.

Features that Make Showcaser Stand Out

Showcaser is loaded with features to help you animate with ease and precision:

  • Multiple Animation Sequences: You can create several animated sequences for a single scene, allowing you to showcase different aspects of your design or focus on specific elements.
  • Flexible Object Loading and Ordering: Load objects by manual selection, name, layer, or group, and define the animation order based on name, size, or position, or set a custom order.
  • Animation Variety: Choose from multiple animation types (movement, rotation, scale, appearance/disappearance) and customize easing (linear, ease in/out, spring).
  • Turntable Animations: Generate a turntable animation with customizable parameters or load a custom turntable model for professional model presentations.
  • Group Animations: Showcaser allows you to animate specific groups of objects together, based on criteria such as size, layer, or user-defined sets, creating more organized animations.
  • Adjustable Timing: Configure start and end times, control entry and exit durations, and overlap animations for a smooth flow.
  • Keyframe Control and Flexibility: Showcaser creates standard keyframes, so you have full control and can adjust animations manually in 3ds Max without dependency on the plugin.

A User-Friendly Animation Tool

Showcaser’s intuitive design and preset library make it accessible for all experience levels. With instant parameter presets and the ability to save custom presets, you can easily replicate animation settings for consistency across multiple projects. Plus, Showcaser’s custom undo function and option to restore the initial scene state make experimenting with animations risk-free.

The Advantages of Showcaser

Showcaser is ideal for 3D artists, designers, and animators who need an efficient tool for creating animated presentations. Here’s why Showcaser stands out:

  1. Simplicity and Speed: Instantly animate scenes or models without needing extensive animation skills.
  2. Professional Presentations: Deliver high-quality, dynamic presentations in fields like CGI, architectural visualization, game art, and industrial design.
  3. Animation Control: Each animated object remains a standard 3ds Max object, allowing for manual edits with 3ds Max’s native tools.
  4. Flexible Export: Showcaser animations are compatible with real-time engines like Unreal Engine, Unity, and Chaos Vantage for game design and virtual presentations.

Ready to bring your 3ds Max projects to life? Try Showcaser today and explore how simple, powerful animations can elevate your 3D presentations.

Showcaser 3ds Max plugin

Share
Posted on by — Leave a comment

TurboSplines for 3ds Max: Effortless Path Deform Animations for CG Artists

TurboSplines 3ds Max plugin

TurboSplines 3ds Max plugin

Creating smooth, spline-driven animations in 3ds Max can be challenging, especially when working with complex paths or multiple meshes. TurboSplines is here to simplify that process. This powerful plugin automates the creation, editing, and animation of path-deformed meshes, making it an ideal tool for professionals in CG animation, motion graphics, and VFX.

Why Choose TurboSplines?

TurboSplines is designed to streamline path deform animations in 3ds Max, enabling artists to produce high-quality animations with minimal effort. Here’s how TurboSplines can transform your workflow:

  • Instant Path Deform Setup: TurboSplines automatically assigns Path Deform modifiers to both preset and custom meshes. In just a few clicks, you can animate splines into dynamic cables, wires, ribbons, tentacles, and much more.
  • Choose Your Meshes: Work with predefined shapes (cylinder, capsule, box, ribbon) or bring in custom profiles and meshes. TurboSplines handles multiple meshes per path, letting you create intricate animations from a single intuitive interface.
  • Enrich and Refine: Add taper, tip, and slice effects to adjust the look of your meshes. Control animations on parameters like scale, height, rotation, twist, and stretch to bring realism and detail to your creations.
  • Copy, Paste, and Customize: Easily copy and paste settings between meshes, apply variation and offset for unique, realistic animations, and manage all parameters from TurboSplines’ user-friendly interface.

The TurboSplines Advantage: Focused Simplicity

Unlike particle systems and other powerful plugins like TyFlow, which are oriented toward visual effects, particle simulations, physics simulations, and fluid dynamics, TurboSplines is exclusively focused on mesh deformation along spline paths. This specialized approach offers a wide range of creation, editing, and animation options through a simple, intuitive interface—without the need to learn a complex, all-encompassing tool. TurboSplines has a quick learning curve, making it accessible for users of all experience levels.

One of TurboSplines’ key benefits is its flexibility: each generated mesh is a standard 3ds Max object, fully selectable and editable. This allows for manual adjustments and precise control over each animated mesh, giving you creative freedom to tweak and refine every detail.

Versatile Animation Options

With TurboSplines, artists can explore various animation styles along a path, including movement, growth, and reveal animations. For users working with complex spline paths, TurboSplines also offers a quick conversion feature to turn splines into custom helical paths, perfect for creating spirals, springs, and cables.

Key Benefits of TurboSplines

  1. Efficiency: Automates repetitive tasks, saving time on each project.
  2. Creative Control: Gives you the ability to control numerous animation parameters from a central interface.
  3. Realism and Variation: Apply offset and variation to create more lifelike animations.
  4. Quick Learning Curve: Ideal for users who need a specialized tool for spline animations without the complexity of particle systems.
  5. No Plugin Dependency: TurboSplines uses 3ds Max standard modifiers, ensuring compatibility with all major render engines without plugin dependency.

TurboSplines is the ultimate tool for 3ds Max users aiming to automate, streamline, and enhance their path deform animations. Whether you’re animating growing vines, trailing light effects, or spiraling cables, TurboSplines gives you the flexibility and control to bring your ideas to life faster than ever.

Ready to elevate your animations in 3ds Max? Explore TurboSplines today and see how easy it can be to add professional-grade path deform animations to your workflow.

TurboSplines 3ds Max plugin

Share
Posted on by — Leave a comment

A Must-Have Tool for Spline Optimization: Spline Cleaner 3ds Max Plugin

Spline Cleaner 3ds Max Plugin

For 3ds Max users handling complex, spline-heavy projects, Spline Cleaner is an essential plugin that optimizes your workflow, automates repetitive tasks, and prepares your splines for accurate extrusions. Ideal for architectural plans, CAD file imports, and Illustrator paths, Spline Cleaner simplifies curve management and ensures your splines are clean, efficient, and ready for use in any 3D model.

Key Benefits of Spline Cleaner

  1. Streamline Spline Management and Cleanup
    Spline Cleaner provides an advanced suite of tools to batch-process splines efficiently. Perfect for imported CAD and vector files, it helps eliminate overlapping, disorganized, or duplicated curves, automatically organizing them with smart filters like size, length, proximity, and layer. This tool is especially valuable when working with hundreds of shapes, saving hours of manual selection and cleanup.
  2. Optimize and Automate Spline Edits
    With Spline Cleaner, you can select, attach, detach, or delete multiple splines quickly by applying filters to target curves based on specific attributes such as bounding box size, wire color, or vertex count. The plugin also enables precise vertex management, letting you weld, reduce, or normalize vertices effortlessly. This level of control is invaluable for creating smooth, clean splines, whether in architectural layouts, logo designs, or motion paths.
  3. Comprehensive Spline Diagnostics and Monitoring
    The Splines Info Dialog offers real-time feedback on spline attributes like material counts, vertex numbers, and material IDs. The Diagnosis feature pinpoints potential issues like overlapping curves, empty shapes, or duplicate splines, ensuring your curves are optimized before extrusion. This interactive tool updates with every action, keeping your spline data organized and error-free as you work.
  4. Prepare Splines for Accurate Extrusions and Modeling
    Spline Cleaner’s robust optimization tools ensure your spline curves are extrusion-ready. Features like Smart Normalize allow you to rebuild splines with even vertex distribution, while Reduce Vertices and Weld Vertices eliminate unnecessary points, creating smooth, clean curves that translate well into 3D geometry. These features ensure precision and efficiency, especially valuable in CAD-based or vector design imports.

Key Features and Tools in Spline Cleaner

  • Smart Normalize: Rebuild your splines with evenly distributed vertices, ideal for creating consistent curves in architectural plans or logos.
  • Filter by Open/Closed Condition: Easily sort and organize splines based on whether they’re open or closed.
  • Support for Material IDs: Maintain material assignments across all operations, ensuring consistent appearances for complex models.
  • Advanced Error Detection: Identify and fix overlapping or empty shapes with the Diagnosis tool, ensuring smooth extrusions.
  • Automated Filters for Efficient Selection: Use nine distinct filters to select, attach, or delete shapes by criteria such as size, wire color, and layer.
  • Vertex Management Tools: Weld, optimize, or reduce vertices for refined spline curves, minimizing geometry clutter and enhancing performance.
  • Explode and Reverse Tools: Detach segments or reverse splines with options to preserve material IDs for better extrusion control.
  • Viewport Data Exposure: See real-time spline data like vertex numbers and material IDs in the viewport, providing immediate feedback as you work.

Ideal for Designers, Architects, and 3D Artists Across Industries

Spline Cleaner is invaluable for both architectural visualization and graphic design, excelling in projects that rely on spline-based workflows. Its automated tools streamline time-consuming tasks, from preparing CAD layouts to organizing vector paths, allowing you to work more efficiently and deliver polished results. This plugin is indispensable for any professional working with 3ds Max who wants to elevate their workflow, reduce manual edits, and achieve high-quality, clean spline results ready for any 3D application.

Spline Cleaner 3ds Max Plugin

Share