The Rider

2024

Category | Virtual Production · XR · Photogrammetry · 3D Environment Art

Tools | Unreal Engine 5, Reality Capture, MAYA, Zbrush, Substance Painter

Studio | Madwell LLC - WLab Virtual Production

←

Overview

This project is a realistic 3D waterfront environment created for virtual production, based on a real location at the Brooklyn Navy Yard. The scene aims to balance real-world accuracy with real-time performance.

Reference Photo

Virtual Environment in Unreal Engine 5

Our team captured the environment using 3D scanning and photogrammetry, then rebuilt and optimized the scene in Unreal Engine. The final environment supports different lighting, weather, and time-of-day conditions for flexible virtual production use.

Technical Details

Built using 3D scanning and photogrammetry, this environment was processed through RealityCapture, Maya, ZBrush, and Substance Painter, then assembled and optimized in Unreal Engine with Ultra Dynamic Sky Plugin.

  • Data capture

    • Geometry captured using LiDAR scanner - Artec Leo Ray II

    • Photogrammetry Cross-Polarized Capture used to obtain accurate colors

  • Reconstruction & cleanup

    • Scan alignment and reconstruction in RealityCapture

    • Geometry cleanup, retopology, and UV creation in Maya & ZBrush

  • Texturing

    • High-to-low poly baking workflow

    • PBR texture fixing in Substance Painter

  • Real-time & virtual production

    • Environment building in Unreal Engine

    • Ultra Dynamic Sky plugin used for lighting, weather, and time-of-day variations

Reality Capture Alignment & Projection

Cleaned-up Assets Integrated into UE

Credits

I led the photogrammetry capture and workflow, then collaborated with environment artists to integrate the assets into Unreal Engine with flexible time-of-day and weather setups.

Me & goose friends🪿

Photogrammetry: Shentong Yu, Kevin Wang, Seyeon Jeong

Art: Shentong Yu, Seyeon Jeong, Wenguang Sha, Yuanpeng Cheng, Harsh Palan