A 2D sketch becomes a photorealistic 3D human head instantly through a single mathematical pass.
April 24, 2026
Original Paper
SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting
arXiv · 2604.19202
The Takeaway
Creating 3D digital humans usually requires complex modeling software or slow iterative rendering. This framework uses Gaussian splatting to generate high-fidelity faces from simple line drawings. It bypasses the need for hours of manual work or massive compute budgets. The result is a fully editable 3D model that responds to changes in the sketch in real time. This technology makes professional 3D character design accessible to anyone with a stylus.
From the abstract
3D Gaussian representations have emerged as a powerful paradigm for digital head modeling, achieving photorealistic quality with real-time rendering. However, intuitive and interactive creation or editing of 3D Gaussian head models remains challenging. Although 2D sketches provide an ideal interaction modality for fast, intuitive conceptual design, they are sparse, depth-ambiguous, and lack high-frequency appearance cues, making it difficult to infer dense, geometrically consistent 3D Gaussian s