JI.
Across The JordanyVerse hero
Back to Work

Across The JordanyVerse

3D Scan / VFX / Mixed RealityCreative Experiment · 2023

A full-body NYCAP3D scan, rigged and animated in Blender with mocap and keyframes, then tracked with CamTrack, lit via HDReye, and composited as three Spider Jordanys over live footage.

TypeCreative Experiment
Category3D Scan / VFX Compositing
3D ScanNYCAP3D (Full Body)
Output3 Spider Jordanys
ToolsBlender, CamTrack, HDReye
AnimationMoCap + Keyframe
TrackingCamTrack App
LightingHDReye HDRI Capture

Vision

The Spider-Verse Impulse

Sony's Into the Spider-Verse proved a mainstream film could embrace broken rendering: mixed frame rates, visible halftone dots, Ben-Day patterns bleeding through CG geometry.

Across The JordanyVerse applies that to self-portraiture. The question isn't how accurately I can digitize myself, but what happens when I break the process on purpose and the artifacts become the art.

Identity Across Dimensions

A photograph locks a person into one moment, one angle, one plane. A 3D scan frees them into space but adds its own distortions, and depth estimation from a single image is approximate in ways that read as more expressive than precision.

Pipeline

01 - 3D Body Scan

NYCAP3D did the full-body scan. I brought the raw model into Blender, cleaned the mesh, reduced the poly count for animation, and prepared it for rigging.

02 - Rigging & Animation

Rigged the model with a full skeleton and applied motion capture data for natural movement, then layered custom keyframes for the Spider-Verse feel: stylized poses, exaggerated stances, three versions of myself in one frame.

03 - Real-World Tracking

The CamTrack app recorded video while capturing camera position, rotation, and focal length. HDReye captured the scene's lighting as an HDRI so the characters would be lit by the real conditions of the footage.

04 - Compositing & Render

In Blender: import the tracked camera, set the HDRI lighting, place three rigged and animated copies of the scan, and render. Three Spider Jordanys standing in a real NYC environment, lit and tracked to match.

Outputs

NYCAP3D: Full Body Scan
01

NYCAP3D: Full Body Scan

Full-body capture at NYCAP3D's Brooklyn studio: hundreds of synchronized cameras firing at once to capture complete geometry and texture in one session.

NYCAP3D Turntable
02

NYCAP3D Turntable

Turntable of the raw NYCAP3D scan before optimization, showing the geometry and texture of the capture.

NYCAP3D Rigged & Animated
03

NYCAP3D Rigged & Animated

The optimized scan rigged with a full skeleton and driven by motion capture data.

ATJV Source
04

ATJV Source

Source material and process: the pipeline from 2D image to 3D environment.

ATJV Grey
05

ATJV Grey

Grey-material render of the pure geometry, stripped of color and texture.

06

ATJV Final

Final composite: three Spider Jordanys rendered onto tracked footage with matched lighting and camera data.

Tech Stack

NYCAP3D

Full-body 3D scan, high-resolution geometry and texture

Blender

Mesh optimization, rigging, animation, lighting, final render

Motion Capture

MoCap data layered with custom keyframe animation

CamTrack

iOS camera tracking: position, rotation, focal length

HDReye

On-location HDRI capture for scene lighting

After Effects

Final compositing, color grading, output

More Projects