Hero Cloud — Single-Shot Scene Reconstruction in PFTrack
- Adam Hawkes
- 17 hours ago
- 5 min read
A new node in PFTrack generates a measured 3D point cloud directly from a single tracked shot, no reference photography, no LiDAR scan, no second capture required. Export to Gaussian splat pipelines, surface to mesh, or use as a spatial scaffold in any DCC. Available now in Solo, Studio, and Enterprise.
What's new
Hero Cloud is shipping today in PFTrack. It joins the existing PFTrack node graph as a new reconstruction tool, sitting alongside Camera Solver, Photo Mesh, and the rest of the toolset.
Hero Cloud takes a tracked plate, the same plate you’ve already solved with PFTrack’s Camera Solver, and generates a measured 3D point cloud of the scene. It uses through-the-lens reconstruction, a technique that extracts spatial information directly from the moving camera in the shot. No separate photogrammetry set is required. No LiDAR scanner. No additional capture of any kind.
It’s available in every PFTrack edition: Solo, Studio, and Enterprise. The node will appear in the next build.
When to use it
Hero Cloud is built for a situation every matchmove and reconstruction team has encountered: a brief that needs measured 3D data of the scene — for set extension, CG integration, lighting reference, forensic analysis, or architectural measurement — and no reference photography was captured on set. The shoot wrapped before the second-unit crew got to it. The LiDAR scanner couldn’t make it to the location. The brief evolved after the shoot. Or the source material is archival, and there is no on-set crew to send back.
In each of those cases, the plate itself is the only spatial record of the scene. Hero Cloud uses what’s already there.
Typical use cases:
VFX matchmove and set extension where reference photography wasn’t shot or wasn’t usable
Forensic reconstruction from CCTV, body-cam, dash-cam, or witness footage
Heritage and archaeological documentation from archival film or video
Architectural reference from drone footage or walk-through video
Source data for Gaussian splat training pipelines
Any project where the only available record of a scene is the footage itself
How it fits with the rest of the toolset
Hero Cloud doesn’t replace PFTrack’s existing reality-capture tools — it extends them. Use it alongside the tools you already know:
If you have a dedicated photogrammetry set: Photo Mesh (Studio and Enterprise) remains the highest-fidelity reconstruction path, producing a textured mesh from a planned photoset.
If you have LiDAR data: PFTrack’s LiDAR integration (Studio and Enterprise) gives you precise survey-grade point clouds aligned to your tracked cameras.
If you have only the tracked plate: Hero Cloud reconstructs spatial data from what’s in the shot itself, the path forward when no dedicated capture was performed.
The point of through-the-lens reconstruction is to give you a way forward when dedicated capture wasn’t an option, not to replace dedicated capture when it was.
What you can do with the output
Hero Cloud produces a measured 3D point cloud — a set of accurately positioned 3D points representing the surfaces visible in the tracked plate. The release includes new export options that open three concrete downstream paths:
1. Train a Gaussian splat with the new Postshot export
This release introduces a new Postshot export node that writes Hero Cloud point clouds and the associated tracked cameras out in COLMAP format — the standard input format for Postshot and the wider Gaussian splat training ecosystem. For artists working with Postshot or other COLMAP-compatible splat trainers, PFTrack now sits naturally at the front of that pipeline. Track your plate, run Hero Cloud, export to COLMAP, train a splat in Postshot. The artist-friendly route into a workflow that has historically required command-line tools.
2. Surface to a textured mesh with Photo Mesh
Photo Mesh has been updated to work with Hero Cloud point clouds (Studio and Enterprise editions). For users who need a finished textured mesh from a single shot, Photo Mesh can now take a Hero Cloud output as input and produce a surfaced reconstruction — ready for export to Maya, Nuke, Unreal Engine, USD, and the rest of PFTrack’s supported formats. This gives Studio and Enterprise users a complete single-shot path from tracked plate to textured mesh, all within PFTrack.
3. Use as a spatial scaffold in any DCC
This release also extends USD export to support dense point clouds with per-point normal and colour data, and FBX export has been improved to handle very large dense point clouds reliably. Export Hero Cloud output to USD, FBX, OBJ, Alembic, or PLY, and use it directly in Maya, Houdini, Blender, Nuke, or any DCC — as a measurement scaffold for modelling, a volumetric guide for placing CG elements, or a spatial reference for set extension and lighting.
Whichever path you take, Hero Cloud is the front of the workflow. The choice of downstream tool depends on what you need to deliver.
How to use it
Hero Cloud is a single node, designed to drop into your existing tracking workflow without restructuring your graph. The basic process:
Track and solve your hero plate as you normally would, using Auto Track or User Track followed by Camera Solver.
Add a Hero Cloud node downstream of the solved camera.
Connect the tracked footage and solved camera into the Hero Cloud node’s inputs.
Run the node. Hero Cloud generates a 3D point cloud of the scene, viewable in the Cinema window and ready for downstream use.
Export via Scene Export (USD, FBX, OBJ, PLY, Alembic), the new Postshot export (COLMAP for splat training), or feed the output into Photo Mesh for surfaced mesh generation.
New in this release: Viewer windows now have an “Active Camera” viewport with an option to snap the camera pose to the active clip — a useful aid for visually verifying your Hero Cloud output against the tracked plate.
The full node reference, including parameter details and quality controls, is in the PFTrack documentation.
What it requires
Hero Cloud works with any plate that PFTrack can track and solve, including footage from cinema cameras, broadcast cameras, drones, body-cams, dash-cams, action cameras, mirrorless and DSLR cameras, and CCTV. Camera metadata is helpful but not required, the Camera Sensor Database covers most common cameras automatically, and Camera Solver can estimate parameters where metadata is unavailable.
The shot does need parallax. Hero Cloud reconstructs depth from the camera’s movement through the scene, so locked-off shots and shots with very little camera motion will produce sparse or unreliable results. Most production footage, even handheld stationary shots — has enough small camera movement to produce a usable reconstruction. Shots with deliberate camera motion produce richer results.
Performance
Hero Cloud typically processes in minutes per shot on modern hardware. The node benefits from GPU acceleration; refer to the PFTrack Hardware Guide for recommended configurations. Processing runs entirely locally, no cloud processing, no data leaves your workstation.
Looking ahead
Hero Cloud is the first of a wider set of through-the-lens reconstruction tools coming to PFTrack. Future PFTrack releases will extend the workflow with additional reconstruction nodes that build on the same foundation. Watch this space for further announcements.
Get started
Hero Cloud ships in the current build of PFTrack across all editions. To start using it:
Download the latest build
Existing PFTrack users: Download the latest build. Hero Cloud will be available in the Geometry node category.
New to PFTrack?
New users: The trial mode now operates with full export functionality for seven days, enough time to track a plate, run Hero Cloud, and take the output through to Postshot, Photo Mesh, or your DCC of choice.
Learn More
Try PFTrack Solo Free
Try PFTrack Solo free for 7 days, with full export functionality, enough time to take a real plate from track through Hero Cloud and into Postshot, USD, or your DCC of choice.
