Ziyun (Claude) Wang

I am an Assistant Professor in the Department of Electrical and Computer Engineering at Johns Hopkins University, where I lead the SPIKE Lab. My research sits at the intersection of computer vision, robotics, and neuromorphic computing, with a focus on event-based, continuous-time perception—building systems that see and act at the speed of the physical world. I received my Ph.D. from the GRASP Laboratory at the University of Pennsylvania, where I was advised by Kostas Daniilidis.

Ziyun Wang

Join the Lab

I am currently recruiting Ph.D. students for Fall 2027. If you're interested in neuromorphic and event-based vision, 3D perception, or embodied AI and robotics, please email me at claude.w@jhu.edu with the subject line:

[PhD Application 2027] Your Name

Please include your CV, transcript (unofficial is fine), and a short statement of interest or description of your research background.

Research

Neuromorphic and Event‑Based Vision

Perception with brain-inspired event cameras: microsecond latency, high dynamic range, low power.

Match-Any-EventsEvAC3DEVIS

3D Perception

Recovering the 3D structure and motion of scenes, objects, and people.

Human Motion FieldTRAMEqNIO

Embodied AI and Robotics

Closing the loop from fast sensing to action in dynamic, real-world environments.

EV-CatcherTRACEM3ED

News & Updates

  • Sep 2026 I co-organized the IROS 2026 workshop "Perception and Decision Making for Athletic Humanoid Robotics" in Pittsburgh and moderated its panel discussion.
  • Aug 2026 I was the inaugural speaker of the APL–JHU Collaboration Seminar Series at the Johns Hopkins Applied Physics Laboratory, with a talk on "Event-Driven Robotic Vision".
  • Aug 2026 We released TRACE, the first trajectory-level ergodic formulation for active Gaussian scene reconstruction, deployed on real robots. Code is available!
  • Jul 2026 I am serving as an Area Chair for WACV 2027.
  • Jul 2026 We released Isaac Sim Event Simulator v1.0, a physics-grounded, high-rate event camera plugin for NVIDIA Isaac Sim!
  • Jul 2026 Our paper "Match-Any-Events" has been accepted to ECCV 2026! The first generalizable matching model with events.
  • Jun 2026 I co-organized the Telluride Neuromorphic AI Workshop.
  • Mar 2026 Our ICRA 2026 workshop, "Challenges and Opportunities of Neuromorphic Field Robotics and Automation", has been accepted and will take place on June 5 in Vienna!
Show older news
  • Nov 2025 I gave a talk at Worcester Polytechnic Institute.
  • Nov 2025 I served as a panelist at the Physical Intelligence Initiative (PI²) Workshop, University of Delaware.
  • Jul 2025 Our paper "Continuous-Time Human Motion Field from Events" has been accepted at ICCV 2025! See you in Hawaii!
  • Mar 2025 Our paper "Event-based Continuous Color Video Decompression" will appear in CVPR 2025 Workshop on Event-based Vision.
  • Jan 2025 Our paper about equivariant neural IMU is accepted at ICLR 2025!
  • Jan 2025 I gave a lightning talk about event-based human motion field at NYC Computer Vision Day 2025.
  • Sep 2024 I was selected as one of the outstanding reviewers for ECCV 2024.
  • Aug 2024 I finished my internship with the Vision Product Group at Apple.
  • Jul 2024 Four papers accepted to ECCV 2024. See you in Milan!
  • Jun 2023 Our new dataset M3ED is presented at the CVPR event vision workshop.
  • Jul 2022 "EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks" is accepted at RA-L.
  • Jul 2022 "EvAC3D: From Event-Based Apparent Contours to 3D Models via Continuous Visual Hulls" was selected as an Oral Presentation at ECCV 2022. See you in Tel Aviv!

Publications

* Equal contribution

TRACE: Ergodic Trajectory Optimization for Active Scene Reconstruction
Ziyue Zheng*, Linli Shi*, Bingkun He, Wen Jiang, Ziyun Wang
arXiv preprint, 2026

The first trajectory-level ergodic formulation for active Gaussian scene reconstruction. Footprint-aware ergodic search gains +1.5 dB PSNR over baselines and runs directly on real robots, including the Unitree GO2 and Franka FR3.

Isaac Sim event camera live-preview interface
EVIS: A Physics-Grounded Event Camera Plugin for NVIDIA Isaac Sim
Linli Shi, Ruijun (Rex) Zhang, Ziyun Wang
Open-source software, 2026

High-rate event camera simulation accelerated by motion-vector frame interpolation, with HDR support, sensor noise models, motion blur, and tools for downstream training.

Match-Any-Events: Zero-Shot Motion-Robust Feature Matching Across Wide Baselines for Event Cameras
Ruijun (Rex) Zhang, Hang Su, Kostas Daniilidis, Ziyun Wang
European Conference on Computer Vision (ECCV), 2026

Zero-shot wide-baseline feature matching for event cameras, using motion-robust multi-timescale attention and sparsity-aware token selection. Improves on prior event matching methods by 37.7%.

Continuous-Time Human Motion Field from Events
Ziyun Wang, Ruijun Zhang, Zi-Yan Liu, Yufu Wang, Kostas Daniilidis
International Conference on Computer Vision (ICCV), 2025

Human motion as a continuous-time field from events. A recurrent, time-implicit network supports parallel pose queries at any temporal resolution, with 23.8% lower joint error and 69% less compute.

EqNIO teaser figure EqNIO: Subequivariant Neural Inertial Odometry
Royina Karegoudra Jayanth*, Yinshuang Xu*, Ziyun Wang, Evangelos Chatzipantazis, Daniel Gehrig, Kostas Daniilidis
International Conference on Learning Representations (ICLR), 2025

Neural inertial odometry that exploits roto-reflective symmetries in IMU data through equivariant, gravity-aligned canonicalization, improving displacement estimates on the TLIO, Aria, RIDI, and OxIOD benchmarks.

Event-based Continuous Color Video Decompression from Single Frames
Ziyun Wang, Friedhelm Hamann, Kenneth Chaney, Wen Jiang, Guillermo Gallego, Kostas Daniilidis
Event-based Vision Workshop, CVPR 2025

Continuous color video reconstructed from a single RGB frame and an event stream, combining long-range motion modeling with neural synthesis to outperform baselines by 3.61 dB PSNR.

Un-EVIMO: Unsupervised Event-based Independent Motion Segmentation
Ziyun Wang, Jinyuan Guo, Kostas Daniilidis
European Conference on Computer Vision (ECCV), 2024

Unsupervised event-based independent motion segmentation that uses geometric constraints to generate pseudo-labels, handles any number of moving objects, and is competitive with supervised methods on EVIMO.

Motion-prior contrast maximization overview Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation
Friedhelm Hamann, Ziyun Wang, Ioannis Asmanis, Kenneth Chaney, Guillermo Gallego, Kostas Daniilidis
European Conference on Computer Vision (ECCV), 2024

Self-supervised dense continuous-time motion estimation for event cameras, combining contrast maximization with non-linear motion priors to improve zero-shot real-world performance by 29% on EVIMO2.

TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos
Yufu Wang, Ziyun Wang, Lingjie Liu, Kostas Daniilidis
European Conference on Computer Vision (ECCV), 2024

Global trajectory and body motion of 3D humans from in-the-wild videos, combining robustified SLAM for camera motion with a video transformer for kinematic body regression.

Track Everything Everywhere Fast and Robustly
Yunzhou Song*, Jiahui Lei*, Ziyun Wang, Lingjie Liu, Kostas Daniilidis
European Conference on Computer Vision (ECCV), 2024

Test-time optimization for dense video point tracking with an invertible deformation network and foundation-model priors, over 10× faster and more robust than OmniMotion.

M3ED: Multi-Robot, Multi-Sensor, Multi-Environment Event Dataset
Kenneth Chaney*, Fernando Cladera*, Ziyun Wang, Anthony Bisulco, M Ani Hsieh, Christopher Korpela, Vijay Kumar, Camillo J Taylor, Kostas Daniilidis
Event-based Vision Workshop, CVPR 2023

An event camera dataset spanning ground vehicles, legged robots, and aerial platforms in challenging conditions, with synchronized stereo event cameras, LiDAR, IMU, and RTK.

EvAC3D: From Event-Based Apparent Contours to 3D Models via Continuous Visual Hulls
Ziyun Wang*, Kenneth Chaney*, Kostas Daniilidis
European Conference on Computer Vision (ECCV), 2022 · Oral Presentation (top 2.7% of papers)

3D reconstruction from event cameras via continuous visual hulls built from apparent contour events, producing high-fidelity meshes from real event sequences with per-event refinement.

EV-Catcher: High-Speed Object Catching Using Low-Latency Event-Based Neural Networks
Ziyun Wang*, Fernando Cladera*, Anthony Bisulco, Daewon Lee, Camillo J Taylor, Kostas Daniilidis, M Ani Hsieh, Daniel D Lee, Volkan Isler
IEEE Robotics and Automation Letters (RA-L), 2022

High-speed object catching with low-latency event-based neural networks and a binary event history image representation, reaching an 81% catch rate on balls at up to 13 m/s.

EventGAN input frame and simulated event output EventGAN: Leveraging Large Scale Image Datasets for Event Cameras
Alex Zhu, Ziyun Wang, Kaung Khant, Kostas Daniilidis
IEEE International Conference on Computational Photography (ICCP), 2021

GAN-based event simulation from image pairs with cycle-consistency losses, enabling object detection and pose estimation networks to train on large image datasets without real event labels.

Robot arm motion planning scene Learning to Generate Cost-to-Go Functions for Efficient Motion Planning
Jinwook Huh, Galen Xing, Ziyun Wang, Volkan Isler, Daniel D. Lee
Experimental Robotics: The 17th International Symposium, 2021

A higher-order function network that generates cost-to-go functions over configuration space, running orders of magnitude faster than planners that explore configuration space online.

Surface HOF dragon reconstruction Surface HOF: Surface Reconstruction from a Single Image Using Higher Order Function Networks
Ziyun Wang, Volkan Isler, Daniel D. Lee
IEEE International Conference on Image Processing (ICIP), 2020

Single-image surface reconstruction with a higher-order function network that maps unit-sphere samples to local tangent planes, generating surfaces at arbitrary resolution with few parameters.

Geodesic-HOF airplane reconstruction and method illustration Geodesic-HOF: 3D Reconstruction Without Cutting Corners
Ziyun Wang, Eric Mitchell, Volkan Isler, Daniel D. Lee
AAAI Conference on Artificial Intelligence, 2021

Single-view 3D reconstruction that lifts points into an embedding where Euclidean distance equals geodesic distance on the surface, improving surface normals and enabling unsupervised object decomposition.

Motion equivariant networks teaser figure Motion Equivariant Networks for Event Cameras with the Temporal Normalization Transform
Alex Zhu, Ziyun Wang, Kostas Daniilidis
arXiv preprint, 2019

A temporal normalization transform for event data that makes spatiotemporal convolutions equivariant to optical flow, removing the need for motion augmentation in classification.

Hybrid egomotion learning pipeline overview Robustness Meets Deep Learning: An End-to-End Hybrid Pipeline for Unsupervised Learning of Egomotion
Alex Zhu, Wenxin Liu, Ziyun Wang, Vijay Kumar, Kostas Daniilidis
Workshop on Deep Learning for Semantic Visual Navigation, CVPR 2019

A hybrid unsupervised egomotion pipeline combining learned optical flow and disparity with RANSAC outlier rejection and least-squares pose estimation, with automatic moving-object segmentation on KITTI.