Projects

CUHK-X

CUHK-X brings together multimodal sensing, datasets, and benchmarks to study how people act in everyday environments. The goal is to help models recognize actions, understand their context, and reason about what may happen next.

The dataset contains 64,267 samples of 40 actions from 30 participants across two indoor environments. It combines seven synchronized modalities: RGB, depth, infrared, thermal, IMU, mmWave radar, and skeleton. Its benchmarks cover human action recognition (HAR), understanding (HAU), and reasoning (HARn).

CUHK-X Challenge (Co-located with UbiComp/ISWC 2026) ↗

A Large-Scale Multimodal Dataset and Benchmarks for Human Activity Scene Understanding and Reasoning

Siyang Jiang, Mu Yuan, Xiang Ji, Bufang Yang, Zeyu Liu, Lilin Xu, Yang Li, Yuting He, Liran Dong, Wenrui Lu, Zhenyu Yan, Xiaofan Jiang, Wei Gao, Hongkai Chen, Guoliang Xing

ACM MobiSys 2026

Introduces the CUHK-X dataset and benchmarks for recognizing, understanding, and reasoning about human activities.

PDF | Code | Project Page

MACS — a Portable System for Multimodal Activity Recording with Built-In Annotation

Bohan Liu, Siyang Jiang, Mu Yuan, Hongkai Chen, Guoliang Xing

ACM MobiSys 2026 Demo

A portable system that synchronizes multimodal activity recordings and supports annotation during data collection.

Paper