Publications

2025

  1. roshi.gif
    RoSHI: A Versatile Robot-oriented Suit for Human Data In-the-Wild
    Wenjing Mao, Jefferson Ng, Luyang Hu, Daniel Gehrig, and Antonio Loquercio
    ICRA 2026(under review), 2025

    We present RoSHI, a low-cost wearable that fuses 9 IMUs with Aria glasses to capture full-body motion, articulated hands, and egocentric video. Our design emphasizes long-horizon stability and occlusion robustness for humanoid learning. We introduce a simulation-in-the-loop retargeting framework that converts human data into physically feasible robot actions. 61.9% of captured sequences successfully deployed on a Unitree G1 humanoid, providing a scalable foundation for human-to-humanoid imitation learning.

  2. eureka.png
    EUREKAWORLD: Scalable Real-World Manipulation via LLM-Automated RL
    Luyang Hu, others, Dinesh Jayaraman, and Osbert Bastani
    RSS 2026(expected submission), 2025

    We present Eureka for Manipulation, a large-scale RL framework that integrates LLMs to automate environment setup, reward shaping, and curriculum design for dexterous manipulation. Leveraging multi-GPU compute, our system couples LLM-guided simulation construction with massive RL optimization to generate diverse digital twins and achieve zero-shot sim-to-real transfer. We demonstrate robust transfer across manipulation tasks from single-arm tool use to bimanual coordination, and propose a paradigm for scalable reproducibility.

2024

  1. pinfonav.gif
    Persona-Nav: A Large-Scale Personalized Household Navigation Dataset Generated by LLMs
    Luyang Hu, Yichi Zhang, and Joyce Chai
    ICML 2026 (expected submission), 2024

    We present a large-scale household navigation dataset of 2,700+ houses with personalized semantics reflecting resident identities, preferences, and relationships. Using LLM-driven top-down generation, we create environments where robots navigate via user-centric queries (e.g., "the owner’s favorite mug") rather than generic spatial commands. This work bridges spatial navigation and context-aware behavior, enabling human-aligned embodied intelligence in personalized home environments.