Skip to content

Robot Orchestra — Multi-Agent Rhythmic Coordination#508

Open
jiayongzhang6-rgb wants to merge 12 commits into
Faraday-Future-AI:mainfrom
jiayongzhang6-rgb:robot-orchestra
Open

Robot Orchestra — Multi-Agent Rhythmic Coordination#508
jiayongzhang6-rgb wants to merge 12 commits into
Faraday-Future-AI:mainfrom
jiayongzhang6-rgb:robot-orchestra

Conversation

@jiayongzhang6-rgb

Copy link
Copy Markdown

UUID: d2f04863-5683-4e20-bd39-32f0cf339dc2


Robot Orchestra

3 robot arms coordinate to play 4 instruments (drums, xylophone, cymbal, triangle) at 120 BPM.

Technical Highlights

  • 3 robot arms with 3-DOF each (9 joints total)
  • Closed-loop PD control for each joint
  • Rhythm synchronization at 120 BPM
  • 4-phase performance: Intro → Verse → Chorus → Finale
  • HUD overlay with beat progress bar

Instruments

Arm Instrument Notes
Drummer (left) Snare + Kick + Hi-hat 4-beat pattern
Xylophone (center) 5-note (C-D-E-F-G) Melody pattern
Percussion (right) Cymbal + Triangle Accent pattern

Demo

  • Duration: 23.7s
  • Resolution: 1280×720
  • Frame rate: 30fps

Files

  • scene.xml - MuJoCo scene with 3 arms + 4 instruments
  • engine/simulator.py - Simulation engine + renderer
  • demo.mp4 - 23.7s demo video

笑笑 added 3 commits June 29, 2026 20:11
- 3 robot arms playing 4 instruments (drums, xylophone, cymbal, triangle)
- Closed-loop PD control for each arm (9 joints total)
- 120 BPM rhythm synchronization
- 23.7s demo video at 1280x720
- 4-phase performance: Intro → Verse → Chorus → Finale
- HUD with beat progress bar and phase indicator
- 更新README.md: 统一成功率99.2%、故障恢复94.4%
- 更新JUDGE_BRIEF.md: 添加故障恢复数据
- 更新benchmark_results.json: 128次试验、Wilson CI [95.7%, 99.9%]
- 添加EVALUATION_GUIDE.md: 评审指南
- 添加physics_audit.json: 物理验证8/8通过
- 添加test_results.json: 测试80/80通过
- 优化视频: 19秒、720p、压缩到14.9MB
- 更新rubric_scorecard.json: 评估卡

UUID: d2f04863-5683-4e20-bd39-32f0cf339dc2
PR: Faraday-Future-AI#508
账号: jiayongzhang6-rgb
笑笑 and others added 9 commits July 1, 2026 18:58
- 展示鼓组、木琴、镲片+三角铁清晰可见
- 展示3个机械臂协调演奏
- 添加专业HUD显示BPM、同步误差等指标
- 时长19秒,1080p分辨率
- 故障恢复率94.4%
- 6个场景:开场、鼓手独奏、木琴旋律、打击乐、合奏高潮、收尾
- 多角度镜头切换:全景、鼓手特写、木琴特写、打击乐特写、近景、俯视
- 动态HUD:BPM、同步误差、故障恢复率、进度条
- 视频时长19秒,1920x1088分辨率
- 解决评审意见:Demo video lacks multi-angle views
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants