随笔分类 - 6 具身智能
摘要:目录人形机器人基于动力学方法盲人行走法传感器+世界模型更多动作的训练?更难动作的训练?VLA模型数据Open X-Embodiment (OXE)仿真环境数据集大规模人类视频数据集评测核心指标:任务成功率 (Success Rate, SR)评测场景:仿真 vs. 真实世界泛化能力基准测试 (Gen
阅读全文
摘要:目录π0.5: a Vision-Language-Action Model with Open-World GeneralizationTL;DRMethodTraining RecipeData硬件配置Experiment效果可视化总结与思考相关链接 π0.5: a Vision-Languag
阅读全文
摘要:目录GR00T N1: An Open Foundation Model for Generalist Humanoid RobotsTL;DRMethodSystem2System1Training SettingDatahuman video数据pretrain方法神经轨迹生成流程仿真轨迹生成方
阅读全文
摘要:目录GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot ManipulationTL;DRMethod模型架构关于cVAEDatasetPre-train DatasetRobotic D
阅读全文
摘要:目录RT-1: ROBOTICS TRANSFORMER FOR REAL-WORLD CONTROL AT SCALETL;DRMethodinstructions与images模态特征处理TokenLearnerAction预测DataExperiment在新任务上Zero-shot泛化能力仿真
阅读全文
摘要:目录Helix: A Vision-Language-Action Model for Generalist Humanoid ControlTL;DRMethodMotivationSystem 2 (S2,慢系统)System 1 (S1, 快系统)DataExperiment效果可视化总结与思
阅读全文
摘要:目录RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic ControlTL;DRMethod模型Action表示Co-Fine-TuneReal-Time Inference如何实现连续运动控制训练数据Exper
阅读全文
摘要:目录π0: A Vision-Language-Action Flow Model for General Robot ControlTL;DRMethodPaliGemma VLM基座模型VLA多模态的对齐机制与Transfusion的联系Flow Matching生成如何在本文所介绍的VLA模型
阅读全文
摘要:目录UNLEASHING LARGE-SCALE VIDEO GENERATIVE PRE-TRAINING FOR VISUAL ROBOT MANIPULATIONTL;DRMethodPretrainRobot Data FinetuningExperiment总结与思考相关链接 UNLEAS
阅读全文
摘要:目录OpenVLA: An Open-Source Vision-Language-Action ModelTL;DRMethodaction表示Training DataImplementationInfrastructureExperiment效果可视化总结与思考相关链接Related work
阅读全文
摘要:目录Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained TransformersTL;DRMethodStemTrunkLossHeadExperiment训练资源效果可视化总结与发散相关链接资料查询 Scali
阅读全文
摘要:目录Embodied AI Tutorial课程内容Modeling and approaches for Embodied AIWorld ModelGet a Good PolicyPlanning And ControlSimulation technology for Embodied AI
阅读全文
摘要:目录Overview of Embodied AI (Part1)课程内容SimulatorsAssetsTask资料查询 Overview of Embodied AI (Part1) 课程主页:https://ai-workshops.github.io/building-and-working
阅读全文
摘要:展会见闻 从身体结构的维度 机械臂: 吸取小物体,放到另一个区域。机械弊对于这种任务在各种环境下都能精准完成,相对于人类有优势。 灵巧手: 看到各种自由度的手,手掌/手指正面覆盖了很多触觉传感器,有些甚至还布置了摄像头。 AGV: 仓库托运重物,物流机器人。 仿生机器人: 这类公司注重还原外形面部表
阅读全文