🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

UnrealCV: Connecting Computer Vision to Unreal Engine

A library for differentiable nonlinear optimization

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥

SAPIEN Manipulation Skill Framework, a GPU parallelized robotics simulator and benchmark

[Embodied-AI-Survey-2024] Paper list and projects for Embodied AI

Unified Reinforcement Learning Framework

[CVPR 2024 Highlight] GenAD: Generalized Predictive Model for Autonomous Driving & Foundation Models in Autonomous System

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

具身智能入门指南

Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Google Robot, WidowX+Bridge)

A universal summary of current robotics simulators

🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses

A curated list of awesome papers on Embodied AI and related research/industry-driven resources.

Open Platform for Embodied Agents

Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"

[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"

[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"