To enable the development of intelligent robotic systems, Facebook has OSS’ed droidlet – a modular, heterogeneous embodied agent architecture and platform for building embodied agents. Droidlet makes it easier for users to experiment with and integrate SOTA NLP, computer vision, and other ML algorithms in embodied and/or robotic systems. Each droidlet agent includes a memory system, perception modules, set of lower-level tasks, and controller. These modules may be composed of heuristic and/or learned components (which may be trained on static or dynamic data) and can be altered to support each robot’s physical architecture and sensor requirements. Droidlet also features an interactive dashboard with debugging and visualization capabilities.