Instance-aware Visual Language Map for Robot Navigation

IVLMap enables zero-shot instance level object goal navigation from natural language

Abstract

TODO: Put Abstract here!

Approach

IVLMap Creation

TODO: Put IVLMap Creation Content here!

Localizing Open-Vocabulary Landmarks

TODO: Put Localizing Open-Vocabulary Landmarks Content here!

Zero-Shot Instance Level Object Goal Navigation from Natural Language

TODO: Put Zero-Shot Instance Level Object Goal Navigation from Natural Language Content here!

Experiment

Dataset acquisition and 3D Reconstruction

We created an Interactive Dataset Collection Scheme by combining the cmu-exploration development environment with the Habitat simulator. This involves integrating cmu-exploration's autonomous exploration with Habitat robot agents for a unified dataset collection approach.

Multi-Object Navigation with given subgoals

TODO: Put Multi-Object Navigation with given subgoals Content here!

Zero-Shot Instance Level Object Goal Navigation from Natural Language

TODO: Put Zero-Shot Instance Level Object Goal Navigation from Natural Language Content here!