This documentation reflects AI2-THOR version 2.1.0. For the latest AI2-THOR documentation, visit ai2thor.allenai.org.

Concepts

  • Agent: A capsule shaped entity that can navigate within scenes and interact with objects.

  • Scene: A scene within AI2-THOR represents a virtual room that an agent can navigate in and interact with. There are 4 scene Categories, each with 30 unique Scenes within them: Kitchen, Living Room, Bedroom, Bathroom.

  • Action: A discrete command for the Agent to perform within a scene (e.g. MoveAhead, RotateRight, PickupObject)

  • Sim Object: Objects that can be interacted with by the Agent. Objects have a range of interactions based on affordanced defined by the Object Type.

  • Object Visibility: An object is considered Visible when it satisfies three conditions: It must be within the Camera’s viewport, it must be within a threshold of distance from the Agent’s center (default: 1.5 meters), and a ray emitted from the camera must hit the object without first hitting another obstruction. Note that an object rendered in an image will not always be Visible to the Agent. For example, an object outside the 1.5 meter threshold could be seen in an image, but will be reported as not-visible to the Agent.

  • Object Interactability: An object is said to be Interactable if it is flagged as Visible and if it is unobstructed by any other objects. Most objects will be Interactable as long as they are also Visible, but some objects have transparency which can cause objects to be reported as Visible through them. An example is a Glass Shower Door with a Sponge object behind it. The glass door will be flagged as Visible and Interactable, but the sponge will only be Visible. Attempting to interact with the sponge will throw an error as it cannot be reached through the glass door, only seen.

  • Receptacle: A type of object that can contain another object. Some examples of receptacles are: TableTop, Cup, Sofa, Bed, Desk, Bowl, etc. Some Receptacles cannot be moved within the scene, and are mostly large objects that don’t make sense to move (Countertop, Sink, etc). Some Receptacles can also open and close (Microwave, Cabinet, Drawer, etc) while others can also be picked up and moved around by the Agent (Plate, Bowl, Box, etc.).

Next Steps

Continue on to the Scenes documentation.