Available with Advanced license.
Available with Image Analyst license.
Interactive object detection is a tool that uses a trained deep learning model to recognize objects displayed in a map or scene. Each identified feature is represented by a point feature with a location in the coordinate system of the map. Interactive object detection also stores attributes detailing the orientation and extent of the object, as well as its confidence value as a likely match. It is designed for on-demand detection of objects in the current view.
To detect objects, on the Analysis tab, in the Workflows group, expand the Exploratory 3D Analysis gallery, and click Object Detection 
to open the Exploratory Analysis pane and activate the Object Detection tool. Review the parameters and select a creation method to use the tool.
This tool requires the installation of the Deep Learning Libraries prior to being run.
License:
The interactive object detection tool requires either an ArcGIS Pro Advanced license or the ArcGIS Image Analyst extension.
There are two creation methods for setting the view:
- Current Camera—Detect objects by applying the current camera position. Ideally, you have navigated and positioned the camera perspective as precisely as you can.
- Reposition Camera (3D only)—Detect objects in the current scene by adjusting the camera either horizontally or vertically on the viewpoint. Ideally, you have navigated and set up the view as best you can, then the camera will reposition for final refinement.
Current Camera
Detect objects for the current camera position. Objects are detected based on the parameters defined in the Exploratory Analysis pane. This is the default creation method.
Use the following steps to detect objects using the current camera position:
- Navigate using the Explore tool
to set the perspective of the scene on the region of interest, where objects are to be detected.
- On the Exploratory Analysis pane, under the Create tab, select Current Camera
from the Creation Method options. - Review or optionally update the Deep Learning Model and Output parameters.
- Click Apply.
The Current Camera method remains active to continue detecting objects. You can navigate to a different area and detect objects again. This ensures that the model does not need to be reloaded and the results are returned faster. If you use a different Deep Learning Package (.dlpk) model, it will reload.
Reposition Camera
Detect objects in the current 3D view by setting a viewpoint and repositioning the camera to look at that viewpoint. Objects are detected based on the parameters defined in the Exploratory Analysis pane.
This method allows you to set the camera to have a view direction before performing the object detection. For example, choose a horizontal view direction if you click a building facade where you want to detect windows. A vertical view direction would be useful for a top-down camera angle, such as detecting pools. The camera automatically adjusts.
Tip:
This method is not intended to bring far away objects up close.
Use the following steps to detect objects by repositioning the camera to look at the viewpoint:
- In the Exploratory Analysis pane, under the Create tab, select Reposition Camera from the Creation Method options.
- Optionally, change the View Direction to either Horizontal or Vertical.
- Review or optionally update the Deep Learning Model and Output parameters.
- Click in the scene. The camera moves so that the horizontal or vertical viewpoint is the clicked point. You should be reasonably close to the object of interest, rather than trying to bring a far away object up close.
The object detection runs and the detected objects are added to the output feature layer.
The Reposition Camera method remains active to continue detecting objects. Click to define another viewpoint and detect objects again.