Import images from 360-degree video

Available for an ArcGIS organization licensed with the Indoors extension.

You can import 360-degree images from an equirectangular .mp4 video file to an oriented imagery dataset using the 360 Video To Oriented Imagery tool. You can include floor-aware oriented imagery layers in your floor-aware maps to support visualization and navigation of indoor spaces in Indoors Viewer and ArcGIS Indoors Mobile apps.

The oriented imagery dataset can be used for spatially oriented 360-degree imagery. Oriented imagery uses camera location and orientation information to display directionally accurate 360-degree photos. This ensures that a north-facing view in the map is associated with a north-facing view in the image. Map Viewer and other viewers with the oriented imagery capability can display 360-degree images stored in an oriented imagery dataset.

Prerequisites for capturing 360 video data

Successful capture of stable equirectangular video may involve a combination of device position, camera settings, and settings for the processing software used to export the video.

Before capturing 360 video for import, consider the following prerequisites:

• Select a suitable device—Use a 360 degree camera equipped with two or more lenses.
• Adjust camera settings—Enable camera stabilization to reduce motion blur, and adjust exposure settings based on the lighting conditions of the environment.
• Position the camera—Hold the camera directly above the operator. For dual-fisheye cameras, consult the vendor's specifications for the best camera position.
• Plan a recording path—Record along a path that loops back on itself at least once, and move at a comfortable walking speed in open areas when recording 360 video. Slow down when navigating through doorways or tight spaces.
• Account for multifloor facilities—Capture a separate video recording for each floor to keep video file sizes smaller.
• Stabilize the recording—Captured video must provide a stable viewing experience, such that the horizon remains level and vertically centered. The center of the video must also stay consistently oriented in the same compass direction. Consult the vendor's documentation for available stabilization settings for the device and processing software.
• Export the video to MP4—After recording, use the vendor's software to export the captured video as an .mp4 file. The exported video should display equirectangular distortion when played back in a standard video player.

  

Export images from 360 video data to an oriented imagery dataset

To export images from a 360 video file for use in ArcGIS Indoors, complete the following steps:

1. Start ArcGIS Pro.
2. Sign in to your ArcGIS organization if necessary.
3. Optionally, add the Levels feature class from an Indoors workspace to the map.
4. If necessary, create an oriented imagery dataset using the Create Oriented Imagery Dataset tool.

   Note:

   The oriented imagery dataset must be z-enabled and should be in the same coordinate system as the Levels layer, if it is present in the map.

5. On the Analysis tab, click Tools .

   The Geoprocessing pane appears.

6. In the Geoprocessing pane, click the Toolboxes tab.
7. Expand Indoors Tools and click 360 Video To Oriented Imagery.

   The 360 Video To Oriented Imagery tool opens in the Geoprocessing pane.

8. For the Input 360 Video parameter, choose the input .mp4 file that contains the 360-degree video to be imported.
9. For the Target Oriented Imagery parameter, choose the target oriented imagery dataset that will be populated with the extracted photo features.

   The target oriented imagery dataset must be z-enabled. If the target oriented imagery layer is shared as a web layer, it must also have attachments enabled.

10. For the Target Image Folder parameter, choose the destination folder to which images will be extracted from the .mp4 file.

    Folders on local and network drives are supported.

11. Optionally, specify a value for the Control Point 1 parameter:
    1. Review the video and pause when the camera reaches an identifiable location on the map, such as a corridor intersection or landmark.

       Tip:

       To improve georeferencing accuracy, select video times that are at least 5 seconds from the start or end of the video. You can also identify camera locations on opposite sides of a level to improve accuracy.

    2. Type the video timestamp of the identified location in the Video Time text box, in HH:MM:SS.S format.
    3. Click edit to add a point to the map in a new layer representing the identified location.

       Tip:

       If you previously created a control point using the tool, you can select it in the drop-down menu next to the Camera Location parameter. The selected layer must contain only one control point feature, or a single point feature must be selected from the layer.

12. If you specified a value for the Control Point 1 parameter, repeat the steps for the Control Point 2 parameter.
13. Optionally, specify a value for the Input Levels Feature parameter to assign the LEVEL_ID value from the selected level feature to the level ID field of the output oriented imagery features.
14. For the Extraction Interval parameter, provide a value to specify a time interval at which you want images to be extracted along the video path.

    The default is 2 seconds.

15. For the Start Timestamp and End Timestamp parameters, provide values indicating the start and end times of the segment of video from which you want images to be extracted.

    By default, the tool will process the entire video.

16. Click Run.

    The tool creates point features in the oriented imagery dataset that contain file path information for where the images are stored in the target image folder.

    Note:

    If you choose an oriented imagery layer shared as a hosted feature service, the 360 Video To Oriented Imagery tool will also import images as feature attachments.

The images in the oriented imagery dataset are ready for inspection and can be shared as a service if necessary and used in floor-aware maps.

Inspect the oriented imagery

The 360 Video to Oriented Imagery tool uses visual simultaneous location and mapping (VSLAM) to determine the relative position of the output features. You can use the oriented imagery viewer to inspect the output features and make any necessary adjustments.

To inspect the oriented imagery features, complete the following steps:

1. Start ArcGIS Pro.
2. Open a floor-aware indoor map in a new or existing project.
3. Use the floor filter to navigate to the floor where the imported images were captured.
4. If needed, add the oriented imagery layer to the map.
5. Zoom to the extent of the oriented imagery layer.
6. Verify the oriented imagery features are positioned correctly:
   • If features are missing for a segment of the footage, or if features seem to drift out of position, you can try re-running the tool with adjusted extraction settings to process the affected segment of video footage.
   • If features are not positioned correctly relative to the indoor map, you can georeference all the features together using the Transform Features tool, or select and move features using the Move, Rotate, and Scale tools as needed.
7. Select the oriented imagery layer in the Contents pane. On the Oriented Imagery Layer tab of the ribbon, click Explore Images.

   The Oriented Imagery Viewer pane appears.

8. Click the map near one of the oriented imagery features.

   The 360-degree image associated with the feature opens in the Oriented Imagery Viewer pane. A red frustum appears on the map near the feature, indicating the portion of the image visible in the Oriented Imagery Viewer pane.

   Note:

   If the red frustum does not appear on the map, you can enable it by clicking Current Footprint on the Oriented Imagery Layer tab of the ribbon.

9. Pan to look in a known direction, such as along a corridor, and zoom the image all the way in.
10. Verify the image's Camera Heading field value is correct:

    If the frustum is pointing in a different direction than the image perspective, use the Measure Angle tool on the Map tab to determine the difference in viewing angle, and then use the Calculate Field tool to edit the Camera Heading field value.

    For example, if the frustum is pointing 23 degrees to the right of the actual view from the image, you would decrease the Camera Heading field value by 23 using the expression !CameraHeading! - 23 in the Calculate Field tool.

Enable floor-awareness for oriented imagery

Oriented imagery features must contain a LEVEL_ID field with values describing the building level the features are located on to display correctly in floor-aware maps and apps.

To add LEVEL_ID values to the georeferenced oriented imagery features, complete the following steps:

1. Start ArcGIS Pro.
2. Open a new or existing project containing a georeferenced oriented imagery layer.
3. Open the attribute table for the oriented imagery layer.
4. Add a text field, named LEVEL_ID.
5. Select the rows for the oriented imagery features you want to assign level ID values to.
6. Use the Calculate Field tool to update the LEVEL_ID values for the selected rows to the corresponding floor value in the Levels layer.

The LEVEL_ID values for the selected rows are updated. You can verify the change by setting the oriented imagery layer's Floor Field property in the layer Properties dialog box and then testing if the floor filter affects the displayed oriented imagery layer features in the map.

Share floor-aware oriented imagery as a service

You can use the Generate Service From Oriented Imagery Dataset tool to publish a hosted feature service from an oriented imagery dataset and add the extracted images as feature attachments. You can then add the oriented imagery feature layer to a floor-aware map and visualize your 360-degree images in apps including Indoors Viewer and Map Viewer.

To create a hosted oriented imagery layer and share it in a floor-aware web map, complete the following steps:

1. Start ArcGIS Pro.
2. Sign in to your ArcGIS organization if necessary.
3. Add the oriented imagery dataset to a new or existing map.
4. On the Analysis tab, click Tools .

   The Geoprocessing pane appears.

5. In the Geoprocessing pane, click the Toolboxes tab.
6. Expand Oriented Imagery Tools > Manage and click Generate Service From Oriented Imagery Dataset.

   The Generate Service From Oriented Imagery Dataset tool opens in the Geoprocessing pane.

7. Check the Add images as attachments check box to attach the extracted 360-degree images to their corresponding point features in the hosted feature layer.
8. Configure the remaining tool parameters as necessary.

   Note:

   A footprint layer is not required.

9. Click Run.

   The oriented imagery data is published as a hosted feature layer with image attachments as a feature service to the active ArcGIS organization.

10. Add the published oriented imagery layer to an existing floor-aware web map from the Portal tab of the Catalog pane, or to a new floor-aware map.
11. Configure the oriented imagery layer as floor-aware.
12. Save the map if using an existing web map, or share the new map to your ArcGIS organization.

You can open the web map in Map Viewer and view 360-degree images using the oriented imagery viewer. You can also use the web map to create apps that support oriented imagery.