Available for an ArcGIS organization licensed with the IPS extension.
Assessing the quality of an ArcGIS IPS deployment is important to the user experience in your facility. The quality assessment workflow provides insights into how ArcGIS IPS is performing in different areas of your environment. You can run this assessment for several positioning files. The results allow you to compare the performance of each of the positioning files you have created.
After quality assessment, you can go back on-site, perform new survey recordings for that area, and generate a new positioning file. With the new positioning file in place, you can perform a second assessment and compare the results with previous results to verify improved quality.
ArcGIS IPS quality recording
The first step in the quality assessment workflow is to collect quality recordings. This procedure is similar to the collection of survey recordings, but a positioning file must already be in place. Follow the instructions to collect quality recordings for iOS or Android devices.
As you perform a quality recording with the ArcGIS IPS Setup app, the active positioning file is used by the ArcGIS IPS engine to compute your real-time position and stores it with the recording data.
Quality measures are generated along the trajectory of the quality recordings. It is recommended that you perform as many quality recordings as necessary to properly cover the area.
Create an ArcGIS IPS quality dataset
The ArcGIS IPS quality dataset contains the following feature classes that are required to store a quality assessment:
- Computed Positions—Indoor positions computed by the ArcGIS IPS engine while performing a quality recording
- Reference Positions—Actual positions of the surveyor while performing a quality recording
You can generate an ArcGIS IPS quality dataset using the Create IPS Quality Dataset tool in ArcGIS Pro.
Complete the following steps to create an ArcGIS IPS quality dataset for a map in ArcGIS Pro:
- Open the map in ArcGIS Pro.
- On the Analysis tab, click Tools
.The Geoprocessing pane appears.
- In the Geoprocessing pane, click the Toolboxes tab.
- Expand Indoor Positioning Tools and expand Quality Assessment.
- Click the Create IPS Quality Dataset tool.
The Create IPS Quality Dataset tool opens in the Geoprocessing pane.
- Click Browse
next to the Target Workspace parameter and browse to and choose the workspace where you want to create the quality dataset.Caution:
This tool honors the Allow geoprocessing tools to overwrite existing datasets geoprocessing options. If overwrite is enabled and the output quality dataset already exists in the target workspace, it is overwritten.
- Optionally, provide a coordinate system for the Spatial Reference parameter.
Note:
If no coordinate system is provided, WGS84 is used to create the quality dataset.
- For the Dataset Name parameter, provide a name for the quality dataset.
- Click Run.
A feature dataset with the provided coordinate system and name is created in the target workspace that contains the Reference Positions and Computed Positions feature classes.
You can now compute the positioning quality from the collected quality recordings.
Compute ArcGIS IPS positioning quality
To compute the positioning quality for a set of quality recordings, run the Compute Positioning Quality tool for a map in ArcGIS Pro.
- Open the map in ArcGIS Pro.
- On the Analysis tab, click Tools .
The Geoprocessing pane appears.
- In the Geoprocessing pane, click the Toolboxes tab.
- Expand Indoor Positioning Tools, expand Quality Assessment, and click the Compute Positioning Quality tool.
The Compute Positioning Quality tool opens in the Geoprocessing pane.
- For the Target IPS Quality Dataset parameter, provide the ArcGIS IPS quality dataset that you created in the previous section.
- For the IPS Recordings Features parameter, provide a feature layer that contains quality recordings.
- Optionally, provide values for the Sight Blocking Details Features parameter.
If no values are provided, the line of sight between reference and computed positions will not be computed.
- Click Run.
The tool extracts the real-time positions computed by the ArcGIS IPS engine and the surveyor's corresponding actual positions. These are stored in the Computed Positions and Reference Positions feature classes, respectively. Each computed position is associated with a unique reference position by a recording ID and time.
In every positioning file, each point in the Reference Positions feature class has associated information about the quality of the positioning performance at the specific location. This information can be used to compare a reference position with the corresponding computed position and the obstacles present in the environment.
The positioning performance is estimated using the following metrics:
- Level Match—A Boolean value that indicates whether the reference and computed positions are on the same level.
- LOS to Computed—A Boolean value that indicates whether the reference position is visible from the corresponding computed position. In the case of a floor mismatch, this is set to FALSE; otherwise, it is the result of a line-of-sight calculation in which the Sight Blocking Details Features values are considered obstacles. If no sight obstruction details are provided, the line of sight is not computed, and this field is set to NULL.
- Distance to Computed—The distance between the reference and computed positions. In the case of a floor mismatch, this is set to NULL; otherwise, it is the Euclidean distance between a computed position and its corresponding reference position.
- Level of Accuracy—A classification of the positioning accuracy based on the Distance to Computed field. In the case of a floor mismatch, this field is assigned Invalid; otherwise, it is assigned Low, Medium, or High.
Note:
The computed values are encoded in the DOM_IPS_QA_ACCURACY_LEVEL domain when the ArcGIS IPS quality dataset is created using the Create IPS Quality Dataset tool.
The possible combinations of the Level Match, LOS to Computed, and Level of Accuracy fields provide a qualitative assessment of the deployment as shown in the table below. Not all combinations of values are possible.
| Level Match | LOS to Computed | Level of Accuracy |
|---|---|---|
TRUE | TRUE | High |
TRUE | TRUE | Medium |
TRUE | TRUE | Low |
TRUE | FALSE | High |
TRUE | FALSE | Medium |
TRUE | FALSE | Low |
FALSE | FALSE | Invalid |
The accuracy level is a classification of the positioning accuracy based on the Distance to Computed field and the following threshold values:
| Distance to Computed | Level of Accuracy |
|---|---|
<5 m | High |
5 m - 10 m | Medium |
>10 m | Low |
The reference positions and computed positions features can be used to assess the ArcGIS IPS deployment.