Migrating metadata scripts from ArcMap to ArcGIS Pro

Python scripts that are used to manage metadata in ArcGIS Desktop must be modified before you can run them in ArcGIS Pro. The sections below cover the significant changes between the tools offered in ArcGIS Desktop in the Conversion toolbox, and the capabilities available in arcpy.metadata.

メモ:

The capabilities provided in ArcGIS Desktop by the XML Schema Validation and Validate Metadata tools are not yet available in ArcGIS Pro. These capabilities will be added in a future release.

Export metadata

The capabilities of the ArcGIS Desktop Export Metadata tool are now available from the arcpy.metadata exportMetadata function. Scripts written for ArcGIS Desktop that used the following translators should be updated to use the appropriate metadata export option, as indicated below.

ArcGIS Desktop translator	ArcGIS Pro metadata_export_option
ARCGIS2FGDC.xml	FGDC_CSDGM
ARCGIS2ISO19139.xml	ISO19139
ARCGIS2ISO19139gml321.xml	ISO19139_GML32

The following sample demonstrates how to export an item's metadata to an FGDC CSDGM-format metadata XML file using ArcGIS Desktop:

import arcpy
import os

dir = arcpy.GetInstallInfo("desktop")["InstallDir"]
translator = os.path.join(dir, "Metadata/Translator/ARCGIS2FGDC.xml")
source_item = "C:/data/data.gdb/roads"
output_file = "C:/data/roads_csdgm.xml"
arcpy.ExportMetadata_conversion(source_item,translator, output_file)

The following sample demonstrates how to export an item's metadata to an FGDC CSDGM-format metadata XML file using ArcGIS Pro:

import arcpy
from arcpy import metadata as md

src_item_md = md.Metadata("C:/data/data.gdb/roads")
output_file = "C:/data/roads_csdgm.xml"
src_item_md.exportMetadata(output_file, 'FGDC_CSDGM')

Import and copy metadata

The capabilities of the ArcGIS Desktop Import Metadata tool are now available from the arcpy.metadata importMetadata function. Scripts written for ArcGIS Desktop that used the following import type settings should be updated to use the appropriate import option, as indicated below.

ArcGIS Desktop Import_Type	ArcGIS Pro import_option
FROM_ARCGIS	ARCGIS_METADATA
FROM_FGDC	FGDC_CSDGM
FROM_ISO_19139	ISO19139_UNKNOWN

The following sample demonstrates how to import the contents of a FGDC CSDGM-format metadata XML file that describes some data to an item that represents the same data using ArcGIS Desktop:

import arcpy

csdgm_file = "C:/data/roads_csdgm.xml"
target_item = "C:/data/data.gdb/streams"
arcpy.ImportMetadata_conversion(csdgm_file, "FROM_FGDC", target_item)

The following sample demonstrates how to import the contents of a FGDC CSDGM-format metadata XML file that describes some data to an item that represents the same data using ArcGIS Pro:

import arcpy
from arcpy import metadata as md

src_csdgm_file = "C:/data/roads_csdgm.xml"
tgt_item_md = md.Metadata("C:/data/data.gdb/streams")
tgt_item_md.importMetadata(csdgm_file,"FGDC_CSDGM")
tgt_item_md.save()

Save changes to an item's metadata

The capabilities of the ArcGIS Desktop Metadata Importer tool are now available from the arcpy.metadata copy function. This function should be used to transfer content in the ArcGIS metadata format from one item to another, such as from a metadata template to a feature class.

The following sample demonstrates how to copy content from an ArcGIS metadata template to another item using ArcGIS Desktop:

import arcpy

src_template = "C:/data/arcgis_template.xml"
target_fc = "C:/data/data.gdb/streams"
arcpy.MetadataImporter_conversion(src_template, target_fc)

The following sample demonstrates how to copy content from an ArcGIS metadata template to another item using ArcGIS Pro:

import arcpy
from arcpy import metadata as md

src_template_md = md.Metadata("C:/data/arcgis_template.xml")
tgt_item_md = md.Metadata("C:/data/data.gdb/streams")
tgt_item_md.copy(src_template_md)
tgt_item_md.save()

Synchronize metadata content

The capabilities of the ArcGIS Desktop Synchronize Metadata tool are now available from the arcpy.metadata synchronize function.

The following sample demonstrates how to update the properties of the item that are stored in its metadata using ArcGIS Desktop:

import arcpy

source_item = "C:/data/data.gdb/roads"
arcpy.MetadataImporter_conversion(source_item, "ALWAYS")

The following sample demonstrates how to copy content from an ArcGIS metadata template to another item using ArcGIS Pro:

import arcpy
from arcpy import metadata as md

src_item_md = md.Metadata("C:/data/data.gdb/roads")
src_item_md.synchronize("ALWAYS")

Upgrade metadata

The capabilities of theArcGIS Desktop Upgrade Metadata tool are now available from the arcpy.metadata upgrade function.

The following sample demonstrates how to update an archived item's metadata to the ArcGIS metadata format using ArcGIS Desktop:

import arcpy

source_item = r'C:\Data\Old.gdb\Buildings'
arcpy.UpgradeMetadata_conversion(source_item, "FGDC_TO_ARCGIS")

The following sample demonstrates how to update an archived item's metadata to the ArcGIS metadata format using ArcGIS Pro:

import arcpy
from arcpy import metadata as md

archive_item_md = md.Metadata(r'C:\Data\Old.gdb\Buildings')
archive_item_md.upgrade('FGDC_CSDGM')

Save a copy of an item's metadata, or filter its content

The capabilities of the ArcGIS Desktop XSLT Transformation tool are now available from the arcpy.metadata saveAsXML and saveAsUsingCustomXSLT functions.

Some common operations for managing metadata were supported in ArcGIS Desktop through XSLT stylesheets that were provided with the software. These stylesheets were used with the XSLT Transformation tool to make the desired changes to an item's metadata, save copies of an item's metadata, or generate different types of output. Many of these operations continue to be available in ArcGIS Pro as described below. The capabilities are now built into ArcGIS Pro instead of being provided as XSLT stylesheet resources.

Save a copy of an item's metadata

The capabilities that were provided in ArcGIS Desktop via the XSLT stylesheets listed below are now available ArcGIS Pro from the arcpy.metadata saveAsXML function. Instead of specifying an XSLT stylesheet file, specify the corresponding save as XML option, as indicated below.

ArcGIS Desktop XSLT stylesheet	ArcGIS Pro metadata_save_as_xml_option
exact copy of.xslt	EXACT_COPY
remove local storage info strict.xslt	REMOVE_ALL_SENSITIVE_INFO
remove local storage info.xslt	REMOVE_MACHINE_NAMES
generate metadata template.xslt	TEMPLATE

The following sample demonstrates how to save a copy of an item's metadata to an ArcGIS metadata format XML file, and also a version of the same item's metadata that is filtered to remove any machine names that may be present using ArcGIS Desktop:

import arcpy
import os

source_item = "C:/data/data.gdb/roads"
dir = arcpy.GetInstallInfo("desktop")["InstallDir"]

# Save an exact copy of the item's ArcGIS metadata
xslt_copy = os.path.join(dir, "Metadata/Stylesheets/gpTools/exact copy of.xslt")
output_copy = "C:/data/roads_copy.xml"
arcpy.XSLTransform_conversion(source_item, xslt_copy, output_copy)

# Save a copy where metadata content is filtered to remove machine names
filter = dir + "Metadata/Stylesheets/gpTools/remove local storage info.xslt"
output_filtered = "C:/data/roads_filtered.xml"
arcpy.XSLTransform_conversion(source_item, filter, output_filtered)

The following sample demonstrates how to save a copy of an item's metadata to an ArcGIS metadata format XML file, and also a version of the same item's metadata that is filtered to remove any machine names that may be present using ArcGIS Pro:

import arcpy
from arcpy import metadata as md

src_item_md = md.Metadata("C:/data/data.gdb/roads")

# Save an exact copy of the item's ArcGIS metadata
output_copy = "C:/data/roads_copy.xml"
src_item_md.saveAsXML(output_copy)

# Save a copy where metadata content is filtered to remove machine names
output_filtered = "C:/data/roads_filtered.xml'
src_item_md.saveAsXML(output_filtered, 'REMOVE_MACHINE_NAMES')

メモ:

Additional XSLT stylesheets were provided with ArcGIS Desktop to perform operations such as removing thumbnails or geoprocessing history from an item's metadata. These capabilities will be provided in ArcGIS Pro in a future release.

Custom XSLT

Custom XSLT stylesheets can be created to generate HTML files that can be used on an organization's website, for example, to share metadata describing maps and datasets that are available. Custom XSLT stylesheets can also be used to modify an item's ArcGIS metadata content, for example, to update contact information or access and use constraints.

The following sample demonstrates how to save a copy of an item's metadata to an ArcGIS metadata format XML file using a custom XSLT stylesheet that removes some of the item's original metadata content as part of the process:

import arcpy
import os

source_item = "C:/data/data.gdb/roads"
dir = arcpy.GetInstallInfo("desktop")["InstallDir"]

# Save copy of the item's ArcGIS metadata that is filtered to remove geoprocessing history
xslt_no_gp_history = os.path.join(dir, "Metadata/Stylesheets/gpTools/remove_gp_history.xslt")
output_no_gp_history = "C:/data/roads_copy.xml"
arcpy.XSLTransform_conversion(source_item, xslt_no_gp_history, output_no_gp_history)

The custom XSLT stylesheet used in the above example is provided with ArcMap to use with the ArcGIS Desktop XSLT Transformation tool to remove the item's geoprocessing history from its metadata. This XSLT and the script above will run successfully in ArcGIS Pro if you have ArcMap installed. You can substitute your own custom XSLT in its place in the above example to make your own modifications to an item's metadata as it is saved to a stand-alone XML file.

The following sample demonstrates how to save a copy of an item's metadata to an ArcGIS metadata format XML file using a custom XSLT stylesheet that filters out the item's geoprocessing history using ArcGIS Pro:

import arcpy
import os

from arcpy import metadata as md
src_item_md = md.Metadata("C:/data/data.gdb/roads")

# Save copy of the item's ArcGIS metadata that is filtered to remove geoprocessing history
output_file = "C:/data/roads_no_gp_history.xml"
dir = arcpy.GetInstallInfo("desktop")["InstallDir"]
xslt_no_gp_history = os.path.join(dir, "Metadata/Stylesheets/gpTools/remove_gp_history.xslt")
src_item_md.saveAsUsingCustomXSLT(output_file, xslt_no_gp_history)

メモ:

The following operations are all accomplished using XSLT stylesheets that process an item's ArcGIS metadata. The Microsoft .NET Framework's XSLT processor is used to perform the transformation in all of the following scenarios.

• ArcGIS Desktop metadata tool XSLT Transformation, and some of the options used with the Import Metadata and Export Metadata tools.
• The Save As, Import, Export, and Upgrade options that are available in ArcGIS Pro on the Catalog tab on the ribbon in the Metadata group when the catalog view is active.
• The ArcGIS Pro .NET SDK methods SaveMetadataAsXML, SaveMetadataAsUsingCustomXSLT, and SaveMetadataAsHTML, ExportMetadata, ImportMetadata, and UpgradeMetadata.

However, the arcpy.metadata module's saveAsXML, saveAsUsingCustomXSLT, importMetadata, exportMetadata, and upgrade functions are all accomplished using the Microsoft Core XML Services (MSXML) XSLT processor. As a result, some XSLT stylesheets that run successfully when the .NET Framework executes the transformation may not run successfully when the same XSLT stylesheet is used with the arcpy.metadata module, and vice versa.

Some XSLT stylesheets that are provided with ArcGIS Desktop whose capabilities are not available yet in ArcGIS Pro will work successfully with the arcpy.metadata saveAsWithCustomXSLT function, including remove thumbnail.xslt and remove geoprocessing history.xslt. However, some stylesheets, such as the ones that generate HTML files for display, will not work because the required .NET Framework XSLT functions or custom ArcGIS Desktop XSLT functions are not available when the MSXML XSLT processor is used to perform the transformations.

Edit metadata for many ArcGIS items

The arcpy Metadata object has properties that allow you to access and modify the basic information that is displayed on the item details page when an item is published to ArcGIS Online. However, often the metadata content you need to add or update is more detailed. Performing these operations can be accomplished with Python packages such as xml.etree.ElementTree, PyXML, and lxml.

The ArcMap help provides an example of how to accomplish these updates using ElementTree in the following location: Update metadata with Python scripts. This example has been updated below to show how that script can be adapted to perform the same updates in ArcGIS Pro:

Batch update metadata for a list of datasets. This script is designed to be run as a script tool.

import os
import sys
import xml.etree.ElementTree as ET
import arcpy
from arcpy import metadata as md

# Script arguments...
Source_Metadata = arcpy.GetParameter(0)

# Local variables
#    new purpose text
newPurpose = "This is new text for an existing Purpose metadata element."
newCredits = "This is text for a new Credits metadata element."


# function to update purpose and credits in metadata
def update_metadata(root):
    num_elements = 0

    # modify purpose element's text
    # there is only supposed to be one purpose element in metadata
    # replace purpose element text if element exists
    # if element doesn't exist, do nothing
    purposeEls = root.findall(".//idPurp")
    for element in purposeEls:
        if element.text is not None:
            element.text = newPurpose
            num_elements += 1

    # add credits element to dataIdInfo parent, if the parent exists
    # ISO allows many dataIdInfo groups; ArcGIS supports only one, so get the 1st
    # ISO allows many idCredit elements, and many are supported in ArcGIS
    # append a new idCredit element with appropriate text, existing elements remain
    dataIdInfoEls = root.findall("./dataIdInfo[1]")
    for element in dataIdInfoEls:
        if element:
            newCreditEl = ET.SubElement(element, "idCredit")
            newCreditEl.text = newCredits
            num_elements += 1

    return num_elements


# get and save item metadata
for item in Source_Metadata:
    arcpy.AddMessage("Item: {0}".format(item))
    
    # get the item's metadata xml
    item_md = md.Metadata(item)
    metadata_xml_string = item_md.xml
    
    # create an ElementTree object from the metadata XML string
    root = ET.fromstring(metadata_xml_string)

    # call the update_metadata function to modify the item's metadata
    changes = update_metadata(root)
    
    if changes > 0:
        # get modified XML
        updated_xml_string = ET.tostring(root, encoding="utf-8")
        
        # import result back into metadata 
        arcpy.AddMessage("Saving updated metadata with the item...")
        item_md.xml = updated_xml_string
        item_md.save()
    else:
        arcpy.AddMessage("No changes to save")


arcpy.AddMessage('Finished updating metadata for all source metadata items')

ArcGIS Desktop tools that will not be available in ArcGIS Pro

Some tools that were available in ArcGIS Desktop will not be migrated to ArcGIS Pro.

USGS MP Metadata Translator

The USGS MP Metadata Translator tool provides limited access to the capabilities provided by the USGS's metadata parser utility, mp. For example, it would only accept XML files as input. You could not perform operations such as converting a structured text file to an FGDC CSDGM-format XML file. However, when the same utility is accessed directly from Python, all of mp's capabilities are available. Additionally, the version of mp that is provided with ArcGIS Desktop is out of date. Download the most recent version of the USGS's metadata parser utility, mp, from the website, then run it in your Python script using os.system as illustrated below:

Use the USGS metadata parser utility, mp, to convert a structured text file to an FGDC CSDGM-format XML file.

import os

csdgm_xml_file = "D:/Metadata_Pro/arcpy/Map_current_csdgm.xml"
csdgm_txt_file = "D:/Metadata_Pro/arcpy/Output/csdgm_to_text.txt"
runCmd = "D:/Metadata_Pro/arcpy/mp.exe " + csdgm_txt_file + " -x " + csdgm_xml_file
print(runCmd)
os.system(runCmd)

Esri Metadata Translator

All transformations between the ArcGIS metadata XML format and standards-based XML formats are accomplished using XSLT transformations in ArcGIS Pro. The Esri Metadata Translator tool instead used code to convert metadata from one format to another.

This conversion mechanism would produce messages that were difficult to understand such as Validation failed: em:Metadata($a) --> em:contact($a, $b), em:CI_ResponsibleParty($b) and Error [InvalidForSome]: <MD_Metadata> for-some clause: em:contact(v:Metadata, v:Object) <contact>. The transformations used in ArcGIS Pro to import and export metadata will produce messages of this type.

Export Metadata Multiple and Validate Metadata Multiple

The Export Metadata Multiple and Validate Metadata Multiple tools were provided to support buttons on the ArcCatalog Metadata toolbar. These capabilities are supported in ArcGIS Pro without the need for these tools.

In an ArcGIS Pro Python script, you can export (and in the future validate) metadata for many items by accessing datasets and files using the arcpy list functions, and accessing maps and layers using the arcpy.mp list functions. Use the appropriate arcpy.metadata function to manage metadata for the items returned by those lists.

Metadata Publisher

The Metadata Publisher tool was provided in ArcGIS Desktop to publish metadata to an ArcIMS Metadata Service. ArcIMS has been retired.