Ad hoc Data Loading - Append with Transformation

[AlixVezina]

Access the Data Loading Tools documentation here: Data Loading Tools | ArcGIS Solutions 

If you are looking for an ad hoc data loading process or processing single datasets, you may only need the Append with Transformation tool. This tool allows you to directly map and load your data from the source to the target, without needing the mapping workbooks.

This leverages the Append geoprocessing tool from ArcGIS Pro, which you may already be familiar with, but allows for a more detailed field mapping and the use of complex Expressions.

For example, shown in the image below, I need to load the Water Main features from a layer in my map into the Water Line layer.

Append with Transformation geoprocessing tool in ArcGIS Pro

   1. In the Geoprocessing pane, click the Toolboxes tab and browse to the Data Loading Tools toolbox[1] to open the Append With Transformation tool.

   2. Specify the location of the source dataset.

Map layers can be used as source data and, if a layer has a selection, only the selected records (features or table rows) are used by the tool.

   3. Specify the location of the target dataset.

If there are common field names in both the source and target datasets, the tool will automatically match them.

   4. Specify the Target Field and Expression parameters under the Field Mapping section.

Optionally, use the Code Block parameter for multiline Python expressions and call it in the Expression parameter to run. In this example, the GlobalID values are automatically generated when the data is loaded into the target layer.

   5. Click Run to append your source data into your target dataset with the defined transformations.

If you need to load multiple datasets into a new dataset, you will need to create a data loading workspace with a set of workbooks that can be iterated as your process evolves. This allows you to have a record of your mapping information so that it can be fine-tuned or revisited as needed.

To learn more about source to target mapping using the data loading workspace, check out this video: Source to Target Mapping for Data Loading 

[1]  Set the Stage for Data Loading to install this toolbox in ArcGIS Pro.

[Aaron_Seifert_GISP]

Hello @AlixVezina,

I believe this tool is quite similar to the Load Data Tool (Append).  I get to this tool in the Catalog Pane of ArcGIS Pro by right-clicking on a geodatabase feature class.  I think this is mostly a fantastic tool and have been using it since I discovered it many years ago in ArcMap.

I use this tool to bring together multiple county datasets into one feature class for use within our Computer Aided Dispatch system for locating addresses in emergency fire and medical calls.

However there are some shortcomings:

1. In ArcMap, within the Field Map portion of this tool, it was nice to see the attribute fields in the same order as displayed in the attribute table.  Also it displayed the same field names as well.  In ArcPro the field list is alphabetical and is not using the field aliases - or not sure what it uses.  This gets down right confusing on choosing the Source fields to import my data into fields to the target dataset. If there could be a choice to use the feild order or alphabetical order that would be a big improvement.  As for the field names it is hard to describe what to fix or provide options.

2. In many other geoprocessing tools we can save out a .cal file to later import for the next time we run a tool.  It would be EXTREMELY helpful to be able to save out the field mapping to something like a .cal file.  This combined with the first point would make this tool so much better.