EnterWorks - ETT 130 - How to Generate a Delta File for a Full Import or Export Using Pre- and Post-Processing
Data Flow, Import Pre-Processing
A primary function of EnterWorks is to import data from external sources and export data to external targets. Usually, these imports and exports contain only the changes that have been made since the last import or export was processed. But sometimes the external sources are incapable of providing only the changes and must instead provide a full set of data, regardless of what has changed.
While EnterWorks can be configured to only export new or changed records, it cannot easily limit those records to ones that have changes in the columns that are included in the file. If other attributes are changed, the record will still be exported, but the values in the file for the record will be the same as values sent previously. Additionally, if records are deleted from EnterWorks, there isn’t a way to convey those deletions in the export – it is necessary to not delete the records but set a status that indicates they are no longer active, and that status needs to be included in the export.
The above limitations can be addressed by using a Pre/Post Processor that converts the full import or export file to a much smaller file that only contains the records that are new, modified or deleted. This session covers the use-cases where such a process is needed, how to deploy and configure it and how to use it within Scheduled Imports and Scheduled Exports.
Updates
| Date | Download |
| 10/16/2023 | Added source code to package |
| 04/04/2023 | Updated EW_GenerateDeltaFile.jar - added option to overlay deleted status on an existing column if the deleteColumnName matches an existing column in the file. For example, if one of the Data Columns is "Enable Status", and the deleteColumn is set to "Enable Status" and the deleteValue is set to "Inactive", then the existing value for "Enable Status" will be replaced with "Inactive" for any row that has been identified as being deleted. |
Prerequisites - BBS 066, BBS 067, BBS 068