Synchronizing DDL Changes Using Scheduled Task

Version

Application Scenario

You have created scheduled synchronization tasks using Data Development and want to be informed of DDL changes in the source data table for prompt processing and notify other users.

Function Description

You can be prompted for DDL changes in the source data table of a scheduled task and notify specified users.

You can process the target table fields to update the target table structure on the task configuration page.

DDL Change Detection

After you enable DDL Change Detection, the source table structure is compared with the target table structure configured in the current node during each execution to detect the changes. Enable Result Notification in Task Control to automatically notify the specified user if DDL changes.

Detectable DDL changes include adding, deleting, and renaming the field, as well as modifying the field type or length in the source table.

Field Mapping Update

If you select SQL Server, Oracle, PostgreSQL, or MySQL databases as the data source, you will be prompted to update the field mapping when the source table structure is changed, as shown in the following figure.

Note:

This function is also applicable to the DB Table Output operator.

Click Update Field Mapping to view the changes of added, deleted, and modified fields. Click OK to update the field mapping according to the changes, as shown in the following figure.

The following table displays the categories of field mapping updates:

Target Table Update

If Existing Table is selected as the target table and the source field has changed, you can modify the field mapping by selecting the existing fields or manually adding fields. After you confirm the changes in the mapping relationships, the DDL statement for the target table is generated and executed.

Source Table Structure Detection

Drag a Data Synchronization node to the design page, select Table Selection under Data Source > Configuration Method, select the source table, and configure data filtering, as shown in the following figure.

Go to the Data Destination and Mapping tab page, configure the target data table, and enable DDL Change Detection. Configure the items on the Write Method tab page. Ensure the Data Synchronization node can run normally, as shown in the following figure.

Result Notification Configuration

To inform users of DDL changes, enable DDL Change Detection on the Data Destination and Mapping tab page, and enable Result Notification under Task Control > Result Notification, as shown in the following figure.

If DDL changes occur in the source table during the task execution, the specified user will be notified through the specified channel. For example, if you set Platform as Notification Channel, the user will be prompted by platform messages.

The log also prompts the changes in the source table structure. An error is reported for DDL changes that affect the actual data writing. In other cases, the task is executed normally.

Field Mapping Update

Click Update Field Mapping on the Data Destination and Mapping tab page, where you can adjust the field mapping without affecting the target table structure, as shown in the following figure.

Click OK to view the updated field mapping, as shown in the following figure.

Target Table Update

If you select Existing Table as Target Table, you can click Update Target Table to confirm or add mapping relationships.

Adjust the field mapping by selecting existing fields in the target table or adding fields manually. Click Update to view the DDL statements to be written into the target table.

You can view the changes in the target database table after executing the DDL statements.

Subsequent Operation

You can continue to execute the scheduled task after synchronizing the DDL change in source tables.