4.0.4
4.0.27
Allowed skipping, retrying, and resynchronizing dirty data in single tables and multiple tables.
4.0.29
Supported folder-based task management.
4.1.2
Allowed viewing dirty data and filtering tasks with dirty data. For details, see the section "Function Description."
4.1.4
Allowed starting/pausing pipeline tasks in batches.
Allowed jumping to task details by clicking the task name in the table (previously done through the Operation Monitoring column).
Allowed sorting tasks by Total Input (Row) and Dirty Data in the table.
Added a View button on the right side of tasks that were running.
Added the filtering options to help you filter tasks.
1. Filter:
Changed the Running Status filter from the form of a drop-down box to a checkbox group laid out flat on the page.
Added a Table Exception filter.
Enabled second-level precision for the startup time picker.
2. Table:
Added a Number of Aborted Tables column. Expanded the Operation Status column with new values Starting, Pausing, and To Be Retried.
Separated Running Record and Task Management.
After configuring Data Pipeline tasks, you want to manage all pipeline tasks in a unified manner, such as stopping and deleting tasks, checking the task running status and synchronization performance, monitoring and processing the exceptions, and pausing tasks in batches.
Pipeline Task O&M allows you to view the task running status and the data synchronization performance, check and handle the exceptions, and so on, as shown in the following figure:
Choose O&M Center > Pipeline Task > Task Management, select the specified folder or task, and you can see the task running status on the overview page, as shown in the following figure:
You can filter tasks by task name, synchronization type, task execution status, enabling status of Retry After Failure/Result Notification, creator, and creation time, as shown in the following figure.
The following table describes each field:
Task Name
It displays pipeline task names.
Data Source
It displays target-end database types of pipeline tasks.
Synchronization Type
It records synchronization methods of tasks, including:
Full + Incremental Synchronization
Incremental Sync Only
Retry After Failure
It displays the enabling status of this setting item.
Result Notification Channel
It displays the settings of this item.
Creator
It displays the names of platform users who create these tasks.
Creation Time
It displays the task creation time.
Dirty Data
It displays the amount of dirty data records.
Status
It displays the running status of tasks.
By clicking the task name in the table, you can enter the pipeline task management page to check the task execution status, as shown in the following figure:
If there is dirty data in the synchronization task, you can select a single table or multiple tables in the task to skip, retry, or resynchronize the dirty data, as shown in the following figure:
For details, see the section "Processing Dirty Data" in Single Pipeline Task Management.
Edit
The following figure shows the buttons.
Batch Start
To Be Started, Paused, and Aborted
Running and To Be Retried
Draft, To Be Started, Paused, and Aborted
1. You can start, pause, and delete pipeline tasks in batches.
Select pipeline tasks to be started/paused/deleted and click the Batch Start/Batch Pause/Batch Delete button, as shown in the following figure.
The details are as follows:
You can select all tasks on the current page with one click and start/pause/delete them in batches.
If the selected tasks are all in the Aborted or Paused status, the Batch Pause button will be displayed in grey. If the tasks are all in the Running status, the Batch Start button will be displayed in grey.
The overwriting logic is used. For example, if you click Batch Start, running tasks will continue running, while tasks that were not started will begin running.
2. You will be informed of the results of the operation, as shown in the following figure:
滑鼠選中內容，快速回饋問題
滑鼠選中存在疑惑的內容，即可快速回饋問題，我們將會跟進處理。
不再提示
10s後關閉
Submitted successfully
Network busy