Overview
Version Description
| FineDataLink Version | Functional Change |
|---|---|
4.0.4 | / |
4.0.27 | Allowed skipping, retrying, and resynchronizing dirty data in single tables and multiple tables. |
4.0.29 | Supported folder-based task management. |
4.1.2 | Allowed viewing dirty data and filtering tasks with dirty data. For details, see the section "Function Description." |
4.1.4 | Allowed starting/pausing pipeline tasks in batches. Allowed jumping to task details by clicking the task name in the table (previously done through the Operation Monitoring column). Allowed sorting tasks by Total Input (Row) and Dirty Data in the table. Added a View button on the right side of tasks that were running. Added the filtering options to help you filter tasks. |
Application Scenario
After configuring Data Pipeline tasks, you want to manage all pipeline tasks in a unified manner, such as stopping and deleting tasks, checking the task running status and synchronization performance, monitoring and processing the exceptions, and pausing tasks in batches.
Function Description
Pipeline Task O&M allows you to view the task running status and the data synchronization performance, check and handle the exceptions, and so on, as shown in the following figure:
Function Description
Viewing Pipeline Task Overview
Choose O&M Center > Pipeline Task > Task Management, select the specified folder or task, and you can see the task running status on the overview page, as shown in the following figure:
Filtering Pipeline Tasks
You can filter tasks by Task Name, Synchronization Type, Startup Time, Dirty Data, and Operation Status, as shown in the following figure:
The following table describes each field:
| Type | Description |
|---|---|
Task Name | The name of the pipeline task |
Synchronization Type | The synchronization method of the current task Full + Incremental Synchronization Incremental Sync Only |
Data Source | The source database type |
Data Target | The target database type |
Total Input | Total amount of data read |
Dirty Data | The amount of dirty data |
Running Start Time | The time when the task starts running |
Operation status | The running status of the current task |
Viewing Read/Write Statistics
By clicking the task name in the table, you can enter the pipeline task management page to check the task execution status, as shown in the following figure:
Processing Dirty Data
If there is dirty data in the synchronization task, you can select a single table or multiple tables in the task to skip, retry, or resynchronize the dirty data, as shown in the following figure:
For details, see the section "Processing Dirty Data" in Single Pipeline Task Management.
Starting/Editing/Deleting a Single Task
You can edit and delete all tasks except those whose Operation Status is Running. To edit or delete a running task, you must first pause it, as shown in the following figure:
Starting/Pausing Tasks in Batches
1. You can start and pause pipeline tasks in batches.
Select multiple pipeline tasks to be started/paused and click the Batch Start/Batch Pause button, as shown in the following figure:
The details are as follows:
You can select all tasks on the current page with one click to perform batch start/pause operations.
If the selected tasks are all in the Aborted or Paused status, the Batch Pause button will be displayed in grey. If the tasks are all in the Running status, the Batch Start button will be displayed in grey.
The overwriting logic is used. For example, if you click Batch Start, running tasks will continue running, while tasks that were not started will begin running.
2. You will be informed of the results of the operation, as shown in the following figure:
Previous：Guidance on Scheduled Task O&M
