FineDataLink provides scheduled and real-time data synchronization functions. You need to select function modules based on the synchronization scope (incremental/full) and scheduling requirements (scheduled/real-time), as support varies by module. Additionally, place emphasis on data sources and destinations, the number of tables and databases to be synchronized, and so on.
This document outlines data synchronization scenarios supported by FineDataLink.
Incremental/Full
Full
√
Incremental
Number of tables and databases
Single-table synchronization
Whole-database synchronization
×
Supported data sources and destinations
Data sources supported by Data Development
Data sources supported by Data Pipeline for real-time synchronization
Function description documents
Data Synchronization
Data Pipeline
Scheduled Incremental Synchronization
There are only insertion changes to data in the source table.
The source table contains a timestamp column.
When the source table contains a timestamp column, you can use the Parameter Assignment node to obtain the latest timestamp from the target table, and then use the Data Synchronization node to fetch incremental data for the synchronization.
Parameter Assignment + Data Synchronization
Incremental Data Synchronization
The source table does not contain a timestamp column but has a unique identifier.
You can use the Parameter Assignment node to obtain the unique identifier from the target table, then fetch the corresponding data records that exist only in the source table (the data to be synchronized to the target table), and use the Data Synchronization node to synchronize the fetched data, achieving incremental synchronization.
Scheduled Full Synchronization
All data in the target table needs to be replaced with data from the source table.
Select Write Data into Target Table After Emptying It as Write Method.
Scheduled Comparison-Based Synchronization
Some data in the source table is deleted or modified.
Some data in the source table is deleted.
By using the Data Comparison operator with the DB Table Output operator, you can perform operations such as inserting, deleting, and updating data.
Data Comparison (which should be connected with the source table and the target table) + DB Table Output
Data Comparison
There are insertion or modification changes to data in the source table.
If the target table contains a primary key, you can set Primary Key Mapping in Write Method in the Data Synchronization node.
If the target table contains no primary key, you can use the Data Transformation node with the DB Table Output operator to obtain new or modified data and synchronize the changes to the target table.
There are only modification changes to the source table.
If the target does not contain a primary key, you can use the Data Comparison operator and the DB Table Output operator to fetch the modified data and synchronize the changes to the target table.
Real-Time Synchronization of Data Insertion, Deletion, and Modification to the Target Table
You can use the Data Pipeline function.
Overview of Data Pipeline
Futher Reading
For FineDataLink of V4.0.28 and later versions, the following scenarios (where neither the source table nor the target table is a Jiandaoyun form) can be implemented by using the Data Synchronization node:
Add/modify/delete the data obtained after filtering without the identifier field. (Only one operation type can be selected when the identifier field is empty.)
Add/modify/delete data based on the identifier field and its value.
For details about using the Data Synchronization node to implement the operations, see Adding/Modifying/Deleting Data Based on the Identifier Field.
滑鼠選中內容，快速回饋問題
滑鼠選中存在疑惑的內容，即可快速回饋問題，我們將會跟進處理。
不再提示
10s後關閉
Submitted successfully
Network busy