FineDataLink provides functions such as data development and task O&M to meet your requirements for data synchronization, processing, and cleaning.
This document clarifies the differences between data synchronization and data transformation in usage, helping you better use FineDataLink.
ETL
The operators in the Data Transformation node belong to the data flow, but the Data Transformation node is a node in the step flow.
Extract data from the source end, process data in FineDataLink, and load data into the target end.
Applicable to complex scenarios where the data needs to be processed in FineDataLink
Broad coverage of data processing scenarios
1. Lower data extraction speed compared with Data Synchronization in scenarios with large data volumes
2. High hardware resource and memory consumption
Data Synchronization
ELT
Step flow
Extract data from the source end, load data into the target end, and use the database for processing.
1. Applicable to synchronization scenarios with large data volumes where a single table contains over 10 million data records
2. Applicable to synchronization scenarios requiring no complex data processing
Excellent data extraction performance
Incapability to handle complex data processing
The operators in the Data Transformation node belong to the data flow, but the Data Transformation node is a node in the step flow. Data flow focuses on processing each row and column of data during the flow of data from input to output, allowing for operations such as data input and transformation, as shown in the following figure.
You want to synchronize data into a database after complex data processing.
Enter the Data Transformation node, drag the data input operator corresponding to the data source onto the canvas, and input the data, as shown in the following figure.
Process the input data with operators in Connection and Transformation, as shown in the following figure.
Output the data after processing into the target database with operators in Data Output, as shown in the following figure.
The Data Synchronization node is part of the step flow. The step flow, also called the workflow, involves orchestrating steps, where each step is relatively independent, differing only in execution order. There is no flow of data rows between steps.
The Data Synchronization node can be used with other step flow nodes (such as the Parameter Assignment node and the Loop Container node) to perform ETL data processing, as shown in the following figure.
You want to extract a large amount of data and synchronize the data directly into the target database without complex data processing.
Configure the data to be extracted in Data Source, the target table and field mapping relationship in Data Destination and Mapping, and the data write method in Write Method.
滑鼠選中內容，快速回饋問題
滑鼠選中存在疑惑的內容，即可快速回饋問題，我們將會跟進處理。
不再提示
10s後關閉
Submitted successfully
Network busy