Overview of Data Synchronization Schemes

  • Last update: June 20, 2025
  • Overview

    FineDataLink provides scheduled and real-time data synchronization functions. You need to select function modules based on the synchronization scope (incremental/full) and scheduling requirements (scheduled/real-time), as support varies by module. Additionally, place emphasis on data sources and destinations, the number of tables and databases to be synchronized, and so on.

    This document outlines data synchronization scenarios supported by FineDataLink.

    Data Synchronization Capability

    DimensionData DevelopmentData Pipeline

    Incremental/Full

    Full

    Incremental

    Number of tables and databases

    Single-table synchronization

    Whole-database synchronization

    ×

    Supported data sources and destinations

    Data sources supported by Data Development

    Data sources supported by Data Pipeline for real-time synchronization

    Function description documents

    Data Synchronization

    Data Pipeline

    Data Synchronization Scheme

    Synchronization MethodScenarioSchemeFunction CombinationExample

    Scheduled Incremental Synchronization

    There are only insertion changes to data in the source table.

    The source table contains a timestamp column.

    When the source table contains a timestamp column, you can use the Parameter Assignment node to obtain the latest timestamp from the target table, and then use the Data Synchronization node to fetch incremental data for the synchronization.

    Parameter Assignment + Data Synchronization

    Incremental Data Synchronization

    The source table does not contain a timestamp column but has a unique identifier.

    You can use the Parameter Assignment node to obtain the unique identifier from the target table, then fetch the corresponding data records that exist only in the source table (the data to be synchronized to the target table), and use the Data Synchronization node to synchronize the fetched data, achieving incremental synchronization.

    Scheduled Full Synchronization

    All data in the target table needs to be replaced with data from the source table.

    Select Write Data into Target Table After Emptying It as Write Method.

    Data Synchronization

    Data Synchronization

    Scheduled Comparison-Based Synchronization

    Some data in the source table is deleted or modified.

    Some data in the source table is deleted.

    By using the Data Comparison operator with the DB Table Output operator, you can perform operations such as inserting, deleting, and updating data.

    Data Comparison (which should be connected with the source table and the target table) + DB Table Output

    Data Comparison

    There are insertion or modification changes to data in the source table.

    If the target table contains a primary key, you can set Primary Key Mapping in Write Method in the Data Synchronization node.

    Data Synchronization

    Data Synchronization

    If the target table contains no primary key, you can use the Data Transformation node with the DB Table Output operator to obtain new or modified data and synchronize the changes to the target table.

    Data Comparison (which should be connected with the source table and the target table) + DB Table Output

    Data Comparison

    There are only modification changes to the source table.

    If the target table contains a primary key, you can set Primary Key Mapping in Write Method in the Data Synchronization node.

    Data Synchronization

    Data Synchronization

    If the target does not contain a primary key, you can use the Data Comparison operator and the DB Table Output operator to fetch the modified data and synchronize the changes to the target table.

    Data Comparison (which should be connected with the source table and the target table) + DB Table Output

    Data Comparison

    Real-Time Synchronization of Data Insertion, Deletion, and Modification to the Target Table

    You can use the Data Pipeline function.

    Overview of Data Pipeline

    Futher Reading

    For FineDataLink of V4.0.28 and later versions, the following scenarios (where neither the source table nor the target table is a Jodoo form) can be implemented by using the Data Synchronization node:

    • Add/modify/delete the data obtained after filtering without the identifier field. (Only one operation type can be selected when the identifier field is empty.)

    • Add/modify/delete data based on the identifier field and its value.

    For details about using the Data Synchronization node to implement the operations, see Adding/Modifying/Deleting Data Based on the Identifier Field. 

    附件列表


    主题: Best Practices
    Previous
    Next
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy