Dimension Table Input and Data Association

  • Last update: April 24, 2025
  • icon

    Note:


    The Real-Time Task function in the Data Development module is currently in the internal testing stage. To try it or obtain detailed information, you can send an email to international@fanruan.com or click at https://help.fanruan.com/finedatalink-en/.

    Overview

    Version

    FineDataLink VersionFunctional Change
    4.1.13.4/

    Application Scenario

    You may want to associate data read from a real-time input source with data from another database, and then write data into a database in real time.

    Function Description

    You can configure a real-time task in FineDataLink to read data from dimensional data sources using the Dimension Table Input operator and from real-time data sources, associate the read data using Data Association, and write data into databases in real time.

    icon

    Note:


    The target table does not reflect real-time data changes in the dimension table. Updates only occur when data in CDC Input changes and joins with the latest data in the dimension table.

    Function Description

    Dimension Table Input

    Configuration ItemDescription
    Data Connection

    You can select the required data connection. For details about how to create and manage data connections, see Data Connection Creation and Management.

    For details about databases supported by DB Table Input in Scheduled Task, see Data Sources Supported by FineDataLink (Basic Data Source and Big Data in Progressive Data Source in the "Types of Data Sources Supported by Scheduled Task" section).

    Source TableYou can configure the data source and the source table.

    Dimension Table Input cannot be used as an input source alone to output data. It must be followed by a Data Association operator with real-time data input.

    Data Association

    Configuration ItemDescription
    Association Setting
    • You cannot connect two real-time data sources using Data Association.

    • You cannot connect two Dimension Table Input operators using Data Association.

    • You can only connect one real-time data source and one or multiple  Dimension Table Input operators using Data Association.

    Left Table:

    When you associate a real-time data source with a dimension table, the left table must be the real-time data source.

    When joining multiple dimension tables, start by associating the real-time data source (as the left table) with one dimension table, then use the resulting dataset to join other dimension tables sequentially.

    Join methods include Left JoinRight JoinInner Join, and Full Outer Join.

    • When associating a real-time data source with a dimension table, you can only select Left Join or Inner Join.

    Right Table:

    • The right table can only be a dimension table.

    Join Field:

    • You can configure multiple join fields in Association Setting.

    • You can select any field from the left table.

    Data PreviewWhen you preview the join between a real-time data source and a dimension table in Data Association, the Data Preview tab page displays data based on the sample setting of the real-time input operator and the join configuration.

    Four join methods are supported, which are identical to those in Data Association in scheduled tasks. For details, see Data Association.

    Procedure

    This section takes associating data from a real-time input source with data from another database and then writing data into a database as an example.

    Configuring Dimension Table Input

    Log in to FineDataLink, choose Data Development > Real-Time Task, and create a real-time task, as shown in the following figure.

    Drag a Dimension Table Input operator onto the editing page, and select the data source and the source table, as shown in the following figure.

    Click Data Preview to view the fetched data, as shown in the following figure.

    Configuring Real-Time Data Input

    Drag a real-time data input operator onto the page (for example, CDC Input), and set Data Source, Source Table, Read Mode, and Synchronization Type, as shown in the following figure.

    icon

    Note:


    For details about CDC input, see CDC Input.

    Configuring Data Association

    Add a Data Association operator and configure the join method and the join field, as shown in the following figure.

    Click Data Preview to preview the join result, as shown in the following figure.

    Configuring Data Output

    Output the data after real-time processing to a specified database, as shown in the following figure.

    For details about the configuration of DB Table Output, see DB Table Output (Real-Time Task).

    Starting and Managing Tasks

    Click Start to start the real-time task, as shown in the following figure.

    The task running status is displayed, as shown in the following figure.

    Effect Display

    The result of the first synchronization is displayed in Log.


    附件列表


    主题: Data Development - Real-Time Task
    Previous
    Next
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy