Dataset Output

  • Last update: November 06, 2024
  • Overview

    Version

    FineDataLink Version

    FineBI 6.1 Version

    Functional Change

    4.1.8.2-4.1.8.3

    BI 6.1

    /

    4.1.9.1-4.1.10.3

    BI 6.1.1

    Updated the subtables of the output BI dataset in FineDataLink V4.1.10.4.

    iconNote:

    For details about subsequent version compatibility and updates, see Version Compatibility Description.

    Application Scenario

    The data in the data warehouse is not fully in a final form, and needs further processing to form basic data for analysis. You may want to use FineDataLink to process some data, and write the data directly into Public Data of FineBI.

    Function Description

    You can use the Dataset Output operator of the Data Transformation node or the Data Synchronization node to write data directly to the specified directory of Remote Public Data.

    Prerequisite

    • Modify the configurations of FineDB before using this function. For details, contact FanRuan technical support. You can send an email to international@fanruan.com or click  at https://help.fanruan.com/finedatalink-en/.

    • Ensure the Data Transfer - Basic Operator Package function point is registered.

    • If FineBI or FineDataLink has been configured with a firewall, port 50051 needs to be opened.

    • The version of FineDataLink needs to match that of FineBI. For details, see Version Compatibility Description.

    • Use Public Data as the data connection to create connection between FineDataLink and FineBI, as shown in the following figure.

    Function Description


    Configuration Content

    Configuration Item

    Description

    Data Destination and Mapping

    Target Table

    Existing Table 

    Auto Created Table

    If Auto Created Table is selected, you need to select the table storage path.

    Field Mapping

    Mapping Method:

    • Map Field with Same Name

    • Map Field with Same Row


    Mapping Operation:

    • Obtaining table creation statements is not supported.

    • Re-obtaining is supported.


    Mapping Configuration:

    • Obtaining table creation statements is not supported.

    • Re-obtaining is supported.


    Mapping Configuration:

    • Configuring non-empty fields or primary keys is not supported.

    • Field types are automatically matched and adjustable. Setting field length is not supported.

    • Field types: Text, Value, and Date.


    Write Method

    Write Method

    • Write Data into Target Table Directly

    Configuring logical primary keys is not supported.

    • Write Data into Target Table after Emptying It

    The following operations are not supported:

    • Write Data into Target Table Directly > Strategy for Primary Key Conflict

    • Add/Modify/Delete Data Based on Identifier Field

    Notes

    iconNote:

    Outputting data table scheduling and updating progress can only be controlled by scheduled tasks and manual task execution in FineDataLink.

    If FineDataLink is updated to V4.1.10.4, the subtables of the output BI dataset will also be updated.

    General configurations of table names and capitalization/decapitalization of field names are not supported yet.

    Configuring Dirty Data Tolerance is not supported. If a row of data fails, the entire writing operation will fail and be rolled back.

    Writing data into Public Data is not supported in FineBI 6.1 with the multi-node compute-storage separation architecture.

    Procedure

    For example, the data in your own data warehouse is not finalized, and you may want to further process it into public data for FineBI analysis.

    Processing Data

    Create a scheduled task in Data Development, as shown in the following figure.

    Process the data fetched with the Data Transformation node. In this example, data tables are associated and fields are set, as shown in the following figure.

    For details, see Data Association and Field Setting.

    Outputting Data to Public Data of FineBI

    Use the Dataset Output operator to output the processed data to FineBI. Select Remote Public Data and the corresponding data connection as the data source, and configure the target table. If you select Auto Created Table, you need to select the table path under Public Data for the data to be output to, as shown in the following figure.

    Configure Write Method. You can select Write Data into Target Table After Emptying It or Write Data into Target Table Directly, as shown in the following figure.

    Effect Display

    After running the task, you can view the output data table in the specified location of Public Data in FineBI. You can use the ETL result table in Public Data for analysis.


    附件列表


    主题: Data Development - Scheduled Task
    Previous
    Next
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy