ClickHouse Data Connection

  • Last update: November 21, 2024
  • Overview 

    Version 

    FineDataLink VersionFunctional Change
    3.2Scheduled Task supported data reading from the ClickHouse database.
    3.7Scheduled Task supported data writing into the ClickHouse database.
    4.0.28
    Pipeline Task supported data writing into the ClickHouse database.
    4.1.6.3Data Service supported the ClickHouse database.
    4.1.13.3Real-time data development tasks supported data writing into the ClickHouse database.

    Function Description 

    ClickHouse is a column-oriented database management system (DBMS) for online analytical processing (OLAP) of queries.

    FineDataLink supports connection to the ClickHouse database for data reading and writing using scheduled tasks, data writing using pipeline tasks, data writing using real-time tasks, and for releasing data services.

    iconNote:
    Only the ClickHouse database using the Atomic database engine supports the Auto Created Table function for data writing.

    Preparation 

    Prerequisite

    For details, see Overview of Data Connection.

    Version and Driver 

    Download the driver package and upload it to FineDataLink. For the specific steps of uploading the driver package, see Driver Management

    Supported Database VersionDriver Package
    20.1clickhouse.zip
    22.6clickhouse4j-1.4.4-SNAPSHOT.jar

    Connection Information Collection 

    Collect the following information before connecting FineDataLink to the database.

    • IP address and port number of the database server   

    • Username and password of the database

    • Schema of the database to be connected

    Procedure 

    1. Log in to FineDataLink as the admin, choose System Management > Data Connection > Data Connection Management, and choose Create > Data Connection, as shown in the following figure.

    iconNote:
    If you are not the admin, you can configure data connections only after the admin assigns you permission on Data Connection under Permission Management > System Management. For details, see Data Connection Management Permission

    2. Set the data connection name. You can also modify the directory of this data connection.

    3. Find the ClickHouse data source by searching the data source name or filtering the data source by Data Source Type, Supported Form, and Compatible Module, as shown in the following figure.

    4. Click Custom, select the driver uploaded in the "Version and Driver" section, and enter the connection information collected in the section "Connection Information Collection." 

    Click Click to Connect Database. If the connection is successful, you can select the schema, as shown in the following figure.

    5. Click Save to save the data connection.

    Data Source Usage 

    After configuring the data source, you can use it in Scheduled Task. For details, see Overview of Scheduled Task.

    After configuring the data source, you can use it in Data Pipeline. For details, see Overview of Data Pipeline.

    After configuring the data source, you can use it in Data Service. For details, see Overview of Data Service

    After configuring the data source, you can use it in Real-Time Task. For details, see Overview of Real-Time Task.

    iconNote:
     If you need to write data into an existing table using the real-time data development task, the _fdl_sign field is required in the table to mark the deletion.


    附件列表


    主题: Data Source Configuration
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy