Transwarp Inceptor Data Connection

  • Last update: September 19, 2024
  • Overview

    Version 

    FineDataLink VersionFunctional Change
    4.0.24/
    4.1.3Supported data writing into partition tables that were created during task configuration when a Transwarp Inceptor database was used as the target database.

    Application Scenario 

    Enterprises that store business data in Transwarp Inceptor databases want to read/write data from/into Transwarp Inceptor databases using scheduled tasks via FineDataLink.

    Preparation

    Version and Driver 

    Download the driver package and upload it to FineDataLink. For the specific steps of uploading the driver package, see Driver Management

    Supported Database VersionDriver NameDriver Package Download
    V4.6org.apache.hive.jdbc.HiveDriver4.6-inceptor-driver.jar
    V4.6, V4.9.2, V5.2.1, and V6.0.2inceptor-sdk-transwarp-6.1.0-SNAPSHOT.jar

    Connection Information Collection 

    Collect the following information before connecting FineDataLink to the database.

    • IP address and port number of the database server 

    • Database name

    • Username and password of the database

    Procedure

    1. Log in to FineDataLink, choose System Management > Data Connection > Data Connection Management, click New Data Connection, and click the TRANSWARP INCEPTOR icon, as shown in the following figure.

    iconNote:
     If you are not the admin, you can configure data connections only after the admin assigns you permission on Data Connection under Permission Management > System Management. For details, see Data Connection Management Permission

    2. Click Custom, select the driver uploaded in the section "Version and Driver," and enter the connection information collected in the section "Connection Information Collection."


    Transwarp Inceptor databases support Kerberos authentication. For details, see Kerberos Authentication in Data Connection. Before connecting:

    • Check if the IP address corresponding to the machine name in the hosts file (/etc/hosts) is a LAN address.

    • Check if the machine name in the hostname file (/etc/hostname) is consistent with the one in the hosts file (/etc/hosts).

    • Check if the IP address and machine name configured in the hosts file of the machine where FineDataLink is located are correct.

    • Configure the hosts file (/etc/hosts) for establishing a local connection. Add the remote mapping information, including the IP address and the machine name. For example, 192.168.5.206 centos-phoenix.

    4. Configure the HDFS address if you need to write data into a Transwarp Inceptor database. The configuration details are as follows.

    iconNote:
     Since Transwarp Inceptor is developed based on Apache Hive, you are advised to create a table in the Hadoop Distributed File System (HDFS) first and then load the table data into the target table to accelerate the writing.

    Configuration ItemPromptDescription
    HDFS AddressFill in the IP address or hostname and the port number.

    Fill in the node address where the HDFS is active, in the format of hdfs://IP address:Port number.

    For example, hdfs://192.168.101.119:8020.

    For details, see Confirming IP Address and Port Number in HDFS URL.


    5. Click Test Connection. If the connection is successful, click Save to save the configuration.

    Data Source Usage

    The data source can be used for data reading and writing in Data Synchronization and Data Transformation nodes.

    FineDataLink 4.1.3 and later versions support data writing into partition tables that are created during task configuration when a Transwarp Inceptor database is used as the target database. For details, see Partition Table Creation and Data Reading/Writing.

    For details about Transwarp Inceptor databases, see Transwarp Inceptor Instruction.

    附件列表


    主题: Data Source Configuration
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy