Data Connection to Spark

  • Last update:  2024-10-16
  • Overview

    Version

    FineBI Version
    Functional Change

    6.0

    /

    Application Scenario

    This document introduces how to connect to the Spark data source.

    iconNote:
    This database does not support data tables with direct connection attributes.

    Preparation

    Version/Driver

    Download the driver package and upload it to FineBI. For details, see section "Uploading the Database Driver" in Driver Management.

    iconNote:
    To upload the driver package, you need to decompress the Log JAR file below and upload it to FineBI together with the driver package.
    Supported Database Version
    Driver Package DownloadLog JAR

    V1.6.0

    hive-spark1.6 .rar

    Log JAR.rar

    V2.1, V2.3

    Hadoop Hive.zip

    Connection Information Collection

    Before connecting the database, you need to collect the following information:

    • IP address and port number of the database server

    • Database name

    • Username and password (if username and password authentication is used); client principal and keytab file path (if Kerberos authentication is used)

    Connection Procedure

    1. Log in to FineBI as the admin, choose System Management > Data Connection > Data Connection Management, and click New Data Connection, as shown in the following figure.

    iconNote:

    If you are not the admin, you can configure data connections only after the admin assigns you the permission on Data Connection Management. For details, see Data Connection Permissions Overview.

    新建数据集截图.png

    2. Find the Spark icon, as shown in the following figure.

    图标截图.png

    3. Select Custom from the Driver drop-down list, select the driver uploaded in section "Version/Driver", and enter the connection information collected in section "Connection Information Collection."

    For details about Kerberos authentication, see Kerberos Authentication in Data Connection.

    SPARK数据连接填写信息截图.png

    To use Kerberos authentication, you should pay attention to the following points.

    • Check if the IP address corresponding to the machine name in /etc/hosts is a LAN IP address.

    • Check if the machine name set in /etc/hostname is consistent with that set in /etc/hosts.

    • Check if the IP address and machine name in the hosts file of the machine where FineBI is located are correct.

    • In some cases, especially in non-public network environments, the hostname of the database server cannot be resolved by your client. In such cases, you need to configure the hosts file in /etc/hosts and add remote mapping (IP address and Machine name, for example, 192.168.5.206 centos-phoenix).

    4. Click Test Connection. If the connection is successful, click Save, as shown in the following figure.

    连接成功.png

    Adding Database Tables to FineBI

    Two methods are available to add database tables to FineBI.

    公共数据库新建数据集截图.png

    Attachment List


    Theme: Data Center
    前の記事
    次の記事
    • いいね
    • 良くない
    • 閲覧しただけ

    フィードバック

    鼠标选中内容,快速反馈问题

    鼠标选中存在疑惑的内容,即可快速反馈问题,我们将会跟进处理。

    不再提示

    9s后关闭

    反馈已提交

    网络繁忙