反馈已提交

网络繁忙

You are viewing 5.1 help doc. More details are displayed in the latest help doc.

Configure data connection

  • Recent Updates: April 15, 2022
  • 1. Overview

    1.1 Version

    FineBI version
    JAR
    5.12020-1-15

    1.2 Function introduction

    The first step in data analysis using FineBI is to obtain data, and the first step in obtaining data is to define the data source. The most common thing in actual user system is to store data in a database and keep it updated. No matter what type of data is used in the FineBI Spider engine, it supports continuous updating of the data.

    During data connection, the table name and field name in the database should not contain the special characters shown in the following table:

    Table name and field name do not support the following characters

    JO

    JO_

    __NULL__

    __EMPTY__

    ##

    __order

    __partition

    ##RF#

    JO

    .

    [

    ]

    {}

    (

    )

    =

    /

    MT

    RE_

    MT_

    RE+number

    RE

    -





    2. Create a data connection

    Log into the data decision system (usually an administrator) with a user account that has FineBI data connection permissions, and click "Manage>Data Connection>Data Connection Management>New Data Connection" to create a new data connection, as shown in the following figure:

    1.png

    Note: If a non-administrator user needs to configure the FineBI data connection, the administrator needs to assign the authority to the "Data Connection" under "Manage". For specific operations, please see: Data Connection Control.

    3. Select databse type

    Click "New Data Connection", there are three types to choose from, namely Commonly Used, All, and Others. As shown below:

    2.png

    3.1 Commonly Used

    Fixed display of several commonly used database types, namely Hsql, IBM DB2, Microsoft SQL Server, MySQL, Oracle. As shown below:

    3.png

    3.2 All

    Displays the database types supported by FineBI's "Built-in support" and "Plugin support", namely: Alibaba Cloud AnalyticDB, Amazon Redshift, Apache Impala, Apache KYLIN, Apache Phoenix, DERBY, GBase 8A, GBase 8S, GBase 8T, H2, Huawei Cloud DWS, Fusioninsight elk, Fusioninsight HD, GaussDB 200, Hadoop Hive, HBase, HP Vertica, HSQL, IBM DB2, INFORMIX, KINGBASE, Microsoft SQL Server, MySQL, Oracle, Pivotal Greenplum Database, Postgresql, Presto, SAP HANA, SAP Sybase, SPARK, Sqlite, TeraData , TRANSWARP INCEPTOR, and the database type supported by the installation plugin, as shown in the following figure:

    4.png

    Note: You can filter the database type by checking "Built-in Support" and "Plugin Support"; if they are not checked, it will be blank.

    3.3 Others

    "Others" types include "JNDI Data Connection" and "Other JDBC". As shown below:

    5.png

    3.3.1 JNDI Data Connection

    Click "New Data Connection", and select "JNDI Data Connection" under "Others", as shown in the figure below:

    Note: JNDI data connection only supports Finereport, and FineBI does not support the use of data preparation.

    6.png

    3.3.2 Other JDBC

    If there is no required database type in the database list, select "Other JDBC" under "Other", place the corresponding driver package under %FineBI%\webapps\webroot\WEB-INF\lib, and restart FineBI, which requires manual input complete data connection information such as Driver, URL, etc., click "Test Connection". After the connection is successful, click "Save". As shown below:

    7.png

    4. Confifuration information Introduction

    The following is a detailed explanation of some data connection information:

    Connection information

    Description

    Data Connection Name

    The name of the newly created data connection, which is used to distinguish the connection of different databases in the system

    Driver

    The driver used for data connection, fill in the information provided on the corresponding connection page according to its own database type

    URL

    The URL of the data connection contains information such as Database name, Host, Port, etc. The corresponding data connection page provides a URL example, which can be modified and filled according to the information of your own database. For example, the URL of MySQL is: jdbc:mysql://ip:port/ dbname

    If the IP of its own database is 120.27.40.246, the port is 3306, and the database name is mysql, the URL filled in is jdbc:mysql://120.27.40.246:3306/mysql

    Encoding

    By default, you can use automatic directly. If you add a database table, sql dataset, or server dataset garbled characters, you can modify the encoding corresponding to the current data connection.

    Note: 2019-01-07 and later versions of FineBI will start to support

    Username

    The username corresponding to the connection destination database

    Password

    The password corresponding to the connection destination database

    The information that needs to be configured for different databases may be different. The following describes the specific information of the two attributes of "Pattern" and "Authentication Method".

    4.1 Other JDBC

    When connecting to these databases, such as: Amazon Redshift, Apache KYLIN, Apache Phoenix, DEBRY, HP Vertica, IBM DB2, INFORMIX, Microsoft SQL Server, Oracle, Pivotal Greenplum Database, Postgresql, GBase 8S, GBase 8T, KINGBASE, Presto, SAP HANA, SAP Sybase, Hbase, there is one more step than other data connections: Pattern, as shown in the following figure:

    8.png

    The pattern introduction is as follows:

    • If these databases do not have a pattern selection, the first pattern is selected by default.

    • Some databases do not need to select a pattern, and there is no button for pattern selection, so there is no need for pattern selection.

    • The pattern is not editable by default, you can edit it after you click "Click to Connect Database" and the connection is successful.

    • A database with pattenr selection needs to have an available pattern in the user's database, otherwise an error will be reported.

    It is necessary to select the pattern corresponding to the database correctly, otherwise it will cause the display of "No table available in the current data connection" when adding the database table, and the data can only be accessed through the SQL dataset.

    4.2 Authentication Method

    Among them, the six databases of APACHE IMPALA, Hadoop Hive, SPARK, TRANSWARP INCEPTOR, APACHE Phoenix, and HBase have the option of authentication when configuring data connections. As shown below:

    9.png

    The specific introduction is as follows:

    • If the database supports multiple authentication methods, click on the authentication method drop-down box will appear.

    • If you choose "Kerberos" authentication, fill in the "Client Principal" and "Keytab Key Path" of the registered kdc.

    • For detailed Kerberos authentication, please refer to: Data Connection Kerberos Authentication.

    4.3 Advanced Setting

    The advanced setting interface is shown in the figure below:

    10.png

    The description of each parameter of the connection pool attribute is shown in the following table:

    Name

    Example 

    Meaning  

    Initial connection No.

    initialSize="1"

    The number of initial connections created when the connection pool is started

    Max active connection

    maxActive="200"

    The maximum number of active connections that the connection pool can allocate at the same time. If set to a non-positive number, it means no limit

    Max idle connection

    maxIdle="100"

    The maximum number of connections allowed to remain idle in the connection pool, the excess idle connections will be released, if it is set to a negative number, it means no limit

    Note: The third-party framework has abandoned this parameter, and the setting has no effect

    Min idle connection

    minIdle="2"

    The minimum number of connections allowed in the connection pool to remain idle, below this number will create a new connection, if it is set to 0, it will not be created

    Max Wait Time(Millisecond)

    maxWait="1000"

    When there is no available connection, the maximum time (counted in milliseconds) for the connection pool to wait for the connection to be returned. If the time is exceeded, an exception will be thrown. If set to -1, it means waiting indefinitely.

    SQL Verification Query

    validationQuery="SQL statement"

    Used to verify the connection taken from the connection pool. If specified before returning the connection to the caller, the query must be a SQL SELECT and must return at least one row of records

    Test before connect

    testOnBorrow="false"

    Indicate whether to check before removing the connection from the pool, if the check fails, remove the connection from the pool and try to remove another

    Test before disconnect

    testOnReturn="true"

    Indicate whether to inspect before returning to the pool

    Idle recycler check

    testWhileIdle="true"

    Indicate whether the connection is checked by the idle connection collector (if any), if the check fails, the connection will be removed from the pool

    Idle recycler sleep time(Millisecond)

    timeBetweenEvictionRunsMilli

    s="1000"

    The sleep time value during the running of the idle connection collector thread, in milliseconds. If set to a non-positive number, the idle connection collector thread will not run

    Number of idle connection

    numTestsPerEvictionRun="2"

    The number of connections checked each time the idle connection collector thread (if any) runs

    Min idle time

    minEvictableIdleTimeMilli

    s="18005000"

    The minimum time value for the connection to remain idle in the pool without being reclaimed by the idle connection collector thread (if any)

    5. Manage data connection

    5.1 Management Scope

    In the data decision system, click "Manage>Data Connection>Data Connection Management" and click the icon on the right side of a database, as shown in the following figure:

    11.png

    The description of each setting item of "Data Connection Management" is shown in the following table:

    Setting items

    Description

    Test Connection

    Test whether the database configuration is successful

    Edit

    Modify the data connection configuration

    Rename

    Rename the database

    Copy

    Copy the database, and the data connection name is automatically increased by 1

    Delete

    Delete the database

    Data connection information

    Display the database type and creator

    Need to pay attention to the following points:

    • No 14.pngicon is displayed on the right side of the database type that is not adapted.

    • When managing the data connection, the name of the data connection cannot be changed at will. The matching of the updated local table with the database depends on the name of the data connection. If the name of the data connection is modified, the table taken out of the connection will no longer be updated.

    • If it is a SQL dataset, there will be no "Modify SQL" button.

    • If you update the database in a locally saved table, for example, when the table name and the table structure are the same when the table name and the table structure are the same from the development environment to the production environment, you only need to modify the URL of the data connection. The locally saved table can still update the data according to the data connection name.

    5.2 Connection Pool Status

    The data connection interface provides a connection pool status page, and you can see the data connections that have been created so far and the corresponding connection status, as shown in the following figure:

    12.png

    The description of "Active Connection Number" and "Number of Idle Connections" is shown in the following table:

    Connection Pool Status

    Description

    Active Connection Number

    The maximum number of connections that can be created in the connection pool. If the maximum number of connections is 10, the program has applied for 10 connections and has been using it. The 11th connection request error: active 10 maxActive 10

    Number of Idle Connections

    The connection currently in the idle state will turn into an active connection at any time, and it will be automatically released when the idle state exceeds the maximum idle connection time

    Number of active connections + number of idle connections = actual number of physical connections

    6. Common error

    6.1 Data cannot be previewd

    Problem description:

    BI connect to server dataset, there is an error message during data preview:find fieldinfo failed for table:XXX

    Cause analysis:

    There are repeated field names in the database table. BI does not support repeated field names and empty values, as shown in the following figure:

    13.png

    Solution:

    Modify the repeated field name.

    Attachment List


    Theme: Data Connection
    Already the First
    Already the Last
    • Helpful
    • Not helpful
    • Only read

    售前咨询电话

    400-811-8890转1

    在线技术支持

    在线QQ:800049425

    热线电话:400-811-8890转2

    总裁办24H投诉

    热线电话:173-1278-1526

    文 档反 馈

    鼠标选中内容,快速反馈问题

    鼠标选中存在疑惑的内容,即可快速反馈问题,我们将会跟进处理。

    不再提示

    10s后关闭