Data Connection to MaxCompute

  • Last update:November 08, 2024
  • Overview

    Version

    FineBI Version
    Functional Change

    6.0

    /

    Introduction

    MaxCompute, formerly referred to as Open Data Processing Service (ODPS), is a fast and fully hosted GB/TB/PB-level data warehousing solution provided by Alibaba's general computing platform. It provides you with complete data import schemes and various classic distributed computing models. MaxCompute supports fast computing on a large amount of data, effectively reduces costs for enterprises, and ensures data security.

    This document introduces how to connect to the Alibaba Cloud MaxCompute database.

    Preparation

    Version/Driver

    Download the driver package and upload it to FineBI. For details, see section "Uploading the Database Driver" in Driver Management.

    iconNote:
    You need to upload the Log JAR.zip together with the driver package.


    Database Version
    DriverURLDriver DownloadLog

    V 3.2.7 and later   versions

    com.aliyun.odps.jdbc.OdpsDriver

    jdbc:odps:<Maxcompute_endpoint>?Project=<maxcompute_project_name>

    odps-jdbc-3.2.8-jar-with-dependencies.jar

    LogJAR.zip

    URL Explanation:

    • <maxcompute_endpoint>: the endpoint of the region where the MaxCompute service is located For      example, the endpoint of the extranet in East China 1 (Hangzhou) is http://service.cn-hangzhou.maxcompute.aliyun.com/api.

    • <maxcompute_project_name>: the space name of the MaxCompute project

    For details, see Usage Notes.

    Connection Information Collection

    Before connecting the database, you need to collect the following information:

    • <maxcompute_endpoint> (the endpoint of the region where the MaxCompute service is located)

    • <maxcompute_project_name> (the space name of the MaxCompute project)

    • Username and password of the database

    • Schema of the database to be connected

    Connection Procedure

    1. Log in to FineBI as the admin, choose System Management > Data Connection > Data Connection Management, and click New Data Connection, as shown in the following figure.

    新建数据集截图.png

    Note: If you are not the admin, you can configure data connections only after the admin assigns you the permission on Data Connection Management. For details, see Data Connection Permissions Overview.

    2. Find the Alibaba Cloud MaxCompute icon, as shown in the following figure.

    tubiao.png

    3. Select Custom from the Driver drop-down list, select the driver uploaded in section "Version/Driver", and enter the connection information collected in section "Connection Information Collection."

    Click Click to Connect Database. If the connection is successful, select the schema, as shown in the following figure.

    信息填写.png

    iconNote:
    You can optionally modify other advanced settings. For details, see section "Advanced Settings" in Entry-Level Data Connection Configuration.

    4. After successful connection, click Save to save the data connection.

    成功连接.png

    Adding Database Tables to FineBI

    Two methods are available to add database tables to FineBI.

    公共数据库新建数据集截图.png

    User Guide for MaxCompute

    Official Documentation

    Official documentation of MaxCompute: MaxCompute

    Official documentation of DataWorks: DataWorks

    You can conduct visual management of MaxCompute by using DataWorks.

    MaxCompute Query Acceleration

    The MCQA feature of MaxCompute:

    • Accelerates the execution of small- and medium-sized query jobs and reduces the time that is required to complete such a query job from minutes to seconds. The MCQA feature is compatible with other query features of MaxCompute.

    • Supports mainstream business intelligence (BI) tools to perform ad hoc queries or BI analysis.

    • Uses an independent resource pool that does not occupy quota resources. MCQA can automatically identify query jobs to reduce the load of the job queue and improve user experience.

    For details, see MaxCompute Query Acceleration.

    How to enable MCQA in FineBI?

    Suffix the URL in section "Version/Driver" with &interactiveMode=true.

    Note:To use the acceleration parameter, you need to add the parameter autoSelectLimit=1,000,000,000 when the data volume exceeds the limit of one million.

    For details, see MaxCompute Query Acceleration.

    How to extract data from a table with partitions in FineBI?

    In MaxCompute, you cannot directly extract data from a table with partitions by adding a Database Table in FineBI. Instead, you need to add a SQL Dataset.

    For example, in MaxCompute, a table named test exists with two partitions A and B. Add a SQL Dataset, and enter the statement: select * from test where fenqu = A for data extraction.

    SQL取数.png

    附件列表


    主题: Data Preparation
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy