Alibaba Cloud MaxCompute data connection

1.1 Version

1.2 Introduction

MaxCompute (previously called ODPS) is a fast and fully managed GB/TB/PB-level data warehouse solution provided by Alibaba's general computing platform. Now it has been renamed MaxCompute. MaxCompute provides users with a complete data import solution. And a variety of classic distributed computing models can more quickly solve the user's massive data computing problems, effectively reduce enterprise costs, and ensure data security.

This article describes how to connect to the MaxCompute database.

1.3 Data volume attention

If the acceleration parameter is used, when the data volume exceeds the 100w limit, the parameter autoSelectLimit=1000000000 needs to be added.

2.1 Configuration information

• <maxcompute_endpoint>: Endpoint of the region where the MaxCompute service is located. For example, the endpoint of the extranet in East China 1 (Hangzhou) area is http://service.cn-hangzhou.maxcompute.aliyun.com/api.

• <maxcompute_project_name>: MaxCompute project space name.

For details, please refer to: JDBC Reference Instructions.

2.2 Steps

2.2.1 Install driver isolation plugin

Download the plugin, please click: 

fr-plugin-maxcompute-driver-loader-2.5.zip

Please refer to the plugin installation method: Plugin management.

2.2.2 Add the driver

1) Create a new folder under the FineBI path %FineBI%/webapps/webroot/WEB-INF, the folder name is "maxcomputedriverlib".

2) Download the driver under section 2.1, and place two JAR packages in this folder, as shown in the following figure:

Among them, odps-jdbc-3.2.8-jar-with-dependencies.jar is the driver package; slf4j-log4j12-1.7.16.jar is the jar related to the java log framework. Both jar packages must be placed in the path to ensure that they are connected to the database.

3) Restart FineBI.

2.2.3 Configure data connection

1) Go to "Manage>Data Connection Management>New Data Connection>All" and find "MaxCompute", as shown in the figure below:

2) Enter your own configuration information according to section 2.1, as shown in the figure below:

3) Click "Test Connection", if the connection is successful, click "Save", as shown below:

3.1 Official document

MaxCompute official document: MaxCompute Alibaba Cloud official document

DataWorks official document: DataWorks Alibaba Cloud official document

Users can use DataWorks to visually manage MaxCompute.

3.2 Quick query (MXQA)

The quick query function of MaxCompute:

• It can speed up and optimize query jobs with medium and small data volumes, reduce query jobs whose execution time is minutes to seconds, and are fully compatible with the original MaxCompute query functions.

• MCQA supports connecting mainstream BI tools or SQL clients to MaxCompute projects to perform ad hoc or business intelligence (BI) analysis.

• MCQA uses an independent resource pool, does not occupy a quota group, can automatically identify query jobs, relieve queuing pressure, and optimize user experience.

For details, please refer to: Overview of Accelerated Query

How to enable quick query (MCQA) in FineBI

Add &interactiveMode=true after the URL in Section 2.1

For details, please refer to: Instructions for Speeding Up Query.

3.3 How does FineBI access data when table has partitions

In MaxCompute, if a table has partitions added, you cannot directly add a "Database table" in FineBI for access, but use the "SQL dataset".

For example, there is a table "test" in MaxCompute with two partitions(fenqu) "A, B". Add "SQL dataset", enter the sentence: select * from test where fenqu = A to fetch data.

When the class "XMLEventFactory" is not found, open the path: %FineBI%\webapps\webroot\WEB-INF\maxcomputedriverlib, open the odps driver in the file, and delete all the contents under the driver javax\xml. As shown below: