GBase 8a Data Connection

Version

Function Description

GBase 8a is a cloud-native analytical database independently developed by General Data Technology. It is designed primarily for data warehousing, business analytics, and business intelligence. It supports multiple data sources and data integration tools, making it suitable for cloud-native architectures and scenarios that require elastic scaling and real-time analytics.

FineDataLink supports connection to GBase 8a data sources for data reading and writing using Scheduled Task and data writing using Real-Time Pipeline Task and Real-Time Task.

Prerequisite

For details, see Overview of Data Connection.

The Big Data feature has been licensed.

Version and Driver

Download the driver package and upload it to FineDataLink. For details about driver uploading steps, see Driver Management.

GBase 8a clusters are supported.

Connection Information Collection

Collect the following information before connecting FineDataLink to the database:

• IP address and port number of the database server

• Database name

• Username and password of the database

Procedure

For details about data connection steps, see Data Source Connection and Management.

When configuring the data connection, select Custom from the Driver drop-down list and select the driver described in the "Version and Driver" section.

Scheduled Task

1. You can use data from this data source for data development.

2. Starting from FineDataLink 4.2.7.4, when GBase 8a is selected as the destination and the target table has a physical primary key or logical primary key mapping is configured, only the following strategies for primary key conflict are available:

• Update Data: Overwrite existing rows if the same Primary Key values exist.

• Throw an Error: Throw a node error and exclude conflicting rows from writing if the same Primary Key values exist.

Real-Time Pipeline

Note: 

LOB fields cannot be written into this database.

1. Data writing to existing partitioned tables is supported.

2. Distribution keys cannot be configured when the target table is automatically created.

3. Synchronizing source table structure change is supported with the following restrictions:

• For an INT field, only its comment can be modified.

• For a VARCHAR field, only its length and comment can be modified.

4. Parallel reading is not supported during full volume synchronization.

5. Physical primary keys are not supported; only logical primary keys are supported. Records with null primary key values can be updated or deleted.

6. When records with the same primary key are updated, the existing record is generally deleted before the new record is inserted. Because GBase 8a does not support transactions, if the insertion fails, the completed delete operation is not rolled back.

7. Under high concurrency, if multiple real-time pipeline tasks write to the same target table using the same logical primary key, duplicate primary key values may be generated. Since GBase 8a does not support transactions or physical primary keys, this issue cannot currently be avoided.

Real-Time Task

Note: 

LOB fields cannot be written into this database.

1. Data writing to existing partitioned tables is supported.

2. Distribution keys cannot be configured when the target table is automatically created.

3. Physical primary keys are not supported; only logical primary keys are supported. Records with null primary key values can be updated or deleted.

4. When records with the same primary key are updated, the existing record is generally deleted before the new record is inserted. Because GBase 8a does not support transactions, if the insertion fails, the completed delete operation is not rolled back.

General Configuration

Starting from FineDataLink V4.2.22.2, you can configure field mapping rules for this data source under System Management > General Configuration.