4.2.12 Update Log

Introduction of Availability Restrictions for Global Parameters

You can now limit global parameters to specific users or tasks, which helps control parameter access and standardize parameter usage.

For details, see Global Parameter - Static Parameter and Global Parameter - Assignment Parameter.

Introduction of Password-Type Static Parameters

The supported value types for static parameters now include Password, addressing the risk of password exposure from storing and displaying plaintext and thereby enhancing account security.

For details, see Global Parameter - Static Parameter.

Optimization of Date/Boolean-Type Static Parameter Configuration

For details, see Global Parameter - Static Parameter and Custom Parameter (Static Parameter).

Parameter Description Support

You can now customize parameter descriptions to clarify the purposes, facilitating understanding and maintenance.

For details, see Global Parameter - Static Parameter, Global Parameter - Assignment Parameter, Parameter Assignment, Parameter Output, and Custom Parameter (Static Parameter).

Optimization of HDFS Setting for Hadoop Hive Data Connections

You can now customize the HDFS loading path for archived intermediate tables and configure extended parameters in HDFS Setting when configuring Hadoop Hive data connections.

For details, see Hadoop Hive Data Connection.

Support for Specifying the Storage Format to Write Data into Hadoop Hive Tables

 If you select Hadoop Hive as the data destination and set Target Table to Auto Created Table, you can select the storage format of the target table as needed.

For details, see Hadoop Hive Data Connection.

Support for the KingbaseES (Oracle) Data Source

FineDataLink supports connection to KingbaseES (Oracle) data sources with the following functions available:

• Data reading/writing using Scheduled Task

• Data reading/writing using Real-Time Pipeline Task

• Data writing using real-time tasks

• Data query API creation in Data Service

Optimization of the KingbaseES (PostgreSQL) Data Source

Before optimization: 

The KingbaseES (PostgreSQL) data source was classified as Other JDBC in FineDataLink.

After optimization: 

A KingbaseES (PostgreSQL) data source type has been added, simplifying the configuration process.

New OSS-HDFS Configuration for the Hadoop Hive Data Source

The Hadoop Hive data source now supports the OSS-HDFS configuration, enabling direct data writing to the OSS-HDFS service via scheduled tasks, meeting end-to-end full-link data writing requirements.

For details, see Hadoop Hive Data Connection.

Removal of fetchsize Configuration for Certain Data Sources

To mitigate the risk of service crashes that may arise from invalid custom fetchSize configuration, the configuration entry of this function has been temporarily removed in this iteration for the following data sources: MySQL, Doris, StarRocks, SelectDB, and Alibaba Cloud AnalyticDB.

Support for Calling Stored Procedures During Data Query API Configuration

You can now call stored procedures in databases to fetch data when configuring data query APIs, as shown in the following figure.

For details, see Function Description of Data Query API.

Support for Setting Data Types for Generated Fields During Data-Receiving API Configuration

Before optimization: 

During the configuration of data-receiving APIs (General API Request Body), the recognized data types of fields generated after JSON parsing could be inaccurate, and manual adjustment was not supported.

After optimization: 

During the configuration of data-receiving APIs (General API Request Body), you can now set data types for fields generated after parsing, preventing data distortion or loss during data parsing and writing to the database.

Support for the Vastbase G100 (Oracle) Data Source

FineDataLink supports connection to Vastbase G100 (Oracle) data sources with the following functions available:

• Data reading/writing using Scheduled Task

• Data Service

• Database Table Management

For details, see Vastbase G100 (Oracle) Data Connection.

Support for Specifying the Value Source in Parameter Assignment by Column Name

Before optimization: 

Under Parameter Assignment > Output Parameter > Value Source, you could only specify the column by index. Once the column order was changed, parameter value fetching issues might occur.

After optimization: 

A Specified Column Name option has been added in Value Source, enabling column selection by column name to supply parameter values. Even if the column order is changed, parameter values will be fetched correctly.

For details, see Parameter Assignment.

Transaction Control Now Available for SelectDB and Doris Data Sources

The Transaction Control function is available when a SelectDB or Doris data source is selected as the target end.

For details, see Data Synchronization - Write Method.

Supporting the Informix Data Source for Data Query APIs

You can now release data query APIs using the Informix data source, as shown in the following figure.

For details, see Function Description of Data Query API.

Statistical Content Optimization

To improve the readability of statistical content:

• The entries have been sorted by start time in chronological order by default. You can also sort them by clicking column headers.

• The number of entries per page has been increased to 10.

For details, see Introduction to the Scheduled Task Page.

Lineage Analysis Now Available for the YMatrix Database

If a YMatrix database is used as the source end and Configuration Method is set to SQL, lineage analysis is available.

For details, see Lineage Analysis.