4.2.13 Update Log

FineDataLink V4.2.13.2 introduces the Encoding configuration in General Configuration. If you roll back the upgrade, you must contact technical support personnel to adjust the encoding configuration. Otherwise,  anomalies on the General Configuration page will occur as the older version's code is incompatible with the new encoding configuration.

Scheduled Task Supporting the Server Message Block Data Source

FineDataLink supports connection to Server Message Block data sources for data reading and writing using scheduled tasks.

Optimization of the JSON Generation Operator

1. If an array is nested three levels deep, no sub-arrays are permitted at any deeper level.

2. Direct nesting of arrays, for example, [[1,2,3],[4,5,6]]) is not supported.

3. Multiple parallel arrays are allowed at the same nested level. If sub-arrays contain multiple values and other fields outside the sub-arrays share identical values, no data merging or deduplication will be performed, ensuring all data is preserved in the aggregation result.

4. The JSON-Template-Based Generation panel features a draft autosave mechanism. The edit will be automatically saved after you click Save Draft or Generate.

Selecting String Fields as Splitting Keys for Parallel Reading Using Scheduled Tasks

After enabling Parallel Read in a scheduled task, you can select a string field as the splitting key.

Supporting the HTTPS Protocol for SelectDB, Doris, and StarRocks Data Sources

FineDataLink now supports connection to SelectDB, Doris, and StarRocks data sources via the HTTPS protocol.

Optimization of Table Selection Logic for SAP ERP

If Configuration Method in an SAP ERP Input operator is set to Table Selection, the system will first attempt to use the FDL_EXTRACT_TABLE_DATA function in the target system for data fetching. If this function does not exist, the system will use the RFC_READ_TABLE function.

Real-Time Pipeline Tasks Supporting Parallel Synchronization During Full Synchronization

A new Parallel Synchronization During Full Sync configuration has been added to real-time pipeline tasks, enabling parallel synchronization of inventory data when a real-time pipeline task is started for the first time or rerun after an exception. It can significantly improve the efficiency of full synchronization and reduce the recovery costs of re-synchronization.

Support for Oracle Physical Standby - ADG Mode

Real-Time Pipeline now supports connection to Oracle physical standby databases for data fetching, reducing performance pressure on the primary database caused by log parsing and minimizing the impact on core business systems.

Renaming the WeCom Chatbot Notification Channel WeCom Group Message Push

The WeCom Chatbot notification channel has been renamed WeCom Group Message Push. This change applies to all relevant settings within the product.

Support for Writing to KingbaseES (Oracle) and SelectDB Data Sources Using Data-Receiving APIs

The data-receiving APIs support data writing to KingbaseES (Oracle) and SelectDB data sources.

Optimization of General Configuration

New Encoding Configuration

Before optimization: If the character encoding and collation of the source and target tables were inconsistent, manual adjustments were required, resulting in limited flexibility.  

After optimization: The configuration content of Auto Table Creation Configuration has been moved to Case Format. An Encoding setting item has been added, which enables automatic conversion of character encoding and collation without manual intervention, improving configuration flexibility and synchronization efficiency.

For details, see General Configuration - Auto Table Creation Configuration.

Optimization of Interactive Experience

Auto Table Creation Configuration and Field Mapping Rule are now managed on different tab pages independently.

New Scheduled Task Timeout Notification

A Timeout Notification checkbox has been added to Notification Content of scheduled tasks, which allows setting task timeout reminders to notify O&M personnel for prompt processing.

For details, see Task Control - Result Notification.

Optimization of the Jiandaoyun Output Operator

If you set Write Method in the Jiandaoyun Output operator to Write Data into Target Table After Emptying It, the system will first delete all existing data in the target table, which may lead to a large number of deletion records accumulating in the Jiandaoyun recycle bin, thereby occupying storage space. If this write method is selected, you are advised to clean up the Jiandaoyun recycle bin regularly.

For the Jiandaoyun exclusive edition, you can contact technical support personnel to enable hard deletion, where data is permanently removed without being transferred to the recycle bin, reducing storage usage.

Scheduled Tasks Supporting Invocation of Scheduled Pipeline Tasks

You may want data processing workflows to be triggered immediately after scheduled pipeline tasks fetch data from application data sources to ensure a seamless transition from data synchronization to processing.

This version introduces a Scheduled Pipeline Task Invocation node, allowing you to invoke scheduled pipeline tasks within scheduled tasks.

Support for Copying Scheduled Pipeline Tasks

You can now copy scheduled pipeline tasks to specified locations. 

Scheduled Tasks Supporting Parallel Reading for GaussDB 100/GaussDB T Data Sources

You can now enable Parallel Read for GaussDB 100/GaussDB T data sources within scheduled tasks.

For details, see GaussDB 100/GaussDB T Data Connection.

Optimization of Real-Time Pipeline Task Configuration for SQL Server Data Sources

Users unfamiliar with the specific implementation principles of SQL Server databases might encounter the following issues when entering the configuration page:

• The required fields did not appear in the field list.

• Tables to be synchronized did not appear in the selection list.

Starting from this version, FineDataLink provides prompts for scenarios not supported by implementation principles during real-time pipeline task configuration. For details, see Microsoft SQL Server Data Connection.