Limiting the Amount of Dataset Extraction

Version

Description

When business personnel add a basic table or self-service dataset, there will be the following hidden troubles due to their lack of understanding of the disk situation:

A certain user added a dataset with a large amount of data, severely occupying disk resources and affecting the overall project and others' usage.

A heavy burden on the system update due to unrestrained setting of update tasks with large amounts of data of users.

Implementation Method

FineBI has added a control parameter SystemOptimizationConfig.tableLoadDataLimit, through which you can control the amount of data extracted.

1. Modify the value of SystemOptimizationConfig.tableLoadDataLimit to 1000000 (corresponds to the number of limited cells). For details, see FINE_CONF_ENTITY Visualization Configuration.

2. Restart FineBI for the parameters to take effect.

3. After the parameters take effect, you cannot successfully update basic tables or self-service datasets with data volumes exceeding 1 million. An error occurred in Update Information, as shown in the following figure.