Data Storage Path

  • Last update:  2024-04-04
  • Overview

    Version

    FineBI Version

    Functional Change

    6.0

    /

    6.0.9

    You can configure the absolute storage path of extracted data through node files in the cluster extraction environment.

    Application Scenario

    FineBI will extract data from the database to the disk if you use extracted data. You may want to know where extracted data will be stored.

    Function Description

    This document introduces where the extracted data is stored and how to modify the data storage path.

    Standalone/Web Cluster Data Update Storage Path

    The default path for data updates is in the FineBI project package, with the default path being %FineBI%\webapps\webroot\bi-data\spider . Because data updates contain important data, you store the extracted data separately from the project package for security. Therefore, FineBI provides the option to modify the data storage path.

    iconNote:

    You are advised to start FineBI in the recommended way, otherwise the new data storage path will be modified after you restart FineBI.

    Modifying the Path

    1. Choose Public Data, click Global Update and you can see the data storage path. You can modify this path, as shown in the following figure.

    27c8ab65b00188e03646956e9f3e510.png

    iconNote:

    When entering the path here, you need to pay attention to the differences of path formats among different systems. This example demonstrates the Windows system.

    2. After you click OK, the data storage path is modified successfully.

    44c80381bc9005b67716b24553c8093.png

    iconNote:

    The modification can take effect only the new folder for storage must be empty.

    Effect Display

    Open the path D:\BI Data Storage , and you can see that the files of data updates have been stored in the db folder, as shown in the following figure.

    d0780a1e098af88fac58dc8ad47d673.png

    iconNote:

    After modifying the storage path, the files of data updates in the previous path will be moved to the current modified path (not copied and pasted to).

    After modifying the storage path, the temporary file temp will also be moved to the new path, as shown in the following figure.

    497e7c146164f6f05d36698517ef339.png

    Spider Cluster Data Update Storage Path

    Viewing Path

    Log in to the FineBI system as the admin, choose System Management > System Setting > Cluster Extraction, and you can view the storage path of the extracted data for each node on the Node Management page, as shown in the following figure.

    抽取集群.png

    Modifying Path

    1. Go to the path WEB-INF/config , open the node's corresponding folder config, and modify the file spider.cluster.properties.

    2. Add the parameter and its corresponding value of the newly-modified storage path spider_local_base_path=absolute path , as shown in the following figure.

    iconNote:

    In the absolute path, the separator cannot be \, and it must be /.

    1683530491886965.png

    1683530501615845.png

    Restarting the Project Node

    1. After you have modified the storage path, re-log in to the FineBI system as the admin, and choose System Management > System Setting > Cluster Extraction. You can see the status of the corresponding node has become DOWN, and then delete the node.

    2. Manually delete the bi-data file in the webapps\webroot directory of the node.

    3. Restart the project node to make the configuration take effect. The polars and spider files in the previous path webapps\webroot\bi-data will be regenerated in the current modified path.

    Composition of Data Update Files

    File Type

    There are three types of files in the data update storage path: associated cache files, temporary files of data files, and single table folders.

    Associated cache files: files that the names start with ##R#T

    Temporary files for data files: files that the names start with dummyT

    Single table file: files that the names start with T

    15c960d5ccc8ecd5b45862066e335aa.png

    Deleting Temporary Files

    After the data update is completed, the system will delete the temporary files.

    However, if you had a data update failure before, then those temporary files left in that failed update will be retained as junk files to occupy the computer memory rather than deleted by the system.

    When FineBI has not performed data updates, you need to check if there are files that the names start with dummyT in the storage path of data updates. If there are, you can manually delete the files.

    附件列表


    主题: Data Center
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy