Elasticsearch Input

  • Last update: April 24, 2026
  • Overview

    Version

    FineDataLink VersionFunctional Change
    4.2.0.2

    /

    4.2.11.4

    Supported the short field data type.

    Application Scenario

    Your business database is Elasticsearch. You need to periodically read data from Elasticsearch and write it to other databases (such as relational databases or other Elasticsearch instances).

    Function Description

    1. The Elasticsearch Input operator enables data reading from a specified Elasticsearch database, as shown in the following figure.

    2. You can use Elasticsearch as a data source in Data Synchronization, Parameter Assignment, and Global Assignment Parameter.

    Usage Restriction & Prerequisite

    Usage Restriction

    The supported Elasticsearch field data types are as follows:

    Supported Field Data Type

    INTEGER, LONG, DOUBLE, BINARY, BOOLEAN, KEYWORD, TEXT, DATE, and Short (from FineDataLink V4.2.11.4)

    Prerequisite

    1. You have registered the NoSQL function point.

    2. You have configured an Elasticsearch data connection and have the permission to use it. For details, see Elasticsearch Data Connection.

    Function Description

    The Data Source tab page is shown in the following figure.

    Setting Item
    Description

    Data Connection

    Select a configured Elasticsearch Data Connection on which you have permission.

    Configuration Method

    From Elasticsearch V6.3, Configuration Method is set to SQL by default.

    For Elasticsearch of versions earlier than V6.3, only Index Selection is available.

    SQL:

    You can write SQL statements to query and retrieve data from indexes in the Elasticsearch source database. Parameter referencing is also supported.

    You can select a specified index.

    Index Selection:

    Source Index: You can select an index from the drop-down list.

    You can filter data by writing DSL statements to define conditions. Provide a JSON object as the value of the query.

    • The content can be empty.

    • You can filter data from the source table by writing a WHERE clause using the syntax of the selected database (requiring no WHERE keyword).

    • Referencing parameters is supported.

    • Linking parameter values and fields in the index is supported.

    • LIMIT clauses are not supported.

    Procedure

    Your business database is Elasticsearch. You need to periodically read data from Elasticsearch and write it to other databases (such as relational databases or other Elasticsearch instances).

    Task Configuration

    Create a scheduled task, drag in a Data Transformation node, and enter the editing page. Drag in an Elasticsearch Input operator and extract data to be processed, as shown in the following figure.

    image 1.png

    Process data, as shown in the following figure.

    image 2.png

    Finally, drag in a DB Table Output operator and configure it. Run the task to write the data to the specified database, as shown in the following figure.

    image 3.png

    Effect Display

    After running the task, you can view the extracted Elasticsearch data in the output database, as shown in the following figure.

     

     


    附件列表


    主题: Data Development - Scheduled Task
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy