Field Setting

  • Last update: March 18, 2025
  • Overview

    Version

    FineDataLink Version

    Functional Change

    3.7

    Added a Field Setting operator in the Overview of Data 

    Transformation node, allowing you to select and rename 

    fields in the data flow, as well as convertiong data types 

    of these fields.

    4.1.5.3

    • Supported batch deletion and restoration of fields. Fordetails, see the "Field Setting" section.

    • Optimized the interactive experience.

    4.1.5.5

    Optimized the interactive experience.

    Function Overview

    The Field Setting operator allows you to perform the following operations on input data:

    • Delete some fields.

    • Rename fields.

    • Change the data type.

    Example

    Preparation

    This document uses the example in the Data Association document to illustrate the Field Setting function.

    Adding a Field Setting Operator

    Add a Field Setting operator between the Left Join and DB Table Output operators. Connect the Field Setting operator with the Left Join and DB Table Output operators, as shown in the following figure.

     

    Click the Field Setting operator to view table fields after a left join, as shown in the following figure.

     

    Field Setting

    This section takes the following operations as examples to illustrate the Field Setting function.

    • Delete the Name1 field.

    • Rename the Name field Student_Name.

    • Change the data types of English_Score and Math_Score to int.

    The following figure shows the Field Setting page where these operations are finished.

     

    The following table describes the setting items.

    Setting Item

    Description

    Checkbox

    You can tick fields and perform batch deletion and restoration, as shown in the following 

    figure.

    Field Name

    It lists output field names, which are editable.

    The output field name should meet the following requirements.

    • The field name cannot be empty.

    • The length must be within 30 characters.

    • The field name can only consist of letters (from a to z, which is case-sensitive), digits (from 0 to 9), underscores (_), and Chinese characters.

    • Spaces are not allowed.

    • The field name cannot be duplicated with other valid field names.

    iconNote: Duplicate field name detection is performed upon field modification. If a duplicate column name is detected,  the system throws the erro "Duplicate Spark columns.For example, if the A and B fields exist, an error will occur when you rename the field B as the field name B already exists.

    Type

    You can select from the following data types.

    • int

    • long

    • float

    • double

    • date

    • timestamp

    • binary

    • boolean

    • varchar

    Change Record

    It displays the modification type. You   can filter Modified and Unmodified fields.

    Time Format

    The Time Format column is displayed only when the field data is of the time type.

    Options in the drop-down list include:

    1)yyyy-MM-dd HH:mm:ss

    • It is the default time format of fields whose data type is changed from varchar to      timestamp.

    • It is the default time format of fields whose data type is changed from timestamp to varchar.

    In the format, yyyy represents a four-digit year, MM represents a month, dd represents a day, HH represents a 24-hour format hour, mm represents a minute, ss represents a 

    second, and SS represents a millisecond.

    2)yyyy-MM-dd

    • It is the default time format of fields whose data type is changed from varchar to         date.

    • It is the default time format of fields whose data type is changed from date to          varchar.

    3)yyyyMMddHHmmss

    4)yyyyMMdd

    Configuring Data Output

    Click the DB Table Output operator, set the target table to Auto Created Table, and name it Test_Score, as shown in the following figure.

     

    Running the Task

    Click Save in the upper right corner to save the design in the Data Transformation node, as shown in the following figure.

     

    Go back to the Date Development page and click Run in the upper right corner, as shown in the following figure. After successful execution, a message indicating successful execution will be displayed in Log.

     

    The data in the Test_Score table is shown in the following figure.

     

    附件列表


    主题: Data Development - Scheduled Task
    Previous
    Next
    • Helpful
    • Not helpful
    • Only read

    滑鼠選中內容,快速回饋問題

    滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。

    不再提示

    10s後關閉

    Get
    Help
    Online Support
    Professional technical support is provided to quickly help you solve problems.
    Online support is available from 9:00-12:00 and 13:30-17:30 on weekdays.
    Page Feedback
    You can provide suggestions and feedback for the current web page.
    Pre-Sales Consultation
    Business Consultation
    Business: international@fanruan.com
    Support: support@fanruan.com
    Page Feedback
    *Problem Type
    Cannot be empty
    Problem Description
    0/1000
    Cannot be empty

    Submitted successfully

    Network busy