DB Table Output (Real-Time Task)

• Optimized the interaction of primary key configuration.

• Supported new stream insertion without a primary key.

• Supported timestamp marking.

You can select a database table for data writing.

• You can select Auto Created Table.

• You can describe the table.

• You can create tables manually.

The configuration is the same as that in DB Table Output in scheduled tasks.

• Existing Table: You cannot modify the primary key setting of the existing table.

• Auto Created Table: You can set primary keys for a target table according to its characteristics.

Write Method

Write Method:

1. Write Data into Target Table Directly is supported only.

2. You can tick Logical Deletion.

3. You can enable Timestamp Marking, which is supported in FineDataLink of V4.2.1.4 and later versions.

4. You can configure primary key mapping, which is supported in FineDataLink of V4.2.1.4 and later versions.

With Timestamp Marking enabled:

• The system automatically adds/maintains a timestamp field recording data insertion time to/in the target table.

• The field name is _fdl_update_timestamp, which is the same as the timestamp field name in Data Pipeline.

Primary Key Mapping:

1. You can select fields as logical primary keys for mapping to ensure data uniqueness.

If the target table has a physical primary key, the primary key mapping is obtained automatically, which cannot be modified.

If the target table has no physical primary key, you can select one or more configured field mapping rows for logical primary key mapping.

2. You can skip primary key mapping in specific scenarios when writing data into Doris, StarRocks, and ClickHouse databases. For details, see StarRocks Instruction, Doris Instruction, and ClickHouse Data Connection.