Common Spark SQL Syntax

=

Equal operator

A=B. Returns TRUE if the A value is equal to the B value. Returns FALSE otherwise.

In FineDataLink, you can use Data Filtering instead.

<> 

Not equal operator

A <> B. Returns NULL if the A value is NULL or the B value is NULL. Returns TRUE if the A value is unequal to the B value. Returns FALSE otherwise.

In FineDataLink, you can use Data Filtering instead.

< 

Less than operator

A < B. Returns NULL if the A value is NULL or the B value is NULL. Returns TRUE if the A value is less than the B value. Returns FALSE otherwise.

In FineDataLink, you can use Data Filtering instead.

<=

Less than or equal operator

A <= B. Returns NULL if the A value is NULL or the B value is NULL. Returns TRUE if the A value is less than or equal to the B value. Returns FALSE otherwise.

In FineDataLink, you can use Data Filtering instead.

>=

Greater than or equal operator

A >= B. Returns NULL if the A value is NULL or the B value is NULL. Returns TRUE if the A value is greater than or equal to the B value. Returns FALSE otherwise.

In FineDataLink, you can use Data Filtering instead.

IS NULL

NULL value test

A IS NULL. Returns TRUE if the A value is NULL. Returns FALSE otherwise.

In FineDataLink, you can use Data Filtering instead.

IS NOT NULL

NOT NULL value test

A IS NOT NULL. Returns FALSE if the A value is NULL. Returns TRUE otherwise.

In FineDataLink, you can use Data Filtering instead.

LIKE

Fuzzy matching

Syntax one: A LIKE B 

Syntax two: LIKE (A, B) 

Expression type: string 

Return value type: boolean or NULL 

Returns NULL if either the A value or the B value is NULL. 

Returns TRUE if the A value matches the regular syntax of the expression B. Returns FALSE otherwise. With LIKE you can only use the percent sign (%) and the underscore (_) as the wildcard character in the expression B, where % matches any number of characters, even zero characters, and _ matches exactly one character. (You can use multiple underscores, with each representing a character.) 

For example, select Football like %ba from Test and select like (Football, _otba%) from Test.

FineDataLink makes fuzzy querying and filtering easier by visualizing the process, improving efficiency. For details, seeFuzzy Field Querying/Filtering.

AND

Logical AND

A AND B.

Returns TRUE if both the A value and the B value are TRUE. Returns FALSE otherwise.

OR

Logical OR

A OR B.

Returns TRUE if either the A value or the B value is TRUE. Returns FALSE otherwise.

SELECT to_json(named_struct('a', 1, 'b',   2));

{"a":1,"b":2}

SELECT to_json(map('a', named_struct('b',   1)));

{"a":{"b":1}}

SELECT to_json(array(map('a', 1)));

[{"a":1}]

To convert text to a JSON array:

SELECT to_json(split('a,b,c', ',')) AS   jsonArray

["a", "b",   "c"]