🔎

    Query Data Stream

    The Query Data Stream node enables querying data streams in a way very similar to SQL SELECT through the use of Apache DataFusion.

    Configuration Options🔗

    • Inputs: The number of input ports to expose on the node. Increasing this number automatically adds input connectors to the node.
    • Outputs: The number of output ports to expose on the node. Each represents a SQL-style SELECT query. Increasing this number automatically adds output connectors to the node, as well as a new query field in the node configuration.
      • Query: The SQL-style SELECT query to execute on the input data stream. The query can be a simple SELECT statement or a more complex query with JOINs, WHERE clauses, and more.

    Each output query has access to all inputs. Inputs are named based on the input port number (e.g., input0, input1, etc.).

    Example🔗

    Simple query to select all data from the input stream:

    SELECT * FROM input0

    Query to select specific columns from the input stream:

    SELECT input0."Column1", input0.Column2" FROM input0

    Query to filter data based on a WHERE clause:

    SELECT * FROM input0 WHERE input0."Name" = 'value'

    Query to join two input streams:

    SELECT input0."ID", input0."Name", input1."Address" FROM input0 JOIN input1 ON input0."ID" = input1."ID"