Substream

Substream is a not physical stream and only available at query time.

You can create substreams together with tumble/hop/session windows for a particular primary key, to maintain separate watermarks and streaming windows.

For example:

SELECT window_start, window_end, cid, count(*), max(speed_kmh)
FROM session(car_live_data, 1m) PARTITION BY cid
GROUP BY window_start, window_end

It will create session windows for each car with 1 minute idle time. Meaning if the car is not moved within one minute, the window will be closed and a new session window will be created for future events. If the car keeps moving for more than 5 minutes, different windows will be created (every 5 minutes).