StreamingQueryManager
Manages all the StreamingQuery instances active in a single SparkSession. Use SparkSession.streams to access this.
Mirrors the public surface of org.apache.spark.sql.streaming.StreamingQueryManager over the Spark Connect protocol. Every method issues a StreamingQueryManagerCommand to the server and reads the typed result back from the response stream.
Value parameters
- spark
-
the session whose streaming queries are managed.
Attributes
- Graph
-
- Supertypes
-
class Objecttrait Matchableclass Any
Members list
Value members
Concrete methods
Returns an array of the currently active queries associated with this session.
Returns an array of the currently active queries associated with this session.
Attributes
Registers a StreamingQueryListener to receive streaming-query lifecycle events. The first registration opens the server's listener-event stream; events are dispatched on the client.
Registers a StreamingQueryListener to receive streaming-query lifecycle events. The first registration opens the server's listener-event stream; events are dispatched on the client.
Attributes
Waits until any of the active queries on the associated session terminates, blocking the current thread.
Waits until any of the active queries on the associated session terminates, blocking the current thread.
Attributes
- Returns
-
whether any query has terminated.
Waits until any of the active queries on the associated session terminates, blocking the current thread, or until timeoutMs milliseconds have elapsed.
Waits until any of the active queries on the associated session terminates, blocking the current thread, or until timeoutMs milliseconds have elapsed.
Attributes
- Returns
-
whether any query has terminated within the timeout.
Returns the active query identified by id, or null if no active query with that id exists.
Returns the active query identified by id, or null if no active query with that id exists.
Attributes
Returns the listeners currently registered with this session.
Returns the listeners currently registered with this session.
Attributes
Deregisters a previously added StreamingQueryListener.
Forgets about the past terminated queries so that awaitAnyTermination can be used again to wait for new terminations.
Forgets about the past terminated queries so that awaitAnyTermination can be used again to wait for new terminations.