Trigger

org.apache.spark.sql.streaming.Trigger
See theTrigger companion trait
object Trigger

Attributes

Companion
trait
Graph
Supertypes
class Object
trait Matchable
class Any
Self type
Trigger.type

Members list

Value members

Concrete methods

Processes all available data, possibly in multiple micro-batches, then stops.

Processes all available data, possibly in multiple micro-batches, then stops.

Attributes

def Continuous(interval: String): Trigger

Continuous processing with the given checkpoint interval (e.g. "1 second").

Continuous processing with the given checkpoint interval (e.g. "1 second").

Attributes

def Continuous(intervalMs: Long): Trigger

Continuous processing with the given checkpoint interval in milliseconds.

Continuous processing with the given checkpoint interval in milliseconds.

Attributes

def Continuous(interval: Long, timeUnit: TimeUnit): Trigger

Continuous processing with the given checkpoint interval (in timeUnit).

Continuous processing with the given checkpoint interval (in timeUnit).

Attributes

def Continuous(interval: Duration): Trigger

Continuous processing with the given checkpoint interval.

Continuous processing with the given checkpoint interval.

Attributes

def ProcessingTime(interval: String): Trigger

Runs a micro-batch every interval of processing time (e.g. "10 seconds").

Runs a micro-batch every interval of processing time (e.g. "10 seconds").

Attributes

def ProcessingTime(intervalMs: Long): Trigger

Runs a micro-batch every intervalMs milliseconds of processing time.

Runs a micro-batch every intervalMs milliseconds of processing time.

Attributes

def ProcessingTime(interval: Long, timeUnit: TimeUnit): Trigger

Runs a micro-batch every interval (in timeUnit) of processing time.

Runs a micro-batch every interval (in timeUnit) of processing time.

Attributes

def ProcessingTime(interval: Duration): Trigger

Runs a micro-batch every interval of processing time.

Runs a micro-batch every interval of processing time.

Attributes

def RealTime(batchDuration: String): Trigger

Real-time mode (Spark 4.2+) with batches of the given duration (e.g. "10 seconds"): records are processed as they arrive, for sources and sinks that support it.

Real-time mode (Spark 4.2+) with batches of the given duration (e.g. "10 seconds"): records are processed as they arrive, for sources and sinks that support it.

Attributes

def RealTime(batchDurationMs: Long): Trigger

Real-time mode with batches of batchDurationMs milliseconds.

Real-time mode with batches of batchDurationMs milliseconds.

Attributes

def RealTime(batchDuration: Long, timeUnit: TimeUnit): Trigger

Real-time mode with batches of the given duration (in timeUnit).

Real-time mode with batches of the given duration (in timeUnit).

Attributes

def RealTime(batchDuration: Duration): Trigger

Real-time mode with batches of the given duration.

Real-time mode with batches of the given duration.

Attributes

def RealTime(): Trigger

Real-time mode with the default batch duration of 5 minutes.

Real-time mode with the default batch duration of 5 minutes.

Attributes

Deprecated methods

def Once(): Trigger

Processes all available data in one micro-batch, then stops.

Processes all available data in one micro-batch, then stops.

Attributes

Deprecated
true