RpcDeadlines

org.apache.spark.sql.connect.client.RpcDeadlines

See theRpcDeadlines companion object

case class RpcDeadlines(reattachableExecutePlan: Option[FiniteDuration], reattachExecute: Option[FiniteDuration], analyzePlan: Option[FiniteDuration], addArtifacts: Option[FiniteDuration], config: Option[FiniteDuration], interrupt: Option[FiniteDuration], releaseSession: Option[FiniteDuration], artifactStatus: Option[FiniteDuration], cloneSession: Option[FiniteDuration], getStatus: Option[FiniteDuration], fetchErrorDetails: Option[FiniteDuration])

Per-RPC gRPC deadlines (timeouts). Each field bounds one RPC type; None disables the deadline for that RPC. The defaults match the Apache Spark 4.3 Connect clients.

reattachableExecutePlan and reattachExecute bound each individual result-stream segment, not the query: when one fires, the server-side operation keeps running and the client resumes with a fresh ReattachExecute stream. Non-reattachable ExecutePlan has no deadline because a timeout there would kill the execution with no way to recover.

 SparkConnectClient.builder().rpcDeadlines(RpcDeadlines(analyzePlan = Some(10.minutes)))
 SparkConnectClient.builder().rpcDeadlines(RpcDeadlines.disabled)

Attributes

Companion: object
Graph
Supertypes: trait Serializable

trait Product

trait Equals

class Object

trait Matchable

class Any
Show all

Members list

Value members

Concrete methods

Returns a string representation of the object.

The default representation is platform dependent.

Attributes

Returns: a string representation of the object.
Definition Classes: Any

Inherited methods

Attributes

Inherited from:: Product

Attributes

Inherited from:: Product

In this article

Generated with