Spark Connect for Scala 3
API
Generated with
Spark Connect for Scala 3/org.apache.spark/org.apache.spark.sql/org.apache.spark.sql.connect/org.apache.spark.sql.connect.client/SparkConnectClient/Builder

Builder

org.apache.spark.sql.connect.client.SparkConnectClient.Builder
class Builder(var configuration: Configuration)

Fluent builder for a SparkConnectClient.

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

def connectionString(connectionString: String): Builder

Configures the builder from a Spark Connect connection string of the form sc://host:port/;param1=value1;param2=value2.

Configures the builder from a Spark Connect connection string of the form sc://host:port/;param1=value1;param2=value2.

Attributes

def grpcKeepAliveEnabled(enabled: Boolean): Builder

Whether to send gRPC/HTTP2 keepalive PINGs to detect a silently-dead connection.

Whether to send gRPC/HTTP2 keepalive PINGs to detect a silently-dead connection.

Attributes

def grpcKeepAliveEnabled: Boolean
def grpcKeepAliveTimeMs(timeMs: Long): Builder

Idle time before sending a keepalive PING, in milliseconds.

Idle time before sending a keepalive PING, in milliseconds.

Attributes

def grpcKeepAliveTimeoutMs(timeoutMs: Long): Builder

Time to wait for a keepalive PING acknowledgement before failing, in milliseconds.

Time to wait for a keepalive PING acknowledgement before failing, in milliseconds.

Attributes

def grpcKeepAliveWithoutCalls(enabled: Boolean): Builder

Whether to keep sending keepalive PINGs while there are no in-flight RPCs.

Whether to keep sending keepalive PINGs while there are no in-flight RPCs.

Attributes

def host(inputHost: String): Builder
def maxRetryExceptionElapsedTime(duration: FiniteDuration): Builder

Bounds the total time spent resuming an execution that keeps needing to reattach.

Bounds the total time spent resuming an execution that keeps needing to reattach.

Attributes

def option(key: String, value: String): Builder
def port(inputPort: Int): Builder
def reattachable(enabled: Boolean): Builder

Enables or disables reattachable execution (resilient, resumable result streams).

Enables or disables reattachable execution (resilient, resumable result streams).

Attributes

def rpcDeadlines(deadlines: RpcDeadlines): Builder

Sets the per-RPC deadlines; use RpcDeadlines.disabled to turn them all off.

Sets the per-RPC deadlines; use RpcDeadlines.disabled to turn them all off.

Attributes

def sessionId(id: String): Builder
def token(t: String): Builder
def userAgent(agent: String): Builder
def userId(id: String): Builder
def userName(name: String): Builder
Generated with