SparkConnectClient

org.apache.spark.sql.connect.client.SparkConnectClient
See theSparkConnectClient companion object

The low-level client that talks to a Spark Connect server over gRPC.

It owns the gRPC channel, the (stable) session id, the user context and the user agent, and exposes the RPCs used by the public API: ExecutePlan, AnalyzePlan, Config, Interrupt, ReleaseSession, and GetStatus.

Attributes

Companion
object
Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

def getOperationStatuses(operationIds: Seq[String], operationExtensions: Seq[Any], requestExtensions: Seq[Any]): GetStatusResponse

Returns the status of operations in this session (Spark 4.2+ servers): of the operations with the given ids, or of all operations when operationIds is empty.

Returns the status of operations in this session (Spark 4.2+ servers): of the operations with the given ids, or of all operations when operationIds is empty.

Value parameters

operationExtensions

per-operation extension messages to include in the request.

operationIds

operation ids to report on; empty means all operations in the session.

requestExtensions

request-level extension messages to include in the request.

Attributes

Returns

the full GetStatusResponse, including operationStatuses and any extensions.

def host: String
def port: Int
def shutdown(): Unit
def userAgent: String

Concrete fields

val sessionId: String

The stable session id shared by all requests issued through this client.

The stable session id shared by all requests issued through this client.

Attributes