Spark Connect for Scala 3
API
Generated with
Spark Connect for Scala 3/org.apache.spark/org.apache.spark.sql/SparkSession/Builder

Builder

org.apache.spark.sql.SparkSession.Builder
class Builder

Builder for SparkSession.

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

def appName(name: String): Builder
def config(key: String, value: String): Builder
def config(key: String, value: Boolean): Builder
def config(key: String, value: Long): Builder
def config(key: String, value: Double): Builder
def create(): SparkSession

Builds a brand-new session.

Builds a brand-new session.

Attributes

def getOrCreate(): SparkSession

Returns the active session if present, otherwise builds and registers a new one.

Returns the active session if present, otherwise builds and registers a new one.

Attributes

def remote(connectionString: String): Builder

Configures the connection from a Spark Connect connection string (sc://...).

Configures the connection from a Spark Connect connection string (sc://...).

Attributes

def userAgent(agent: String): Builder

Sets the user agent reported to the server.

Sets the user agent reported to the server.

Attributes

Generated with