RuntimeConfig

org.apache.spark.sql.RuntimeConfig

Runtime configuration interface for Spark, accessible via spark.conf. Reads and writes are delegated to the Spark Connect server's Config RPC.

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

def get(key: String): String

Returns the value of the given key. Throws if the key is not set and has no default.

Returns the value of the given key. Throws if the key is not set and has no default.

Attributes

def get(key: String, default: String): String

Returns the value of the given key, or default if not set.

Returns the value of the given key, or default if not set.

Attributes

def getAll: Map[String, String]

Returns all properties set in this configuration.

Returns all properties set in this configuration.

Attributes

def getOption(key: String): Option[String]

Returns the value of the given key as an Option.

Returns the value of the given key as an Option.

Attributes

def set(key: String, value: String): Unit

Sets the given Spark runtime configuration property.

Sets the given Spark runtime configuration property.

Attributes

def set(key: String, value: Boolean): Unit
def set(key: String, value: Long): Unit
def unset(key: String): Unit

Resets the given configuration property to its default value.

Resets the given configuration property to its default value.

Attributes