org.apache.spark.sql.types
Members list
Type members
Classlikes
A type for which the values can be ordered and compared.
A type for which the values can be ordered and compared.
Attributes
- Supertypes
- Known subtypes
-
object BinaryTypeobject BooleanTypeclass CharTypeobject DateTypeclass DayTimeIntervalTypeclass GeographyTypeclass GeometryTypeobject StringTypeclass TimeTypeclass TimestampLTZNanosTypeclass TimestampNTZNanosTypeobject TimestampNTZTypeobject TimestampTypeclass VarcharTypeobject VariantTypeclass YearMonthIntervalTypeShow all
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
BinaryType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
BooleanType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass NumericTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
ByteType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
CalendarIntervalType.type
A char(n) type.
A char(n) type.
Attributes
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
The base type of all Spark SQL data types.
The base type of all Spark SQL data types.
This mirrors org.apache.spark.sql.types.DataType from Apache Spark closely enough that schemas returned by a Spark Connect server can be represented faithfully on a pure Scala 3 client without depending on spark-catalyst.
Attributes
- Companion
- object
- Supertypes
-
trait Serializableclass Objecttrait Matchableclass Any
- Known subtypes
-
class ArrayTypeclass AtomicTypeobject BinaryTypeobject BooleanTypeclass CharTypeobject DateTypeclass DayTimeIntervalTypeclass GeographyTypeclass GeometryTypeobject StringTypeclass TimeTypeclass TimestampLTZNanosTypeclass TimestampNTZNanosTypeobject TimestampNTZTypeobject TimestampTypeclass VarcharTypeobject VariantTypeclass YearMonthIntervalTypeobject CalendarIntervalTypeclass MapTypeobject NullTypeclass NumericTypeobject ByteTypeclass DecimalTypeobject DoubleTypeobject FloatTypeobject IntegerTypeobject LongTypeobject ShortTypeclass StructTypeShow all
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
DateType.type
A day-time interval type covering a contiguous range of fields.
A day-time interval type covering a contiguous range of fields.
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
DayTimeIntervalType.type
A decimal type with the given precision and scale.
A decimal type with the given precision and scale.
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass NumericTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
DecimalType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass NumericTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
DoubleType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass NumericTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
FloatType.type
A GEOGRAPHY value: its Well-Known Binary (WKB) bytes plus a spatial reference identifier. Returned for GeographyType columns. Mirrors org.apache.spark.sql.types.Geography.
A GEOGRAPHY value: its Well-Known Binary (WKB) bytes plus a spatial reference identifier. Returned for GeographyType columns. Mirrors org.apache.spark.sql.types.Geography.
Attributes
- Companion
- object
- Supertypes
-
trait Serializableclass Objecttrait Matchableclass Any
The GEOGRAPHY type with spatial reference identifier srid (-1, rendered as any, means a mixed-SRID column). Values are represented as Geography. Mirrors org.apache.spark.sql.types.GeographyType (Spark 4.1+).
The GEOGRAPHY type with spatial reference identifier srid (-1, rendered as any, means a mixed-SRID column). Values are represented as Geography. Mirrors org.apache.spark.sql.types.GeographyType (Spark 4.1+).
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
GeographyType.type
A GEOMETRY value: its Well-Known Binary (WKB) bytes plus a spatial reference identifier. Returned for GeometryType columns. Mirrors org.apache.spark.sql.types.Geometry.
A GEOMETRY value: its Well-Known Binary (WKB) bytes plus a spatial reference identifier. Returned for GeometryType columns. Mirrors org.apache.spark.sql.types.Geometry.
Attributes
- Companion
- object
- Supertypes
-
trait Serializableclass Objecttrait Matchableclass Any
The GEOMETRY type with spatial reference identifier srid (-1, rendered as any, means a mixed-SRID column). Values are represented as Geometry. Mirrors org.apache.spark.sql.types.GeometryType (Spark 4.1+).
The GEOMETRY type with spatial reference identifier srid (-1, rendered as any, means a mixed-SRID column). Values are represented as Geometry. Mirrors org.apache.spark.sql.types.GeometryType (Spark 4.1+).
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
GeometryType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass NumericTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
IntegerType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass NumericTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
LongType.type
Metadata is a wrapper over a map that can be used to associate extra information with a StructField. The supported value types mirror Spark's Metadata: Long, Double, Boolean, String, and arrays / nested metadata thereof.
Metadata is a wrapper over a map that can be used to associate extra information with a StructField. The supported value types mirror Spark's Metadata: Long, Double, Boolean, String, and arrays / nested metadata thereof.
Attributes
- Companion
- object
- Supertypes
-
trait Serializableclass Objecttrait Matchableclass Any
Numeric data types.
Numeric data types.
Attributes
- Supertypes
- Known subtypes
-
object ByteTypeclass DecimalTypeobject DoubleTypeobject FloatTypeobject IntegerTypeobject LongTypeobject ShortTypeShow all
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass NumericTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
ShortType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
StringType.type
A field inside a StructType.
A field inside a StructType.
Attributes
- Companion
- object
- Supertypes
-
trait Serializabletrait Producttrait Equalsclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
StructField.type
A struct type, i.e. the schema of a row.
A struct type, i.e. the schema of a row.
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalstrait Iterable[StructField]trait IterableOnce[StructField]class DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
-
StructType.type
The TIME type: a time of day without a time zone, with precision digits of fractional seconds (0 to 9). Values are represented as java.time.LocalTime. Mirrors org.apache.spark.sql.types.TimeType (Spark 4.1+; the server gates it behind spark.sql.timeType.enabled).
The TIME type: a time of day without a time zone, with precision digits of fractional seconds (0 to 9). Values are represented as java.time.LocalTime. Mirrors org.apache.spark.sql.types.TimeType (Spark 4.1+; the server gates it behind spark.sql.timeType.enabled).
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
A timestamp with local time zone with nanosecond-capable precision (7 to 9 fractional-second digits). Values are represented as java.time.Instant. Mirrors org.apache.spark.sql.types.TimestampLTZNanosType (Spark 4.3+, a preview feature the server gates behind spark.sql.timestampNanosTypes.enabled).
A timestamp with local time zone with nanosecond-capable precision (7 to 9 fractional-second digits). Values are represented as java.time.Instant. Mirrors org.apache.spark.sql.types.TimestampLTZNanosType (Spark 4.3+, a preview feature the server gates behind spark.sql.timestampNanosTypes.enabled).
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
A timestamp without time zone with nanosecond-capable precision (7 to 9 fractional-second digits). Values are represented as java.time.LocalDateTime. Mirrors org.apache.spark.sql.types.TimestampNTZNanosType (Spark 4.3+, a preview feature the server gates behind spark.sql.timestampNanosTypes.enabled).
A timestamp without time zone with nanosecond-capable precision (7 to 9 fractional-second digits). Values are represented as java.time.LocalDateTime. Mirrors org.apache.spark.sql.types.TimestampNTZNanosType (Spark 4.3+, a preview feature the server gates behind spark.sql.timestampNanosTypes.enabled).
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
TimestampNTZType.type
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
TimestampType.type
A varchar(n) type.
A varchar(n) type.
Attributes
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Supertypes
-
trait Singletontrait Producttrait Mirrortrait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
- Self type
-
VariantType.type
A year-month interval type covering a contiguous range of fields.
A year-month interval type covering a contiguous range of fields.
Attributes
- Companion
- object
- Supertypes
-
trait Producttrait Equalsclass AtomicTypeclass DataTypetrait Serializableclass Objecttrait Matchableclass AnyShow all
Attributes
- Companion
- class
- Supertypes
-
trait Producttrait Mirrorclass Objecttrait Matchableclass Any
- Self type