projects

Open-source work I'm directly involved in. Star counts reflect a snapshot; see GitHub for current numbers.

apache/spark GitHub stars for apache/spark Top language in apache/spark

A unified analytics engine for large-scale data processing.

apache/arrow GitHub stars for apache/arrow Top language in apache/arrow

Universal columnar format and multi-language toolbox for fast data interchange.

py4j/py4j GitHub stars for py4j/py4j Top language in py4j/py4j

Enables Python programs to dynamically access arbitrary Java objects.

databricks/koalas GitHub stars for databricks/koalas Top language in databricks/koalas

Pandas API on Apache Spark. Co-led; merged upstream into PySpark as the pandas-on-Spark API in Spark 3.2.