Search results

A new feature to optimize partitions size.

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 53573

#53573 In apache/spark;

· dotsering opened on Dec 23, 2025

[SPARK-54812][SQL] Make executable commands not execute on resultDf.cache()

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 53572

#53572 In apache/spark;

· szehon-ho opened on Dec 23, 2025

[SPARK-54804][CONNECT] Reduce conf RPCs SparkSession.createDataset(..)

CONNECT

SQL

Status: Open (in progress).

apache/sparknumber 53568

#53568 In apache/spark;

· hvanhovell opened on Dec 22, 2025

[SPARK-51731][Core][WIP] Introduce a new callback "onQueryExecutionStart" to StreamingQueryListener

CONNECT

PYTHON

SQL

STRUCTURED STREAMING

WEB UI

Status: Draft (not ready).

apache/sparknumber 53558

#53558 In apache/spark;

· JevonCowell opened on Dec 22, 2025

[SPARK-54759][SQL] SQL scripting Cursor support

CONNECT

DOCS

SQL

Status: Open (in progress).

apache/sparknumber 53530

#53530 In apache/spark;

· srielau opened on Dec 18, 2025

[WIP][CONNECT] Read ChunkedLocalRelation from BlockManager

CONNECT

SQL

Status: Draft (not ready).

apache/sparknumber 53497

#53497 In apache/spark;

· hvanhovell opened on Dec 17, 2025

[SPARK-54660][SS] Add RTM trigger to python

CONNECT

PYTHON

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 53448

#53448 In apache/spark;

· jerrypeng opened on Dec 11, 2025

[SPARK-54670][CONNECT] Rework Connect Literal handling

CONNECT

ML

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 53430

#53430 In apache/spark;

· hvanhovell opened on Dec 10, 2025

[WIP][SPARK-54660][SS] Add RTM trigger to python and tests

BUILD

CONNECT

PYTHON

STRUCTURED STREAMING

Status: Draft (not ready).

apache/sparknumber 53415

#53415 In apache/spark;

· jerrypeng opened on Dec 10, 2025

[WIP][SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF)

CONNECT

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 53400

#53400 In apache/spark;

· Yicong-Huang opened on Dec 9, 2025

[SPARK-54630][SQL] Add timestamp_bucket function for temporal bucketing

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 53376

#53376 In apache/spark;

· vinodkc opened on Dec 7, 2025

[SPARK-54588][SQL] Add time_format function to convert TIME values to formatted string representations

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 53320

#53320 In apache/spark;

· vinodkc opened on Dec 4, 2025