Search results

[SPARK-52663][SDP] Introduce name field to pipeline spec

PYTHON

Status: Open (in progress).

apache/sparknumber 51353

#51353 In apache/spark;

· sryza opened on Jul 3, 2025

[SPARK-52503][SQL][CONNECT][4.0] Fix drop when the input column is not existent

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51348

#51348 In apache/spark;

· zhengruifeng opened on Jul 2, 2025

[SPARK-52640][SDP] Propagate Python Source Code Location

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51344

#51344 In apache/spark;

· AnishMahto opened on Jul 1, 2025

[WIP][SPARK-52622][PS] Avoid CAST_INVALID_INPUT of <code>DataFrame.melt</code> in ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Draft (not ready).

apache/sparknumber 51326

#51326 In apache/spark;

· xinrong-meng opened on Jul 1, 2025

[SPARK-52615][CORE] Replace File.mkdirs with Utils.createDirectory

AVRO

CONNECT

CORE

DSTREAM

PYTHON

SQL

STRUCTURED STREAMING

WEB UI

YARN

Status: Open (in progress).

apache/sparknumber 51322

#51322 In apache/spark;

· pan3793 opened on Jun 30, 2025

[SPARK-51051][SQL]Add an optional parameter for <code>array_position</code> function to specify starting index for matching.

CONNECT

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51317

#51317 In apache/spark;

· konjac opened on Jun 29, 2025

[MINOR][DOCS] Updated the docstring of DataStreamWriter.foreach() method

PYTHON

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51316

#51316 In apache/spark;

· nagaarjun-p opened on Jun 29, 2025

[SPARK-52593][PS] Avoid CAST_INVALID_INPUT of <code>Series.dot</code> and <code>DataFrame.dot</code> in ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51310

#51310 In apache/spark;

· xinrong-meng opened on Jun 27, 2025

[SPARK-52592][PS] Prevent error when creating ps.Series from ps.Series

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51300

#51300 In apache/spark;

· petern48 opened on Jun 27, 2025

[SPARK-52580][PS] Avoid CAST_INVALID_INPUT of <code>replace</code> in ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51297

#51297 In apache/spark;

· xinrong-meng opened on Jun 26, 2025

[WIP][PYTHON] Arrow UDF for aggregation

CONNECT

CORE

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51292

#51292 In apache/spark;

· zhengruifeng opened on Jun 26, 2025

[SPARK-52561][PYTHON][INFRA] Upgrade the minimum version of Python to 3.10

BUILD

DOCS

INFRA

PYTHON

Status: Draft (not ready).

apache/sparknumber 51259

#51259 In apache/spark;

· zhengruifeng opened on Jun 24, 2025