Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 4, 2025

• [SPARK-50578][PYTHON][SS][FOLLOWUP] Change to use Thread.interrupt instead of Thread.stop to interrupt the execution of TransformWithStateInPandasPythonPreInitRunner#daemonThread

  Show description for 0d0fa86
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  0d0fa86

  Copy full SHA for 0d0fa86

• [SPARK-50716][CORE] Fix the cleanup logic for symbolic links in JavaUtils.deleteRecursivelyUsingJavaIO method

  Show description for 98dc763
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  98dc763

  Copy full SHA for 98dc763

Commits on Jan 3, 2025

• [SPARK-50493][SPARK-37687][BUILD] Migrate kubernetes-client from 6.x to 7.x

  Show description for dccb129
  

  panbingkun

  authored and

  dongjoon-hyun

  committed
  dccb129

  Copy full SHA for dccb129

• [SPARK-50678][BUILD] Clean up outdated style check rules related to Guava

  Show description for a59941a
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  a59941a

  Copy full SHA for a59941a

• [SPARK-50636][SQL] Extending CTESubstitution.scala to make it aware of recursion

  Show description for 580b3c0
  

  2 peopleauthored and

  cloud-fan

  committed
  580b3c0

  Copy full SHA for 580b3c0

• [SPARK-49087][SQL][CONNECT] Distinguish UnresolvedFunction calling internal functions

  Show description for b210f42
  

  xupefei

  and

  HyukjinKwon

  committed
  b210f42

  Copy full SHA for b210f42

• [SPARK-50717][PS][DOCS] Update doc and add examples for from_pandas

  Show description for 2acc969
  itholic

  committed
  2acc969

  Copy full SHA for 2acc969

• [SPARK-50715][PYTHON][CONNECT] SparkSession.Builder sets the configs in batch

  Show description for a3a8d1c
  zhengruifeng

  committed
  a3a8d1c

  Copy full SHA for a3a8d1c

• [SPARK-50614][SQL] Fix shredding debug message

  Show description for fa0c995
  

  cashmand

  authored and

  cloud-fan

  committed
  fa0c995

  Copy full SHA for fa0c995

• [SPARK-50311][TESTS][FOLLOWUP] Fix test name properly

  Show description for 032e531
  itholic

  committed
  032e531

  Copy full SHA for 032e531

• [SPARK-50710][CONNECT] Add support for optional client reconnection to sessions after release

  Show description for 9087d84
  

  vicennial

  authored and

  HyukjinKwon

  committed
  9087d84

  Copy full SHA for 9087d84

Commits on Jan 2, 2025

• [SPARK-50712][INFRA][PS][TESTS] Add a daily build for Pandas API on Spark with old dependencies

  Show description for c374c00
  zhengruifeng

  committed
  c374c00

  Copy full SHA for c374c00

• [SPARK-50711][PS][DOCS] Upgrade the minimum version of Pandas in PS to 2.2.0

  Show description for 3c0824d
  zhengruifeng

  committed
  3c0824d

  Copy full SHA for 3c0824d

• [SPARK-50614][SQL] Add Variant shredding support for Parquet

  Show description for 5c63484
  

  cashmand

  authored and

  cloud-fan

  committed
  5c63484

  Copy full SHA for 5c63484

• [SPARK-50683][SQL] Inline the common expression in With if used once

  Show description for 492fcd8
  

  zml1206

  authored and

  cloud-fan

  committed
  492fcd8

  Copy full SHA for 492fcd8

• [SPARK-50702][PYTHON] Refine the docstring of regexp_count, regexp_extract and regexp_extract_all

  Show description for 721a417
  

  drexlersky

  authored and

  zhengruifeng

  committed
  721a417

  Copy full SHA for 721a417

• [SPARK-50642][CONNECT][SS] Fix the state schema for FlatMapGroupsWithState in spark connect when there is no initial state

  Show description for 3f333a0
  

  huanliwang-db

  authored and

  HyukjinKwon

  committed
  3f333a0

  Copy full SHA for 3f333a0

Commits on Jan 1, 2025

• [SPARK-49491][SQL] Replace AnyRefMap with HashMap

  Show description for 1c79b54
  

  George314159

  authored and

  wangyum

  committed
  1c79b54

  Copy full SHA for 1c79b54

Commits on Dec 31, 2024

• [SPARK-50648][CORE] Cleanup zombie tasks in non-running stages when the job is cancelled

  Show description for 5334494
  

  yabola

  authored and

  Ngone51

  committed
  5334494

  Copy full SHA for 5334494

• [SPARK-50692] Add RPAD pushdown support

  Show description for e1fb18d
  

  andrej-db

  authored and

  cloud-fan

  committed
  e1fb18d

  Copy full SHA for e1fb18d

• [SPARK-50701][PYTHON] Make plotting require the minimum plotly version

  Show description for 8a09817
  zhengruifeng

  committed
  8a09817

  Copy full SHA for 8a09817

• [SPARK-50706][PYTHON][TESTS] Skip test_value_state_ttl_expiration in Coverage build

  Show description for 5ef556b
  HyukjinKwon

  committed
  5ef556b

  Copy full SHA for 5ef556b

• [SPARK-50697][SQL] Enable tail-recursion wherever possible

  Show description for 6099de7
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  6099de7

  Copy full SHA for 6099de7

• [SPARK-50689][SQL][FOLLOWUP] Enforce deterministic ordering in LCA aggregate lists

  Show description for c4145db
  

  mihailotim-db

  authored and

  HyukjinKwon

  committed
  c4145db

  Copy full SHA for c4145db

• [SPARK-49229][CONNECT] Deduplicate Scala UDF handling in the SparkConnectPlanner

  Show description for fd8230b
  

  xupefei

  authored and

  HyukjinKwon

  committed
  fd8230b

  Copy full SHA for fd8230b

• [SPARK-50699][PYTHON] Parse and generate DDL string with a specified session

  Show description for 4c39d6f
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  4c39d6f

  Copy full SHA for 4c39d6f

Commits on Dec 30, 2024

• [SPARK-50693][CONNECT] The inputs for TypedScalaUdf should be analyzed

  Show description for 43a9b88
  ueshin

  committed
  43a9b88

  Copy full SHA for 43a9b88

• [SPARK-50691][SQL][FOLLOWUP] Use UnsafeProjection for LocalRelation rows instead of ComparableLocalRelation

  Show description for 97ee25a
  

  vladimirg-db

  authored and

  cloud-fan

  committed
  97ee25a

  Copy full SHA for 97ee25a

• [SPARK-50688][SQL] Eliminate ambiguity for rowTag missing in xml write path

  Show description for 7d5aaaa
  yaooqinn

  committed
  7d5aaaa

  Copy full SHA for 7d5aaaa

• [SPARK-50696][PYTHON] Optimize Py4J call for DDL parse method

  Show description for 73a2ebb
  zhengruifeng

  committed
  73a2ebb

  Copy full SHA for 73a2ebb

Commits on Dec 28, 2024

• [SPARK-50632][BUILD] Upgrade tink to 1.16.0

  Show description for 31cb811
  panbingkun

  committed
  31cb811

  Copy full SHA for 31cb811

• [SPARK-50676][SQL] Remove unused private lazy val mapValueContainsNull from ElementAt

  Show description for 89fb67f
  LuciferYang

  committed
  89fb67f

  Copy full SHA for 89fb67f

• [SPARK-50690][SQL] Fix discrepancy in DESCRIBE TABLE view query output columns quoting

  Show description for c1e51f2
  

  asl3

  authored and

  HyukjinKwon

  committed
  c1e51f2

  Copy full SHA for c1e51f2

• [SPARK-50661][CONNECT][SS] Fix Spark Connect Scala foreachBatch impl. to support Dataset[T].

  Show description for 51b011f
  

  haiyangsun-db

  authored and

  HyukjinKwon

  committed
  51b011f

  Copy full SHA for 51b011f

Commits on Dec 27, 2024

• [SPARK-50689][SQL] Enforce deterministic ordering in LCA project lists

  Show description for af53ee4
  

  mihailotim-db

  authored and

  cloud-fan

  committed
  af53ee4

  Copy full SHA for af53ee4

Pagination

Previous

Next