Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Jun 13, 2024

• [CELEBORN-775][FOLLOWUP] Fix executorCores calculation in SparkShuffleManager for Spark2 local mode

  Show description for e177a20
  

  cxzl25

  authored and

  SteNicholas

  committed
  e177a20

  Copy full SHA for e177a20

Commits on May 17, 2024

• [CELEBORN-1402] SparkShuffleManager print warning log for spark.executor.userClassPathFirst=true with ShuffleManager defined in user jar

  Show description for 9908035
  SteNicholas

  committed
  9908035

  Copy full SHA for 9908035

Commits on May 16, 2024

• [CELEBORN-1422] Remove tmpRecords array when collecting written count metrics

  Show description for 90db37b
  

  onebox-li

  authored and

  waitinfuture

  committed
  90db37b

  Copy full SHA for 90db37b

• [CELEBORN-1424] Fix getChunk NPE when enable local read

  Show description for cbaef74
  

  onebox-li

  authored and

  waitinfuture

  committed
  cbaef74

  Copy full SHA for cbaef74

Commits on May 15, 2024

• [CELEBORN-1369][FOLLOWUP] Improve docs for shuffle fallback policy

  Show description for e66d509
  

  pan3793

  and

  cfmcgrady

  committed
  e66d509

  Copy full SHA for e66d509

Commits on May 14, 2024

• [CELEBORN-1419] Avoid adding shuffle id repeatedly

  Show description for 0591959
  

  huangxiaopingRD

  authored and

  SteNicholas

  committed
  0591959

  Copy full SHA for 0591959

Commits on May 3, 2024

• [CELEBORN-1369] Support for disable fallback to Spark's default shuffle

  Show description for 7b1645f
  

  xinyuwang1

  and

  waitinfuture

  committed
  7b1645f

  Copy full SHA for 7b1645f

Commits on Apr 19, 2024

• [CELEBORN-1387] Allow more retries when requesting more memory in sortbasedpusher

  Show description for 4095c8c
  

  CodingCat

  authored and

  waitinfuture

  committed
  4095c8c

  Copy full SHA for 4095c8c

Commits on Mar 27, 2024

• [INFRA] Remove incubator/incubating for graduation

  Show description for c9b878a
  

  SteNicholas

  authored and

  FMX

  committed
  c9b878a

  Copy full SHA for c9b878a

Commits on Mar 25, 2024

• [CELEBORN-1144] Batch OpenStream RPCs

  Show description for fc23800
  

  waitinfuture

  authored and

  RexXiong

  committed
  fc23800

  Copy full SHA for fc23800

• [CELEBORN-1309][FOLLOWUP] Cap the max memory can be used for sort buffer

  Show description for c6c319d
  

  CodingCat

  and

  waitinfuture

  committed
  c6c319d

  Copy full SHA for c6c319d

Commits on Mar 21, 2024

• [MINOR] Unifiy license format of pom.xml

  Show description for d62f75f
  

  SteNicholas

  authored and

  RexXiong

  committed
  d62f75f

  Copy full SHA for d62f75f

Commits on Mar 13, 2024

• [CELEBORN-1309] Support adaptive management of memory threshold for SortBasedWriter

  Show description for 2e25145
  

  CodingCat

  authored and

  waitinfuture

  committed
  2e25145

  Copy full SHA for 2e25145

Commits on Mar 3, 2024

• [CELEBORN-1301] Catch and throw FetchFailedException in CelebornInputStream#fillBuffer

  Show description for cae4de1
  waitinfuture

  committed
  cae4de1

  Copy full SHA for cae4de1

Commits on Feb 29, 2024

• [CELEBORN-1298] Support Spark2.4 with Scala2.12

  Show description for af8c159
  waitinfuture

  committed
  af8c159

  Copy full SHA for af8c159

• [CELEBORN-1271] Fix unregisterShuffle with celeborn.client.spark.fetch.throwsFetchFailure disabled

  Show description for 6d9fbf5
  

  ErikFang

  authored and

  waitinfuture

  committed
  6d9fbf5

  Copy full SHA for 6d9fbf5

Commits on Feb 25, 2024

• [CELEBORN-1287] Improve both combine and sort operation of shuffle read for CelebornShuffleReader

  Show description for ac5fad5
  

  SteNicholas

  authored and

  waitinfuture

  committed
  ac5fad5

  Copy full SHA for ac5fad5

Commits on Feb 20, 2024

• [CELEBORN-1265][FOLLOWUP] Remove unnecessary GlutenShuffleDependencyHelper

  Show description for d720a69
  

  kerwin-zk

  authored and

  SteNicholas

  committed
  d720a69

  Copy full SHA for d720a69

Commits on Feb 16, 2024

• [CELEBORN-1078] Log info to indicate columnar shuffle writer take effect

  Show description for 73707a9
  

  turboFei

  authored and

  waitinfuture

  committed
  73707a9

  Copy full SHA for 73707a9

Commits on Feb 7, 2024

• [CELEBORN-1267] Add config to control worker check in CelebornShuffleFallbackPolicyRunner

  Show description for c183753
  

  kerwin-zk

  authored and

  waitinfuture

  committed
  c183753

  Copy full SHA for c183753

• [CELEBORN-1265] Fix batches read metric for gluten columnar shuffle

  Show description for 7b2b9f7
  

  kerwin-zk

  authored and

  waitinfuture

  committed
  7b2b9f7

  Copy full SHA for 7b2b9f7

Commits on Jan 30, 2024

• [CELEBORN-1250][FOLLOWUP] Fix license issues

  Show description for fd944b2
  FMX

  committed
  fd944b2

  Copy full SHA for fd944b2

Commits on Jan 23, 2024

• [CELEBORN-1242] Unify celeborn thread name format

  Show description for 67e6cbf
  

  AngersZhuuuu

  authored and

  FMX

  committed
  67e6cbf

  Copy full SHA for 67e6cbf

Commits on Jan 10, 2024

• [CELEBORN-1202][FOLLOWUP] Update LICENSE and NOTICE files

  Show description for bb86074
  pan3793

  committed
  bb86074

  Copy full SHA for bb86074

Commits on Jan 9, 2024

• [CELEBORN-1209][FOLLOW] Warning Shuffle Tracking

  Show description for df9b6ac
  

  zwangsheng

  authored and

  pan3793

  committed
  df9b6ac

  Copy full SHA for df9b6ac

Commits on Jan 5, 2024

• Revert "[CELEBORN-1209][FOLLOW] Fix warning based on Spark Enabled ShuffleTracking after Spark 3.4"

  Show description for 21f5e62
  pan3793

  committed
  21f5e62

  Copy full SHA for 21f5e62

• [CELEBORN-1209][FOLLOW] Fix warning based on Spark Enabled ShuffleTracking after Spark 3.4

  Show description for 865f6f3
  

  zwangsheng

  authored and

  pan3793

  committed
  865f6f3

  Copy full SHA for 865f6f3

• [CELEBORN-1211] Add extension for celeborn shuffle handler

  Show description for 735650e
  

  FMX

  authored and

  waitinfuture

  committed
  735650e

  Copy full SHA for 735650e

Commits on Jan 4, 2024

• [CELEBORN-1150] Revert "[] support io encryption for spark"

  Show description for a3c28d0
  

  FMX

  authored and

  waitinfuture

  committed
  a3c28d0

  Copy full SHA for a3c28d0

Commits on Jan 3, 2024

• [CELEBORN-1190][FOLLOWUP] Apply error prone patch and suppress some problems

  Show description for 9f8a6bc
  

  cxzl25

  authored and

  waitinfuture

  committed
  9f8a6bc

  Copy full SHA for 9f8a6bc

Commits on Jan 2, 2024

• [CELEBORN-1209][CLIENT] Print Warning Log if User use Celeborn with enabled Spark ShuffleTracking

  Show description for 4cd880c
  

  zwangsheng

  authored and

  waitinfuture

  committed
  4cd880c

  Copy full SHA for 4cd880c

• [CELEBORN-1204] Update NOTICE year 2024

  Show description for ecd577e
  pan3793

  committed
  ecd577e

  Copy full SHA for ecd577e

Commits on Jan 1, 2024

• [CELEBORN-891] Remove pipeline feature for sort based writer

  Show description for 77e4681
  

  pan3793

  authored and

  waitinfuture

  committed
  77e4681

  Copy full SHA for 77e4681

Commits on Dec 21, 2023

• [CELEBORN-1172][SPARK] Support dynamic switch shuffle push write mode based on partition number

  Show description for 4304be1
  

  2 peopleauthored and

  waitinfuture

  committed
  4304be1

  Copy full SHA for 4304be1

Commits on Dec 20, 2023

• [CELEBORN-1190] Apply error prone patch and suppress some problems

  Show description for 7f653ce
  

  cxzl25

  authored and

  cfmcgrady

  committed
  7f653ce

  Copy full SHA for 7f653ce

Pagination

Previous

Next