Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 21, 2024

• [CELEBORN-1544][FOLLOWUP] ShuffleWriter needs to catch exception and call abort to avoid memory leaks

  Show description for bc3bd46
  

  cxzl25

  authored and

  waitinfuture

  committed
  bc3bd46

  Copy full SHA for bc3bd46

Commits on Aug 12, 2024

• [CELEBORN-1518] Add support for Apache Spark barrier stages

  Show description for 3234bef
  

  mridulm

  authored and

  waitinfuture

  committed
  3234bef

  Copy full SHA for 3234bef

Commits on Aug 2, 2024

• [CELEBORN-1544] ShuffleWriter needs to call close finally to avoid memory leaks

  Show description for 48ce9b9
  

  cxzl25

  authored and

  waitinfuture

  committed
  48ce9b9

  Copy full SHA for 48ce9b9

Commits on Jul 25, 2024

• [CELEBORN-1190][FOLLOWUP] Fix WARNING of error prone

  Show description for c0ca952
  

  SteNicholas

  authored and

  Mridul Muralidharan

  committed
  c0ca952

  Copy full SHA for c0ca952

Commits on Jul 18, 2024

• [CELEBORN-1446] Enable chunk prefetch when initialize CelebornInputStream

  Show description for d692e49
  

  waitinfuture

  authored and

  RexXiong

  committed
  d692e49

  Copy full SHA for d692e49

• [CELEBORN-1515] SparkShuffleManager should set lifecycleManager to null after stopping lifecycleManager in Spark 2

  Show description for 0dc84a5
  

  SteNicholas

  authored and

  pan3793

  committed
  0dc84a5

  Copy full SHA for 0dc84a5

Commits on Jul 11, 2024

• [CELEBORN-1500] Filter out empty InputStreams

  Show description for 1ed9245
  

  waitinfuture

  authored and

  FMX

  committed
  1ed9245

  Copy full SHA for 1ed9245

• [CELEBORN-1495] CelebornColumnDictionary supports dictionary of float and double column type

  Show description for 70e3b24
  

  SteNicholas

  authored and

  FMX

  committed
  70e3b24

  Copy full SHA for 70e3b24

Commits on Jun 13, 2024

• [CELEBORN-775][FOLLOWUP] Fix executorCores calculation in SparkShuffleManager for Spark2 local mode

  Show description for e177a20
  

  cxzl25

  authored and

  SteNicholas

  committed
  e177a20

  Copy full SHA for e177a20

Commits on May 17, 2024

• [CELEBORN-1402] SparkShuffleManager print warning log for spark.executor.userClassPathFirst=true with ShuffleManager defined in user jar

  Show description for 9908035
  SteNicholas

  committed
  9908035

  Copy full SHA for 9908035

Commits on May 16, 2024

• [CELEBORN-1422] Remove tmpRecords array when collecting written count metrics

  Show description for 90db37b
  

  onebox-li

  authored and

  waitinfuture

  committed
  90db37b

  Copy full SHA for 90db37b

• [CELEBORN-1424] Fix getChunk NPE when enable local read

  Show description for cbaef74
  

  onebox-li

  authored and

  waitinfuture

  committed
  cbaef74

  Copy full SHA for cbaef74

Commits on May 15, 2024

• [CELEBORN-1369][FOLLOWUP] Improve docs for shuffle fallback policy

  Show description for e66d509
  

  pan3793

  and

  cfmcgrady

  committed
  e66d509

  Copy full SHA for e66d509

Commits on May 14, 2024

• [CELEBORN-1419] Avoid adding shuffle id repeatedly

  Show description for 0591959
  

  huangxiaopingRD

  authored and

  SteNicholas

  committed
  0591959

  Copy full SHA for 0591959

Commits on May 3, 2024

• [CELEBORN-1369] Support for disable fallback to Spark's default shuffle

  Show description for 7b1645f
  

  xinyuwang1

  and

  waitinfuture

  committed
  7b1645f

  Copy full SHA for 7b1645f

Commits on Apr 19, 2024

• [CELEBORN-1387] Allow more retries when requesting more memory in sortbasedpusher

  Show description for 4095c8c
  

  CodingCat

  authored and

  waitinfuture

  committed
  4095c8c

  Copy full SHA for 4095c8c

Commits on Mar 27, 2024

• [INFRA] Remove incubator/incubating for graduation

  Show description for c9b878a
  

  SteNicholas

  authored and

  FMX

  committed
  c9b878a

  Copy full SHA for c9b878a

Commits on Mar 25, 2024

• [CELEBORN-1144] Batch OpenStream RPCs

  Show description for fc23800
  

  waitinfuture

  authored and

  RexXiong

  committed
  fc23800

  Copy full SHA for fc23800

• [CELEBORN-1309][FOLLOWUP] Cap the max memory can be used for sort buffer

  Show description for c6c319d
  

  CodingCat

  and

  waitinfuture

  committed
  c6c319d

  Copy full SHA for c6c319d

Commits on Mar 21, 2024

• [MINOR] Unifiy license format of pom.xml

  Show description for d62f75f
  

  SteNicholas

  authored and

  RexXiong

  committed
  d62f75f

  Copy full SHA for d62f75f

Commits on Mar 13, 2024

• [CELEBORN-1309] Support adaptive management of memory threshold for SortBasedWriter

  Show description for 2e25145
  

  CodingCat

  authored and

  waitinfuture

  committed
  2e25145

  Copy full SHA for 2e25145

Commits on Mar 3, 2024

• [CELEBORN-1301] Catch and throw FetchFailedException in CelebornInputStream#fillBuffer

  Show description for cae4de1
  waitinfuture

  committed
  cae4de1

  Copy full SHA for cae4de1

Commits on Feb 29, 2024

• [CELEBORN-1298] Support Spark2.4 with Scala2.12

  Show description for af8c159
  waitinfuture

  committed
  af8c159

  Copy full SHA for af8c159

• [CELEBORN-1271] Fix unregisterShuffle with celeborn.client.spark.fetch.throwsFetchFailure disabled

  Show description for 6d9fbf5
  

  ErikFang

  authored and

  waitinfuture

  committed
  6d9fbf5

  Copy full SHA for 6d9fbf5

Commits on Feb 25, 2024

• [CELEBORN-1287] Improve both combine and sort operation of shuffle read for CelebornShuffleReader

  Show description for ac5fad5
  

  SteNicholas

  authored and

  waitinfuture

  committed
  ac5fad5

  Copy full SHA for ac5fad5

Commits on Feb 20, 2024

• [CELEBORN-1265][FOLLOWUP] Remove unnecessary GlutenShuffleDependencyHelper

  Show description for d720a69
  

  kerwin-zk

  authored and

  SteNicholas

  committed
  d720a69

  Copy full SHA for d720a69

Commits on Feb 16, 2024

• [CELEBORN-1078] Log info to indicate columnar shuffle writer take effect

  Show description for 73707a9
  

  turboFei

  authored and

  waitinfuture

  committed
  73707a9

  Copy full SHA for 73707a9

Commits on Feb 7, 2024

• [CELEBORN-1267] Add config to control worker check in CelebornShuffleFallbackPolicyRunner

  Show description for c183753
  

  kerwin-zk

  authored and

  waitinfuture

  committed
  c183753

  Copy full SHA for c183753

• [CELEBORN-1265] Fix batches read metric for gluten columnar shuffle

  Show description for 7b2b9f7
  

  kerwin-zk

  authored and

  waitinfuture

  committed
  7b2b9f7

  Copy full SHA for 7b2b9f7

Commits on Jan 30, 2024

• [CELEBORN-1250][FOLLOWUP] Fix license issues

  Show description for fd944b2
  FMX

  committed
  fd944b2

  Copy full SHA for fd944b2

Commits on Jan 23, 2024

• [CELEBORN-1242] Unify celeborn thread name format

  Show description for 67e6cbf
  

  AngersZhuuuu

  authored and

  FMX

  committed
  67e6cbf

  Copy full SHA for 67e6cbf

Commits on Jan 10, 2024

• [CELEBORN-1202][FOLLOWUP] Update LICENSE and NOTICE files

  Show description for bb86074
  pan3793

  committed
  bb86074

  Copy full SHA for bb86074

Commits on Jan 9, 2024

• [CELEBORN-1209][FOLLOW] Warning Shuffle Tracking

  Show description for df9b6ac
  

  zwangsheng

  authored and

  pan3793

  committed
  df9b6ac

  Copy full SHA for df9b6ac

Commits on Jan 5, 2024

• Revert "[CELEBORN-1209][FOLLOW] Fix warning based on Spark Enabled ShuffleTracking after Spark 3.4"

  Show description for 21f5e62
  pan3793

  committed
  21f5e62

  Copy full SHA for 21f5e62

• [CELEBORN-1209][FOLLOW] Fix warning based on Spark Enabled ShuffleTracking after Spark 3.4

  Show description for 865f6f3
  

  zwangsheng

  authored and

  pan3793

  committed
  865f6f3

  Copy full SHA for 865f6f3

Pagination

Previous

Next