Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 8, 2023

• [CELEBORN-1112] Inform celeborn application is shutdown, then celeborn cluster can release resource immediately

  Show description for 931880a
  

  RexXiong

  authored and

  waitinfuture

  committed
  931880a

  Copy full SHA for 931880a

Commits on Nov 7, 2023

• [CELEBORN-1109] Cache RegisterShuffleResponse to improve the processing speed of LifecycleManager

  Show description for ffbbe25
  

  kerwin-zk

  authored and

  waitinfuture

  committed
  ffbbe25

  Copy full SHA for ffbbe25

Commits on Nov 4, 2023

• [CELEBORN-1048][FOLLOWUP] MR module compile

  Show description for 4465a92
  

  cxzl25

  authored and

  waitinfuture

  committed
  4465a92

  Copy full SHA for 4465a92

Commits on Nov 3, 2023

• [CELEBORN-1081] Client support celeborn.storage.activeTypes config

  Show description for 5e77b85
  

  FMX

  authored and

  RexXiong

  committed
  5e77b85

  Copy full SHA for 5e77b85

• [CELEBORN-1058] Support specifying the number of dispatcher threads for each role

  Show description for 7b185a2
  

  onebox-li

  authored and

  waitinfuture

  committed
  7b185a2

  Copy full SHA for 7b185a2

Commits on Nov 2, 2023

• [CELEBORN-1048] Align fetchWaitTime metrics to spark implementation

  Show description for 0583cdb
  

  2 peopleauthored and

  pan3793

  committed
  0583cdb

  Copy full SHA for 0583cdb

Commits on Nov 1, 2023

• [CELEBORN-1059] Fix callback not update if push worker excluded during retry

  Show description for cd8acf8
  

  onebox-li

  authored and

  waitinfuture

  committed
  cd8acf8

  Copy full SHA for cd8acf8

Commits on Oct 31, 2023

• [CELEBORN-1098] Logging worker address with worker failure log

  Show description for e02cde0
  

  cxzl25

  authored and

  waitinfuture

  committed
  e02cde0

  Copy full SHA for e02cde0

• [CELEBORN-1099] Check register when handleGetReducerFileGroup

  Show description for f6cc377
  

  onebox-li

  authored and

  waitinfuture

  committed
  f6cc377

  Copy full SHA for f6cc377

• [CELEBORN-1102] Optimize the performance of getAllPrimaryLocationsWithMinEpoch

  Show description for 2ce8d6f
  kerwin-zk

  committed
  2ce8d6f

  Copy full SHA for 2ce8d6f

• [CELEBORN-1095] Support configuration of fastest available XXHashFactory instance for checksum of Lz4Decompressor

  Show description for 3092644
  

  SteNicholas

  authored and

  kerwin-zk

  committed
  3092644

  Copy full SHA for 3092644

Commits on Oct 27, 2023

• [CELEBORN-1032][FOLLOWUP] Use scheduleWithFixedDelay instead of scheduleAtFixedRate in threads pool of master and worker

  Show description for df40a28
  

  SteNicholas

  authored and

  waitinfuture

  committed
  df40a28

  Copy full SHA for df40a28

Commits on Oct 23, 2023

• [MINOR] Remove unnecessary increment index of Master#timeoutDeadWorkers

  Show description for 49ea881
  

  SteNicholas

  authored and

  FMX

  committed
  49ea881

  Copy full SHA for 49ea881

Commits on Oct 16, 2023

• [CELEBORN-1042] Calculate duration using nanotime in CelebornInputStream

  Show description for 34e6c19
  

  cxzl25

  authored and

  waitinfuture

  committed
  34e6c19

  Copy full SHA for 34e6c19

Commits on Oct 13, 2023

• [CELEBORN-1040] Adjust local read logs and refine createReader

  Show description for 6b3c108
  

  onebox-li

  authored and

  waitinfuture

  committed
  6b3c108

  Copy full SHA for 6b3c108

Commits on Oct 9, 2023

• [CELEBORN-1024] Thread factory should set UncaughtExceptionHandler to handle uncaught exception

  Show description for 56276e9
  

  SteNicholas

  authored and

  pan3793

  committed
  56276e9

  Copy full SHA for 56276e9

• [CELEBORN-1022][TEST] Update log level from FATAL to ERROR for console output in unit tests

  Show description for b2412d0
  

  cfmcgrady

  authored and

  waitinfuture

  committed
  b2412d0

  Copy full SHA for b2412d0

• [CELEBORN-980] Asynchronously delete original files to fix ReusedExchange bug

  Show description for c4135dc
  

  cfmcgrady

  authored and

  waitinfuture

  committed
  c4135dc

  Copy full SHA for c4135dc

Commits on Sep 14, 2023

• [CELEBORN-839][MR] Support Hadoop MapReduce

  Show description for e0c00ec
  

  FMX

  authored and

  waitinfuture

  committed
  e0c00ec

  Copy full SHA for e0c00ec

Commits on Sep 8, 2023

• [CELEBORN-957] Simplify nano time duration calculation

  Show description for 38a6816
  

  cxzl25

  authored and

  waitinfuture

  committed
  38a6816

  Copy full SHA for 38a6816

Commits on Sep 6, 2023

• [CELEBORN-627][FLINK][FOLLOWUP] Support split partitions

  Show description for b1e3d66
  zhongqiangczq

  committed
  b1e3d66

  Copy full SHA for b1e3d66

Commits on Sep 4, 2023

• [CELEBORN-943][PERF] Pre-create CelebornInputStreams in CelebornShuffleReader

  Show description for a42ec85
  waitinfuture

  committed
  a42ec85

  Copy full SHA for a42ec85

Commits on Sep 1, 2023

• [CELEBORN-627][FLINK] Support split partitions

  Show description for b66eaff
  

  zhongqiangczq

  and

  FMX

  committed
  b66eaff

  Copy full SHA for b66eaff

Commits on Aug 30, 2023

• [CELEBORN-752] Support read local shuffle file for spark

  Show description for 505ba80
  

  FMX

  authored and

  waitinfuture

  committed
  505ba80

  Copy full SHA for 505ba80

Commits on Aug 29, 2023

• [CELEBORN-830] Check available workers in CelebornShuffleFallbackPolicyRunner

  Show description for 4625484
  

  SteNicholas

  authored and

  waitinfuture

  committed
  4625484

  Copy full SHA for 4625484

Commits on Aug 24, 2023

• [CELEBORN-498] Add new config for DfsPartitionReader's chunk size

  Show description for 57a35ca
  

  lishiyucn

  and

  waitinfuture

  committed
  57a35ca

  Copy full SHA for 57a35ca

Commits on Aug 22, 2023

• [CELEBORN-901] Add support for Scala 2.13

  Show description for d6c4334
  

  cfmcgrady

  authored and

  waitinfuture

  committed
  d6c4334

  Copy full SHA for d6c4334

Commits on Aug 17, 2023

• [CELEBORN-899] Fix potential NPE in ShuffleClientImpl#revive

  Show description for 30d979f
  

  lyy-pineapple

  authored and

  waitinfuture

  committed
  30d979f

  Copy full SHA for 30d979f

Commits on Aug 14, 2023

• [CELEBORN-892][TEST] Fix statistics error of commitFiles method

  Show description for 307872d
  

  jiaoqingbo

  authored and

  waitinfuture

  committed
  307872d

  Copy full SHA for 307872d

Commits on Aug 8, 2023

• [CELEBORN-876] Enhance log to find out failed workers if data lost

  Show description for 3ec2188
  FMX

  committed
  3ec2188

  Copy full SHA for 3ec2188

Commits on Aug 7, 2023

• [CELEBORN-152] Add config to limit max workers when offering slots

  Show description for 6ea1ee2
  waitinfuture

  committed
  6ea1ee2

  Copy full SHA for 6ea1ee2

Commits on Aug 5, 2023

• [CELEBORN-760] Convert OpenStream and StreamHandler to Pb

  Show description for ea39a93
  

  FMX

  and

  waitinfuture

  committed
  ea39a93

  Copy full SHA for ea39a93

Commits on Aug 2, 2023

• [CELEBORN-875][FOLLOWUP] Enhance DataPushQueueSuiteJ for thread safety and prevent NullPointerException

  Show description for 39ab731
  

  cfmcgrady

  authored and

  waitinfuture

  committed
  39ab731

  Copy full SHA for 39ab731

Commits on Jul 31, 2023

• [CELEBORN-726][FOLLOWUP] Amend method names

  Show description for 6cd1355
  waitinfuture

  committed
  6cd1355

  Copy full SHA for 6cd1355

• [CELEBORN-860][DOC] Document on ShuffleClient

  Show description for 3593adf
  waitinfuture

  committed
  3593adf

  Copy full SHA for 3593adf

Pagination

Previous

Next