Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 14, 2023

• [CELEBORN-1126] Set kubernetes resources field for master and worker init container for helm chart

  Show description for 7263f64
  

  marwansalem

  authored and

  RexXiong

  committed
  7263f64

Commits on Nov 13, 2023

• [CELEBORN-1106] Ensure data is written into flush buffer before sending message to client

  Show description for f0d4319
  

  2 peopleauthored and

  waitinfuture

  committed
  f0d4319

• [CELEBORN-1124] Exclude workers of shuffle manager remove worker of connect exception primary or replica

  Show description for 65fb07e
  

  SteNicholas

  authored and

  cfmcgrady

  committed
  65fb07e

Commits on Nov 10, 2023

• [CELEBORN-1110][FOLLOWUP] Support celeborn.worker.storage.disk.reserve.ratio to configure worker reserved ratio for each disk

  Show description for 3c6e469
  

  SteNicholas

  authored and

  FMX

  committed
  3c6e469

• [CELEBORN-1114][FOLLOWUP] Make SlotsAllocated metrics panel to follow previous behavior

  Show description for ae3bbc5
  

  onebox-li

  authored and

  waitinfuture

  committed
  ae3bbc5

• [CELEBORN-858] Generate patch to each Spark 3.x minor version

  Show description for c7c2f6a
  

  lukeyan2023

  authored and

  waitinfuture

  committed
  c7c2f6a

• [CELEBORN-1120] ShuffleClientImpl should close batchReviveRequestScheduler of ReviveManager

  Show description for eb1be3f
  

  SteNicholas

  authored and

  cfmcgrady

  committed
  eb1be3f

Commits on Nov 9, 2023

• [CELEBORN-1116] Read authentication configs from HADOOP_CONF_DIR

  Show description for 02cea04
  

  3 peopleauthored and

  waitinfuture

  committed
  02cea04

Commits on Nov 8, 2023

• [MINOR] Updated sbt.md documentation to be consistent with description

  Show description for 39153c8
  

  jiaoqingbo

  authored and

  waitinfuture

  committed
  39153c8

• [CELEBORN-1112] Inform celeborn application is shutdown, then celeborn cluster can release resource immediately

  Show description for 931880a
  

  RexXiong

  authored and

  waitinfuture

  committed
  931880a

• [CELEBORN-1114] Remove allocationBuckets from WorkerInfo and refactor SLOTS_ALLOCATED metrics

  Show description for b7e4dc4
  

  onebox-li

  authored and

  waitinfuture

  committed
  b7e4dc4

• [CELEBORN-1108][FOLLOWUP] Use rat plugin check Flink 1.18

  Show description for 208864a
  cxzl25

  committed
  208864a

• [CELEBORN-1110] Support celeborn.worker.storage.disk.reserve.ratio to configure worker reserved ratio for each disk

  Show description for d258291
  

  SteNicholas

  authored and

  FMX

  committed
  d258291

Commits on Nov 7, 2023

• [CELEBORN-1109] Cache RegisterShuffleResponse to improve the processing speed of LifecycleManager

  Show description for ffbbe25
  

  kerwin-zk

  authored and

  waitinfuture

  committed
  ffbbe25

• [CELEBORN-448] Support exclude worker manually

  Show description for 52eddc5
  

  SteNicholas

  authored and

  FMX

  committed
  52eddc5

• [MINOR] Update log level for TransferBufferPool#reserveBuffers from warn to debug

  Show description for 59dcd96
  

  SteNicholas

  authored and

  FMX

  committed
  59dcd96

Commits on Nov 6, 2023

• [CELEBORN-1105][FLINK] Support Flink 1.18

  Show description for efa22a4
  

  cxzl25

  authored and

  RexXiong

  committed
  efa22a4

• [CELEBORN-1031] SBT correct the LICENSE and NOTICE for shaded client jars

  Show description for 23d7c20
  

  cxzl25

  and

  cfmcgrady

  committed
  23d7c20

Commits on Nov 4, 2023

• [CELEBORN-1048][FOLLOWUP] MR module compile

  Show description for 4465a92
  

  cxzl25

  authored and

  waitinfuture

  committed
  4465a92

• [CELEBORN-1111] Supporting connection to HDFS with Kerberos authentication enabled

  Show description for 455cd40
  

  liujiayi771

  authored and

  waitinfuture

  committed
  455cd40

Commits on Nov 3, 2023

• [CELEBORN-1081] Client support celeborn.storage.activeTypes config

  Show description for 5e77b85
  

  FMX

  authored and

  RexXiong

  committed
  5e77b85

• [CELEBORN-1108] Rat plugin check for more modules

  Show description for 0e5008d
  

  cxzl25

  authored and

  cfmcgrady

  committed
  0e5008d

• [CELEBORN-1107] Make the max default number of netty threads configurable

  Show description for c8b5384
  

  otterc

  authored and

  waitinfuture

  committed
  c8b5384

• [CELEBORN-1058] Support specifying the number of dispatcher threads for each role

  Show description for 7b185a2
  

  onebox-li

  authored and

  waitinfuture

  committed
  7b185a2

Commits on Nov 2, 2023

• [CELEBORN-1094] Optimize mechanism of ChunkManager expired shuffle key cleanup to avoid memory leak

  Show description for 4e8e8c2
  

  SteNicholas

  authored and

  FMX

  committed
  4e8e8c2

• [CELEBORN-1048] Align fetchWaitTime metrics to spark implementation

  Show description for 0583cdb
  

  2 peopleauthored and

  pan3793

  committed
  0583cdb

Commits on Nov 1, 2023

• [CELEBORN-1104][DOC] Fix SBT documentation incorrect command

  Show description for e437228
  

  cxzl25

  authored and

  pan3793

  committed
  e437228

• [CELEBORN-247][FOLLOWUP] Add metrics for each user's quota usage of Celeborn Worker

  Show description for b45b63f
  

  SteNicholas

  authored and

  FMX

  committed
  b45b63f

• [CELEBORN-1059] Fix callback not update if push worker excluded during retry

  Show description for cd8acf8
  

  onebox-li

  authored and

  waitinfuture

  committed
  cd8acf8

• [CELEBORN-1089] Seperate overHighWatermark check to a dedicated thread

  Show description for 320714b
  

  onebox-li

  authored and

  waitinfuture

  committed
  320714b

Commits on Oct 31, 2023

• [CELEBORN-1103][BUG] only clean up expire data for good disks

  Show description for 232a44b
  

  RuiQin7

  authored and

  waitinfuture

  committed
  232a44b

• [CELEBORN-1093] Improve setup endpoint

  Show description for 11fe324
  

  onebox-li

  authored and

  waitinfuture

  committed
  11fe324

• [CELEBORN-1098] Logging worker address with worker failure log

  Show description for e02cde0
  

  cxzl25

  authored and

  waitinfuture

  committed
  e02cde0

• [CELEBORN-1099] Check register when handleGetReducerFileGroup

  Show description for f6cc377
  

  onebox-li

  authored and

  waitinfuture

  committed
  f6cc377

• [CELEBORN-1101] Update metrics doc to add necessary configuration steps

  Show description for 1c2304c
  

  jiaoqingbo

  authored and

  waitinfuture

  committed
  1c2304c

Pagination

PreviousNext