Code

Message writer for record batches#163

Code

Merged

achille-roussel merged 26 commits intosegmentio:mastersegmentio/kafka-go:masterfrom VictorDenisov:v2_message_writerVictorDenisov/kafka-go:v2_message_writerCopy head branch name to clipboardJan 28, 2019

+293-24

Commits

Commits on Jan 14, 2019

• Add branching for record batch writer

  VictorDenisov

  committed
  55ba9d6

  Copy full SHA for 55ba9d6

• Make key and value from headers public

  VictorDenisov

  committed
  1c90763

  Copy full SHA for 1c90763

• Add writeVarInt function

  VictorDenisov

  committed
  a8cd851

  Copy full SHA for a8cd851

• Implement writeRecord method

  VictorDenisov

  committed
  d18779b

  Copy full SHA for d18779b

• Write record batch method

  VictorDenisov

  committed
  582f1d1

  Copy full SHA for 582f1d1

• Use zigzag encoding for varint

  VictorDenisov

  committed
  29674e8

  Copy full SHA for 29674e8

• Drop logging

  VictorDenisov

  committed
  0784aa5

  Copy full SHA for 0784aa5

• Add unit test for v2 record batch

  VictorDenisov

  committed
  faddbdc

  Copy full SHA for faddbdc

• Remove commented out code

  VictorDenisov

  committed
  a57d973

  Copy full SHA for a57d973

• Use int constants from math package

  VictorDenisov

  committed
  57693cf

  Copy full SHA for 57693cf

• Use exact record size instead of extra buffer

  VictorDenisov

  committed
  a96cefa

  Copy full SHA for a96cefa

Commits on Jan 15, 2019

• Give a simpler name to calcVarIntLen

  VictorDenisov

  committed
  60e7246

  Copy full SHA for 60e7246

• Move error check out of if else block

  VictorDenisov

  committed
  8128763

  Copy full SHA for 8128763

• Extract message set size in a function

  VictorDenisov

  committed
  fc101c3

  Copy full SHA for fc101c3

• Give calcRecordSize a shorter name

  VictorDenisov

  committed
  eca66e2

  Copy full SHA for eca66e2

• Protect recordSize from confusing order of params

  VictorDenisov

  committed
  f4bc280

  Copy full SHA for f4bc280

• Use recordSize intead of estimatedRecordSize

  VictorDenisov

  committed
  3da360b

  Copy full SHA for 3da360b

• Extract record batch size

  VictorDenisov

  committed
  d4b332e

  Copy full SHA for d4b332e

Commits on Jan 18, 2019

• Use record size from calculation

  VictorDenisov

  committed
  8c48777

  Copy full SHA for 8c48777

Commits on Jan 21, 2019

• Assign offsets to messages in record batch

  VictorDenisov

  committed
  36e6a36

  Copy full SHA for 36e6a36

• Write message set straight to output writer

  VictorDenisov

  committed
  8798908

  Copy full SHA for 8798908

• Write record batch straight to output writer

  VictorDenisov

  committed
  6464be6

  Copy full SHA for 6464be6

• Get rid of remainder buffer

  VictorDenisov

  committed
  60de28c

  Copy full SHA for 60de28c

Commits on Jan 23, 2019

• Remove commented out code

  VictorDenisov

  committed
  e22b69b

  Copy full SHA for e22b69b

• Use bytes.Equal for comparing slices of bytes

  VictorDenisov

  committed
  d2cd545

  Copy full SHA for d2cd545

Commits on Jan 27, 2019

• Compress messages before calculating size

  VictorDenisov

  committed
  93017f4

  Copy full SHA for 93017f4