Code

WIP three node cluster without PetSet#9

Code

Closed

solsson wants to merge 26 commits intomasterYolean/kubernetes-kafka:masterfrom nopetset-kafkaYolean/kubernetes-kafka:nopetset-kafkaCopy head branch name to clipboard

+434-627

Commits

Commits on Oct 25, 2016

• Single pod zookeeper, now that PetSet is de-supported in GKE

  solsson

  committed
  5178026

• Tree pods, and before we scale that up we probably want PetSet back

  solsson

  committed
  5136cbb

• Labels have changed a bit here in nopetset

  solsson

  committed
  ce64b00

• Manages to get a single instance ready

  solsson

  committed
  659ca06

• No need to have zookeeper data persistent, when clustered

  solsson

  committed
  08cf9e8

• Tries to configure more like the petset example, though there we have https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html#sc_reconfig_file

  solsson

  committed
  ecc545b

• Using 0.0.0.0 for "my" server solves bind 3888 issue at start

  solsson

  committed
  3abef82

• Zookeeper 3.5+ exposes an admin service, for dynamic configuration, which we don't use yet

  solsson

  committed
  d604847

• Back to zookeeper 3.4, built from https://github.com/solsson/zookeeper-docker

  solsson

  committed
  fb83ca4

• Can't have a readiness probe until tolereate-unready-endpoints goes beta, because that blocks use of the services

  solsson

  committed
  05b086b

• We probably don't need longer timeouts so the current official build is OK

  solsson

  committed
  90f1219

• Keeps a namespace file in zookeeper too, because bootstrapping starts there

  solsson

  committed
  2b01d41

• Without PetSet and 3.5+ dynamic config you definitely want to avoid scaling, so do #4 now

  solsson

  committed
  8e7be7e

• Merge branch 'zookeeper-5-nodes' into nopetset-zk

  solsson

  committed
  01061ae

• First shot at Kafka as noPetSet

  solsson

  committed
  59016b5

• Hostnames are random without PetSet

  solsson

  committed
  9de803b

• Adds two new instances that differ only in broker id

  solsson

  committed
  d7de878

• test/21consumer-test1.yml failed to connect to kafka because it got the hostnames (broker-0-xxxxx) as DNS name

  solsson

  committed
  74b3dbe

• Advertises a service, so consumers can get the kafka endpoint through zookeeper

  solsson

  committed
  cfd2d3b

• Updates test commands for nopetset

  solsson

  committed
  86dea9b

• Kafka needs bootstrapping because it has persistent voluemes

  solsson

  committed
  44d3eb6

• Oops. Brokers must of course use the same image.

  solsson

  committed
  8b16c6c

• No need to wrap regular startup with args in bash -c. It might even affect signal handling.

  solsson

  committed
  41d2001

• With the new preconfigured image we don't intend to mount conf

  solsson

  committed
  1f7f53d

Commits on Nov 9, 2016

• Upgrades to the image with log.dirs inside /opt/kafka/data, current docker-kafka-persistent in master

  solsson

  committed
  034c2aa

• Switches to Deployment so we can use strategy type: Recreate, hopefully to avoid issues with persistent volumes not being available to the new pod at restarts or node upgrades

  solsson

  committed
  7a30e26