release: Document how to determine billing demo container status

zRedShift · Nov 10, 2020 · 96ad0e4 · 96ad0e4
1 parent 94613bf
commit 96ad0e4
Showing 1 changed file with 10 additions and 1 deletion.
diff --git a/.github/ISSUE_TEMPLATE/release.md b/.github/ISSUE_TEMPLATE/release.md
@@ -105,7 +105,16 @@ in the infrastructure repository. All of these tests can be run in parallel.
 - [ ] Let the tests run for at least 24 hours, with the following success criteria:
 
   - [ ] chbench: The ingest rate should not be slower than the previous release.
-  - [ ] billing-demo: The container should run and finish without error.
+  - [ ] billing-demo: The container should run and finish without error. You can get the exit code
+    from Docker:
+
+    ```bash
+    docker ps -a | grep -E 'STATUS|materialized|billing-demo'
+    ```
+
+    * `materialized` should be `up` (although see #4753 for the current breakage)
+    * `billing-demo` should be `Exited (0)`
+
   - [ ] perf-kinesis: The "Time behind external source" dashboard panel in Grafana should
     have remained at 0ms or similar for the entirety of the run.