Implementation of required Dashboards and Integration with Grafana Prometheus Cloud #29

lorenzoronzani · 2024-03-19T14:01:11Z

No description provided.

fix 🐞: Removed the dfx stop inside the run_test_canister.sh script

…ometheus.yml

…ry/prometheus/Dockerfile) to handle the problem that the prom/prometheus image doesn't substitute the env variables inside the prometheus.yml config file

…cker compose, so that I can use the prom/prometheus docker image

…stead of a gauge

…the prometheus-prod.yml before starting the container

lorenzoronzani · 2024-03-19T14:05:17Z

Developed some Grafana dashboards:

Number of connected clients (realtime, groupped by hour/day)
Number of connected clients by canister id
Number of active pollers
Time to resolve tls
Time to open connection

Integrated the remote writer on prometheus server (always deployed) to send metrics on the Grafana prometheus cloud

ilbertt

Small changes discussed in the call today

…ronment.sh

…pose.yml to avoid misunderstanding

lorenzoronzani · 2024-03-20T15:04:29Z

I made the minor changes requested during the call. Dashboard clients by hour/day sometimes have strange behavior, so keep an eye on it (when we have more data).

ilbertt

Just a few minor fixes and we're good to go!

README.md

scripts/start_local_docker_environment.sh

scripts/start_prod_docker_environment.sh

scripts/stop_prod_docker_environment.sh

src/ic-websocket-gateway/src/gateway_metrics.rs

src/ic-websocket-gateway/src/client_session_handler.rs

lorenzoronzani added 18 commits March 11, 2024 10:50

docs 📄: Edited the test part inside the README.md

79fdbe4

fix 🐞: Removed the dfx stop inside the run_test_canister.sh script

wip 🚧: Developing a way to substitute the env variables inside the pr…

af50057

…ometheus.yml

wip 🚧: Trying to resolve the env variable substitution problem

66d2040

feat 🦄: Developed a custom version of the prometheus image (./telemet…

f7f9dc1

…ry/prometheus/Dockerfile) to handle the problem that the prom/prometheus image doesn't substitute the env variables inside the prometheus.yml config file

docs 📄: Added doc on prometheus docker image

ce6b9d4

wip 🚧: Developing the grafana dashboard from metrics

fb2cf52

feat 🦄: Developed the time to open connection by client id dashboard

1d5985b

feat 🦄: Developed the clients connected by canister dashboard

46aa5f2

feat 🦄: Developed the required dashboards

8d8df20

style 🌈: Edited the bar width of the dashboards

996afae

wip 🚧: Developing the envsubst in local machine before running the do…

9eedf85

…cker compose, so that I can use the prom/prometheus docker image

refactor ⚙: Refactored the connection count metric using a counter in…

075708a

…stead of a gauge

feat 🦄: Implemented the full path connection_opening_time metric

b3ed833

Merge branch 'main' into lorenzo

2c109b6

Merge branch 'lorenzo' into prometheus-remote-writer

4fa35ce

feat 🦄: Fixed the envsubst problem and provided the flow to generate …

9dba6dd

…the prometheus-prod.yml before starting the container

docs 📄: Edited the Docker part inside the README.md

e1a4817

refactor ⚙: Remove useless comment

85f031b

lorenzoronzani requested review from ilbertt and massimoalbarello March 19, 2024 14:01

ilbertt requested changes Mar 19, 2024

View reviewed changes

lorenzoronzani added 7 commits March 20, 2024 08:05

refactor ⚙: Removed .env override chance from start_local_docker_envi…

a80b3f0

…ronment.sh

docs 📄: Documented the telemetry/prometheus/Dockerfile and docker-com…

780d786

…pose.yml to avoid misunderstanding

refactor ⚙: Changed the clients_session_time hashmap with a variable

ea65325

fix 🐞: Fixed small mistake

63b41af

wip 🚧: Working on counter to gauge conversion

ad66620

refactor ⚙: Refactored small things on dashboards

e237678

fix 🐞: Fixed the dashboards client by hour/day

5242b7a

lorenzoronzani requested a review from ilbertt March 20, 2024 15:07

ilbertt requested changes Mar 21, 2024

View reviewed changes

fix 🐞: Fixed small requested changes

f191ed5

lorenzoronzani requested a review from ilbertt March 21, 2024 13:39

ilbertt approved these changes Mar 21, 2024

View reviewed changes

ilbertt merged commit 366243f into main Mar 21, 2024
1 check passed

ilbertt deleted the lorenzo branch March 21, 2024 16:40

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Implementation of required Dashboards and Integration with Grafana Prometheus Cloud #29

Implementation of required Dashboards and Integration with Grafana Prometheus Cloud #29

lorenzoronzani commented Mar 19, 2024

lorenzoronzani commented Mar 19, 2024

ilbertt left a comment

lorenzoronzani commented Mar 20, 2024

ilbertt left a comment

Implementation of required Dashboards and Integration with Grafana Prometheus Cloud #29

Implementation of required Dashboards and Integration with Grafana Prometheus Cloud #29

Conversation

lorenzoronzani commented Mar 19, 2024

lorenzoronzani commented Mar 19, 2024

ilbertt left a comment

Choose a reason for hiding this comment

lorenzoronzani commented Mar 20, 2024

ilbertt left a comment

Choose a reason for hiding this comment