Add config param to pass additional parameters to confluent-kafka-pyt…

…hon (airtai#1505)

* Add config param to pass additional parameters to confluent-kafka-python

* Raise error if ssl_context is passed

* Add ConfluentConfig typed dict

* Add docs for passing config

* Fix mypy failure

* Remove unused parameters

* Bump version

fix: include NatsRouter streams to original broker (airtai#1509)

* fix: includer NatsRouter streams to original broker

* chore: limit typing-extensions version only for tests

* docs: generate API References

* fix: remove debug message

* chore: update ruff

* chore: use GHA concurency to cancel previous run at push

* chore: test GHA cancelation

* chore: add GHA concurency to generating API CI

---------

Co-authored-by: Lancetnik <Lancetnik@users.noreply.github.com>

feat (airtai#1431): add Response class (airtai#1481)

* feat (airtai#1431): add Response class

* docs: add Response References

* docs: add Confluent Response API

Bump version to 0.5.9 (airtai#1468)

feat: add subscriber no-reply option (airtai#1461)

feature (airtai#916): Observability (airtai#1398)

* Create TelemetryMiddleware

* Refactor TelemetryMiddleware

* Optimization TelemetryMiddleware

* Refactor TelemetryMiddleware

* Change msg type in __call__

* Continue process span while publish

* Change nesting and add create span

* refactor: mv useless types to TYPE_CHECKING

* refactor: add TelemetrySettingsProvider protocol & NATS impl

* chore: update distributions

* Fixed a typo in PR template

* Fixed a typo in ABCBroker: _broker_dependecies to _broker_dependencies

* Add TelemetryTestcase

* Fix invalid ruff formating

* Add telemetry tests, fix kind error

* Add metrics test, fix invalid metric error

* More specifics in the metrics test

* Changed getting a destination to methods

* Add Rabbit impl

* Ruff format

* Remove delivery_tag from publish

* Refactor extracting attributes

* Ruff format

* Add AIOKafka impl

* Add Confluent impl

* Rename test classes

* Add Redis impl

* Refactor settings providers import

* fix: correct TelemetryMiddlewares batch consuming

* Fix spans and metrics ordering in tests, switch Confluent attributes methods

* Add MESSAGING_BATCH_MESSAGE_COUNT attribute

* Add TestConsume and TestPublish to telemetry tests

* refactor: create independant TelemetryMiddleware for each broker

* tests: use broker factory instead of fixtures in Consume and Publish test cases

* tests: refactor RPC and TestClient testcases

* tests: refactor RMQ tests

* tests: refactor Kafka tests

* tests: NATS subscriber tests with patching

* tests: RMQ subscriber tests with patching

* tests: refactor Redis tests

* tests: refactor Confluent tests

* chore: run CI

* tests: fix Confluent TestClient tests

* tests: fix py3.8 compatibility

* lint: fix some mypy

* chore: fix CI

* tests: fix partition tests

* tests: fix partition real broker case

* Change supported metrics

* Separation of metrics for systems with and without batches

* Fix _subscriber_setup_extra merge conflict

* Refactor and update metrics tests, fix metrics

* Refactor metrics, need batches count in publish

* feat: count Redis consuming batch size

* lint: fix mypy

* Add batch tests, metrics ready

* chore: solve main conflicts

* fix: correct confluent batch body serialization

* Fix opentelemetry redis batch test

* lint: correct StreamRoute call annotation

* Add docs for OpenTelemetry

* docs: add otel page links style

* chore: bump version

* Refactor docs

* docs: fix styles

---------

Co-authored-by: Nikita Pastukhov <diementros@yandex.ru>
Co-authored-by: Pastukhov Nikita <nikita@pastukhov-dev.ru>
Co-authored-by: treaditup <treaditup@gmail.com>

feat: add RMQ channels options, support for prefix for routing_key, a… (

airtai#1448)

* feat: add RMQ channels options, support for prefix for routing_key, add public API for middlewares

* tests: fix asyncapi tests

* chore: update dependencies

* fix: parse old NATS stream config if it exists

* feat (airtai#1447): add StreamMessage.batch_headers attr to provide access to whole batch messages headers

* fix: add factory is_flag option

* feat: add batch_headers for Confluent

chore: bump version (airtai#1435)

Co-authored-by: Kumaran Rajendhiran <kumaran@airt.ai>

fix (airtai#1414): correct Messag.ack error processing (airtai#1420)

* fix (airtai#1414): correct Messag.ack error processing

* chore: bump version

polishing (airtai#1399)