Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] Update Debezium connector docs. #2456

Merged
merged 1 commit into from
Sep 11, 2024
Merged

[docs] Update Debezium connector docs. #2456

merged 1 commit into from
Sep 11, 2024

Conversation

ryzhyk
Copy link
Contributor

@ryzhyk ryzhyk commented Sep 10, 2024

  • Consolidate Postgres and MySQL Debezium docs in one document.
  • Don't document database and Kafka connect configuration in detail. These are well documented elsewhere and we don't need to duplicate these docs.
  • Document Avro support.

While working on the docs, I also removed unnecessary configs from the Debezium demo.

@ryzhyk ryzhyk requested a review from gz September 10, 2024 15:12
@ryzhyk
Copy link
Contributor Author

ryzhyk commented Sep 10, 2024

test comment


Debezium is a widely-used **Change Data Capture** (CDC) technology that streams real-time changes from databases such
as PostgreSQL, MySQL, and Oracle to Kafka topics. Feldera can consume these change streams as inputs. We support
Debezium streams encoded in both [JSON](/docs/formats/json.md) and [Avro](/docs/formats/avro.md) formats. Synchronizing
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

btw maybe we can have a table in the higher level connectors page that shows which connector supports which format

docs/connectors/sources/debezium.md Outdated Show resolved Hide resolved
docs/connectors/sources/debezium.md Outdated Show resolved Hide resolved
## Step 3: Create Feldera input connector

Configure an input connector for each Feldera SQL table that must ingest changes from Debezium.
Use the `kafka_input` transport with either `json` or `avro` format. Debezium automatically
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Use the `kafka_input` transport with either `json` or `avro` format. Debezium automatically
Use the `kafka_input` transport with using either `json` or `avro` as the format. Debezium automatically

docs/connectors/sources/debezium.md Outdated Show resolved Hide resolved
docs/connectors/sources/debezium.md Outdated Show resolved Hide resolved
docs/connectors/sources/debezium.md Outdated Show resolved Hide resolved
* Consolidate Postgres and MySQL Debezium docs in one document.
* Don't document database and Kafka connect configuration in detail.
  These are well documented elsewhere and we don't need to duplicate
  these docs.
* Document Avro support.

Signed-off-by: Leonid Ryzhyk <leonid@feldera.com>
@ryzhyk ryzhyk added this pull request to the merge queue Sep 10, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Sep 11, 2024
@ryzhyk ryzhyk added this pull request to the merge queue Sep 11, 2024
Merged via the queue into main with commit 2b7bdca Sep 11, 2024
5 checks passed
@ryzhyk ryzhyk deleted the debezium-docs branch September 11, 2024 05:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants