Skip to content

Commit

Permalink
DBZ-4127 Document incremental.snapshot.chunk.size
Browse files Browse the repository at this point in the history
  • Loading branch information
Naros authored and gunnarmorling committed Nov 30, 2021
1 parent 67ffc28 commit 687b797
Show file tree
Hide file tree
Showing 5 changed files with 25 additions and 0 deletions.
4 changes: 4 additions & 0 deletions documentation/modules/ROOT/pages/connectors/db2.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2219,6 +2219,10 @@ By default, no operations are skipped.
| Fully-qualified name of the data collection that is used to send {link-prefix}:{link-signalling}[signals] to the connector.
The name format is _schema-name.table-name_.

|[[db2-property-incremental-snapshot-chunk-size]]<<db2-property-incremental-snapshot-chunk-size, `+incremental.snapshot.chunk.size+`>>
|`1024`
| The number of rows fetched from the database for each incremental snapshot iteration.

|===

[id="debezium-{context}-connector-database-history-configuration-properties"]
Expand Down
4 changes: 4 additions & 0 deletions documentation/modules/ROOT/pages/connectors/mysql.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2781,6 +2781,10 @@ The name format is _database-name.table-name_.
+
Note that changes to a primary key are not supported and can cause incorrect results if performed during an incremental snapshot. Another limitation is that if a schema change affects only columns' default values, then the change won't be detected until the DDL is processed from the binlog stream. This doesn't affect the snapshot events' values, but the schema of snapshot events may have outdated defaults.

|[[mysql-property-incremental-snapshot-chunk-size]]<<mysql-property-incremental-snapshot-chunk-size, `+incremental.snapshot.chunk.size+`>>
|`1024`
| The number of rows fetched from the database for each incremental snapshot iteration.

|[[mysql-property-read-only]]<<mysql-property-read-only, `+read.only+`>>
|`false`
|Switch to alternative incremental snapshot watermarks implementation to avoid writes to signal data collection
Expand Down
9 changes: 9 additions & 0 deletions documentation/modules/ROOT/pages/connectors/oracle.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2614,6 +2614,15 @@ You can configure the connector to skip the following types of operations:

By default, no operations are skipped.

|[[oracle-property-signal-data-collection]]<<oracle-property-signal-data-collection, `+signal.data.collection+`>>
|No default
| Fully-qualified name of the data collection that is used to send {link-prefix}:{link-signalling}[signals] to the connector.
The name format is _database_name.schema-name.table-name_.

|[[oracle-property-incremental-snapshot-chunk-size]]<<oracle-property-incremental-snapshot-chunk-size, `+incremental.snapshot.chunk.size+`>>
|`1024`
| The number of rows fetched from the database for each incremental snapshot iteration.

|===

[id="debezium-{context}-connector-database-history-configuration-properties"]
Expand Down
4 changes: 4 additions & 0 deletions documentation/modules/ROOT/pages/connectors/postgresql.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -3141,6 +3141,10 @@ By default, no operations are skipped.
|Fully-qualified name of the data collection that is used to send {link-prefix}:{link-signalling}[signals] to the connector.
The name format is _schema-name.table-name_.

|[[postgresql-property-incremental-snapshot-chunk-size]]<<postgresql-property-incremental-snapshot-chunk-size, `+incremental.snapshot.chunk.size+`>>
|`1024`
| The number of rows fetched from the database for each incremental snapshot iteration.

|===

[id="postgresql-pass-through-properties"]
Expand Down
4 changes: 4 additions & 0 deletions documentation/modules/ROOT/pages/connectors/sqlserver.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2377,6 +2377,10 @@ The name format is _database_name.schema-name.table-name_.
+
Note that changes to a primary key are not supported and can cause incorrect results if performed during an incremental snapshot. Another limitation is that if a schema change affects only columns' default values, then the change won't be detected until the DDL is processed from the binlog stream. This doesn't affect the snapshot events' values, but the schema of snapshot events may have outdated defaults.

|[[sqlserver-property-incremental-snapshot-chunk-size]]<<sqlserver-property-incremental-snapshot-chunk-size, `+incremental.snapshot.chunk.size+`>>
|`1024`
| The number of rows fetched from the database for each incremental snapshot iteration.

|[[sqlserver-property-max-iteration-transactions]]<<sqlserver-property-max-iteration-transactions, `+max.iteration.transactions+`>>
|0
|Specifies the maximum number of transactions per iteration to be used to reduce the memory footprint when streaming changes from multiple tables in a database.
Expand Down

0 comments on commit 687b797

Please sign in to comment.