Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

releases: add TiDB 5.1.1 release notes #6030

Merged
merged 17 commits into from
Jul 30, 2021
Merged
Prev Previous commit
Next Next commit
add tidb, tikv, tiflash, pd, and tools notes according to comments
  • Loading branch information
TomShawn committed Jul 28, 2021
commit df11799f5d3c9ab82fe09c82ecabc4955f2bd7a0
127 changes: 86 additions & 41 deletions releases/release-5.1.1.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,19 +13,71 @@ TiDB version: 5.1.1
+ TiDB

- For users upgrading from TiDB 4.0, the value of tidb_multi_statement_mode is now OFF. It is recommended to use the multi-statement feature of your client library instead, see the documentation on tidb_multi_statement_mode for additional details. [#25751](https://github.com/pingcap/tidb/pull/25751)
- exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352)
- Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311)
- Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege.
- Reading from the table information_schema.cluster_info now requires the Process privilege.
- Reading from the table information_schema.cluster_load now requires the Process privilege.
- Reading from the table information_schema.cluster_systeminfo now requires the Process privilege.
- Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297)
- Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150)
- Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768)

TomShawn marked this conversation as resolved.
Show resolved Hide resolved
## Feature enhancements

TomShawn marked this conversation as resolved.
Show resolved Hide resolved
+ TiDB Dashboard

- TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883)

+ TiFlash

- Support the `HAVING()` function in DAG request

## Improvements

+ TiDB

- avoid alloc for paramMarker in buildValuesListOfInsert [#26076](https://github.com/pingcap/tidb/pull/26076)
- planner: support stable result mode [#25995](https://github.com/pingcap/tidb/pull/25995)
- Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265)
- store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480)
- Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225)
- Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200)
- planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194)
- mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192)
- Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874)
- Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763)
- Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737)
- Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the below is duplicate with the above

- store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480)
- Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225)
- Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200)
- planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194)
- mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192)
- Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874)
- Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763)
- Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737)
- Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587)

TomShawn marked this conversation as resolved.
Show resolved Hide resolved
+ TiKV

- separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592)
- Make prewrite as idempotent as possible to reduce the chance of undetermined errors [#10586](https://github.com/tikv/tikv/pull/10586)
- Prevent the risk of stack overflow when handling many expired commands [#10502](https://github.com/tikv/tikv/pull/10502)
- Avoid excessive commit request retrying by not updating `max_ts` with the stale read request's `start_ts` [#10451](https://github.com/tikv/tikv/pull/10451)
- Separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592)
- Reduce impact on data import speed with I/O rate limiting enabled [#10390](https://github.com/tikv/tikv/pull/10390)
- Improve load balance between Raft gRPC connections [#10495](https://github.com/tikv/tikv/pull/10495)

+ Tools

+ TiCDC

- Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327)
- Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186)

+ TiDB Lightning

- Add retry for restoring schemas [#1294](https://github.com/pingcap/br/pull/1294)

## Bug fixes

TomShawn marked this conversation as resolved.
Show resolved Hide resolved
Expand All @@ -38,76 +90,69 @@ TiDB version: 5.1.1
- planner: handle other-conditions from subqueries correctly when constructing IndexJoin [#25819](https://github.com/pingcap/tidb/pull/25819)
- Fix the bug that successful optimistic transactions may report commit errors. [#25803](https://github.com/pingcap/tidb/pull/25803)
- Fix incorrect result of set type for merge join [#25695](https://github.com/pingcap/tidb/pull/25695)

## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类),并移动到上面对应的标题下。如果某条 note 为多余的,请删除。如果漏抓取了 note,请手动补充

+ TiDB

- Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26482](https://github.com/pingcap/tidb/pull/26482)
TomShawn marked this conversation as resolved.
Show resolved Hide resolved
- store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480)
- planner: fix the risk of integer overflow when locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471)
- ddl: fix cast date as timestamp will write invalid value [#26395](https://github.com/pingcap/tidb/pull/26395)
- exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352)
- Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344)
- Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311)
- Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege.
- Reading from the table information_schema.cluster_info now requires the Process privilege.
- Reading from the table information_schema.cluster_load now requires the Process privilege.
- Reading from the table information_schema.cluster_systeminfo now requires the Process privilege.
- Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297)
- Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344)
- fix the bug of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284)
- Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265)
- fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262)
- Fix the issue that concurrently truncating the same partition hangs DDL. [#26239](https://github.com/pingcap/tidb/pull/26239)
- Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225)
- planner/core: fix duplicate enum items [#26202](https://github.com/pingcap/tidb/pull/26202)
- Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200)
- planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194)
- mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192)
- Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150)
- executor: fix a bug that cte.iterOutTbl did not close correctly [#26148](https://github.com/pingcap/tidb/pull/26148)
- load: fix load data with non-utf8 can succeed [#26144](https://github.com/pingcap/tidb/pull/26144)
- fix unsigned int window function error [#26027](https://github.com/pingcap/tidb/pull/26027)
- Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874)
- Fix the issue that TiDB may panic when resolving async-commit locks. [#25862](https://github.com/pingcap/tidb/pull/25862)
- Make Stale Read fully support prepare statement [#25800](https://github.com/pingcap/tidb/pull/25800)
- Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768)
- Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763)
- Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737)
- Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587)
- Fix the issue that ODBC-styled literal(like {d '2020-01-01'}...) cannot be used as the expression. [#25578](https://github.com/pingcap/tidb/pull/25578)
- fix the bug about unnecessary error when run tidb only [#25555](https://github.com/pingcap/tidb/pull/25555)

+ TiKV

- Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10586](https://github.com/tikv/tikv/pull/10586)
- Fix duration calculation panics on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569)
- Fix unencoded keys of `batch_get_command` in load-base-split [#10565](https://github.com/tikv/tikv/pull/10565)
- Prevent the risk of stack overflow when handling many expired commands. [#10502](https://github.com/tikv/tikv/pull/10502)
- Fix online changing `resolved-ts.advance-ts-interval` can't take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494)
- fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486)
- Avoid panic when building a snapshot twice if encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464)
- Not use the stale read request's `start_ts` to update `max_ts` to avoid commit request keep retrying [#10451](https://github.com/tikv/tikv/pull/10451)
- Fix wrong tikv_raftstore_hibernated_peer_state metric. [#10432](https://github.com/tikv/tikv/pull/10432)
- copr: fix the wrong arguments type of json_unquote [#10428](https://github.com/tikv/tikv/pull/10428)
- Fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486)
- Fix panic when building a snapshot twice with encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464)
- Fix wrong `tikv_raftstore_hibernated_peer_state` metric [#10432](https://github.com/tikv/tikv/pull/10432)
- Fix the wrong arguments type of `json_unquote` [#10428](https://github.com/tikv/tikv/pull/10428)
- Fix the bug that index keys in a pessimistic transaction may be repeatedly committed [#10586](https://github.com/tikv/tikv/pull/10586)
- Fix `ReadIndex` command returning stale result right after leader is transferred [#10474](https://github.com/tikv/tikv/pull/10474)

+ PD

- TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883)
- Reduce the conflict due to multiple scheduler running in same time [#3857](https://github.com/tikv/pd/pull/3857)
- Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3824](https://github.com/tikv/pd/pull/3824)

+ TiFlash

- Fix the potential panic issue that occurs when running table scan tasks
- Fix a bug that TiFlash raises error about `duplicated region` when handling DAQ request
- Fix the panic issue that occurs when the read load is heavy
- Fix the potential panic issue that occures when executing `DateFormat` function
- Fix the potential memory leak issue that occurs when executing MPP tasks
- Fix the issue of unexpected results when executing aggregation functions `COUNT` or `COUNT DISTINCT`
- Fix a potential bug that TiFlash can not restore data when deployed on multi disks
- Fix the issue that TiDB Dashboard can not display disk information of TiFlash correctly
- Fix the potential panic issue that occures when deconstructing `SharedQueryBlockInputStream`
- Fix the potential panic issue that occures when deconstructing `MPPTask`
TomShawn marked this conversation as resolved.
Show resolved Hide resolved

+ Tools

+ TiCDC

- Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327)
- puller,mounter,processor: always pull the old value internally [#2306](https://github.com/pingcap/ticdc/pull/2306)
- Fix support for new collation [#2306](https://github.com/pingcap/ticdc/pull/2306)
- Fix minor runtime panic risk [#2300](https://github.com/pingcap/ticdc/pull/2300)
- Fix potential DDL loss when owner crashes while executing DDL [#2290](https://github.com/pingcap/ticdc/pull/2290)
- Don't resolve lock immediately after a region is initialized. [#2266](https://github.com/pingcap/ticdc/pull/2266)
- Fix potential DDL loss when owner crashes while executing DDL [#2252](https://github.com/pingcap/ticdc/pull/2252)
- Don't resolve lock immediately after a region is initialized. [#2235](https://github.com/pingcap/ticdc/pull/2235)
- Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186)
- Fix a bug that could cause data losses if a TiCDC node is kills immediate after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033)
- Fix trying to resolve locks prematurely [#2266](https://github.com/pingcap/ticdc/pull/2266)
- Fix a bug that could cause data losses if a TiCDC node is killed immediately after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033)
- Fix changefeed update to properly handle --sort-dir and --start-ts. [#1921](https://github.com/pingcap/ticdc/pull/1921)
TomShawn marked this conversation as resolved.
Show resolved Hide resolved

+ Backup & Restore
TomShawn marked this conversation as resolved.
Show resolved Hide resolved

- Fix incorrectly calculating the size of data to restore [#1285](https://github.com/pingcap/br/pull/1285)
- Fix missed DDL events when restoring from cdclog [#1094](https://github.com/pingcap/br/pull/1094)

+ TiDB Lightning

- Fix parquet parser for decimal type [#1272](https://github.com/pingcap/br/pull/1272)
- Fix integer overflows when calculating key intervals [#1294](https://github.com/pingcap/br/pull/1294)
TomShawn marked this conversation as resolved.
Show resolved Hide resolved