Skip to content

Make batch sizes configurable #3708

Closed
@AlekSi

Description

What should be done?

const batchSize = 1000


const batchSize = 100

Currently, both handler-level and backends-level batch sizes are constants. That's because we don't want to consume too much memory on the FerretDB side and go over backend limits such as a maximum number or size of query parameters. We also don't know how to detect and/or auto-tune those parameters yet.

But we should allow changing those values via testing flags.

Where?

See reference above.

Definition of Done

  • handler updated;
  • all backends updated;
  • benchmarks updated and run;
  • spot refactorings done.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

code/enhancementSome user-visible feature could work bettercommunityIssues and PRs assigned to community membersgood first issueGood issues for new external contributors

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions