[GSoC'24] Consensus annotation #8434

zhiltsov-max · 2024-09-11T17:59:27Z

Motivation and context

Depends on #8283, #8401

Closes #7973

Merge plan:

Implement consensus task creation (API and UI)
Implement consensus job merging and settings (API and UI)
Implement simple analytics for merge conflicts
Implement review mode and manual merging

How has this been tested?

Checklist

I submit my changes into the develop branch
I have created a changelog fragment
I have updated the documentation accordingly
I have added tests to cover my changes
I have linked related issues (see GitHub docs)
I have increased versions of npm packages if it is necessary
(cvat-canvas,
cvat-core,
cvat-data and
cvat-ui)

License

I submit my code changes under the same MIT License that covers the project.
Feel free to contact the maintainers if that's a concern.

Summary by CodeRabbit

New Features
- Introduced a new analytics page for consensus reporting.
- Added support for merging consensus jobs directly from the job actions menu.
- Implemented a dedicated component for displaying assignee reports and consensus conflicts.
- Enhanced task management with new consensus-related settings and properties.
Bug Fixes
- Improved error handling and state management for consensus job operations.
Documentation
- Updated documentation to reflect changes in consensus job handling and analytics features.
Style
- Added new styles for improved layout and presentation of consensus-related components.
Tests
- Expanded test coverage for new consensus functionalities and components.

…Report

into merge_consensus_jobs

… into consensus-job

Creating Consensus Job

… into consensus_testcases

…onsensus_jobs

…consensus

…mary`

…ticsCard`

…to gsoc/consensus-feature

…ture`

[GSoC'24] Update GSoC Consensus Feature

sonarqubecloud · 2024-10-02T12:23:43Z

Quality Gate failed

Failed conditions
5.7% Duplication on New Code (required ≤ 3%)
C Reliability Rating on New Code (required ≥ A)

See analysis details on SonarCloud

Catch issues before they fail your Quality Gate with our IDE extension SonarLint

#7973 Adding test cases for consensus features ### Checklist  ~- [ ] I submit my changes into the `develop` branch~ ~- [ ] I have created a changelog fragment ~ ~- [ ] I have updated the documentation accordingly~ - [x] I have added tests to cover my changes - [x] I have linked related issues (see [GitHub docs]( https://help.github.com/en/github/managing-your-work-on-github/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword)) ~- [ ] I have increased versions of npm packages if it is necessary ([cvat-canvas](https://github.com/cvat-ai/cvat/tree/develop/cvat-canvas#versioning), [cvat-core](https://github.com/cvat-ai/cvat/tree/develop/cvat-core#versioning), [cvat-data](https://github.com/cvat-ai/cvat/tree/develop/cvat-data#versioning) and [cvat-ui](https://github.com/cvat-ai/cvat/tree/develop/cvat-ui#versioning))~ ### License - [x] I submit _my code changes_ under the same [MIT License]( https://github.com/cvat-ai/cvat/blob/develop/LICENSE) that covers the project. Feel free to contact the maintainers if that's a concern. --------- Co-authored-by: Dmitrii Lavrukhin <dmitrii.lavrukhin@cvat.ai> Co-authored-by: Rodrigo Agundez <rragundez@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru> Co-authored-by: Kirill Lakhov <kirill.9992@gmail.com> Co-authored-by: smit <90560950+smit9924@users.noreply.github.com> Co-authored-by: Roman Donchenko <roman@cvat.ai> Co-authored-by: cvat-bot[bot] <147643061+cvat-bot[bot]@users.noreply.github.com> Co-authored-by: Andrey Zhavoronkov <andrey@cvat.ai> Co-authored-by: Maxim Zhiltsov <zhiltsov.max35@gmail.com> Co-authored-by: Maria Khrustaleva <maria@cvat.ai>

Update consensus to develop

Viditagarwal7479 · 2024-12-26T00:22:38Z

Hello @zhiltsov-max ,
Are you able to build this locally?
Since, I am getting the following error while trying to build this locally.

docker compose -f docker-compose.yml -f docker-compose.dev.yml up -d --build

216.5 gcc: internal compiler error: Illegal instruction signal terminated program as
216.5 Please submit a full bug report,
216.5 with preprocessed source if appropriate.
216.5 See <file:///usr/share/doc/gcc-11/README.Bugs> for instructions.
216.5 make: *** [ffbuild/common.mak:59: libavformat/isom.o] Error 4
[+] Running 0/1 Waiting for unfinished jobs....
 ⠧ Service cvat_server  Building                                                                                                                                                                                                  221.7s 
failed to solve: process "/bin/sh -c curl -sL https://ffmpeg.org/releases/ffmpeg-${FFMPEG_VERSION}.tar.gz --output - |     tar -zx --strip-components=1 &&     ./configure --disable-nonfree --disable-gpl --enable-libopenh264         --enable-shared --disable-static --disable-doc --disable-programs --prefix=\"${PREFIX}\" &&     make -j5 && make install && make clean" did not complete successfully: exit code: 2

…onsensus-feature

zhiltsov-max · 2024-12-26T13:14:38Z

@Viditagarwal7479, yes, it compiles and runs without problems on my machine. The error looks like it can be something specific to your CPU or platform. Please try to launch outside of the containers or maybe change GCC version for the build.

zhiltsov-max · 2024-12-30T11:14:42Z

Added merge plan in the description.

…onsensus-feature

Viditagarwal7479 · 2025-01-01T19:44:13Z

@Viditagarwal7479, yes, it compiles and runs without problems on my machine. The error looks like it can be something specific to your CPU or platform. Please try to launch outside of the containers or maybe change GCC version for the build.

Thank You, removing ffmpeg and ffmpeg4 installed by brew and the related enviornment variables solved this issue.

Viditagarwal7479 · 2025-01-01T19:46:49Z

Added merge plan in the description.

Aren't this 2 already implemented?
[ ] Implement consensus task creation (API and UI)
[ ] Implement consensus job merging and settings (API and UI)

What more params are you looking for related to the merge conflicts?
[ ] Implement simple analytics for merge conflicts

Viditagarwal7479 · 2025-01-01T19:48:32Z

#8895 in this PR I have updated the schema.yml because of which CI / build (pull request) build is failing and updated this branch with develop

Update `gsoc/consensus-feature` with `develop` and update `schema.yml`

sonarqubecloud · 2025-01-03T12:15:00Z

Quality Gate failed

Failed conditions
5.3% Duplication on New Code (required ≤ 3%)
D Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

Viditagarwal7479 and others added 30 commits July 18, 2024 19:04

when consensus jobs are merged the parent job goes in NEW state

10e1053

gave everyone assigned to that Task permission to view the Consensus …

e467eb3

…Report

changed the term normal job to regular job

8508e2e

shifted the consensus based annotation tag below the details of task

c24a82d

changed the term normal job to regular job

fe3f524

showing all kinds of job on jobs page

d53b3ae

added a filter field for job type in jobs page

1c5625d

updated the schema.yml with regular job instead of normal job

fd434ae

Merge branch 'consensus-job' of https://github.com/Viditagarwal7479/cvat

3b90c8f

into merge_consensus_jobs

changed the some leftover usage of normal job to regular job

a5224f1

after merging consensus jobs regular job's state is marked as COMPLETE

27297f4

changed button name for mergeing consensus jobs

e33f9b2

Merge branch 'gsoc/consensus-feature' of https://github.com/opencv/cvat…

2a26581

… into consensus-job

fixed conflict in engine migrations

f754bc6

removed unwanted commented code

9866dbd

Merge pull request #7974 from Viditagarwal7479/consensus-job

df8bd0c

Creating Consensus Job

Merge branch 'gsoc/consensus-feature' of https://github.com/opencv/cvat…

4bf0aeb

… into consensus_testcases

added missing , in TaskReadSerializer fields

033b6a8

added the max. 10 consensus jobs per regular job condition

6d49bf5

added tests related to setting consensus jobs per regular job

2c906bb

fixed OKS implementation

7635f34

Merge branch 'develop' of https://github.com/opencv/cvat into merge_c…

a6a9def

…onsensus_jobs

added sigma for OKS calculation in consensus settings

1b206a3

added matching from quality_reports.py and merging of skeletons to …

1e60737

…consensus

formatted python code

6c24859

added consensus jobs and their annotations into backup

0412835

added restore_db_per_function to TestTaskBackups

f5a4880

fixed JobSummarySerializer to include all types of Jobs in `TaskSum…

89b86df

…mary`

fixed a typo in project as peoject

2c2ca6a

added consensus score and assignee to consensus report

9315d67

Viditagarwal7479 and others added 6 commits October 1, 2024 08:09

modified analytics page to include the change in size props in `Analy…

06995ee

…ticsCard`

Merge branch 'develop' of https://github.com/Viditagarwal7479/cvat in…

93c1dcb

…to gsoc/consensus-feature

fixed migration issue when merging develop into `gsoc/consensus-fea…

e2d96af

…ture`

updated schema.yml

24d79a3

handled consensus score as nan scenario

8dc3c2c

Merge pull request #8500 from Viditagarwal7479/gsoc/consensus-feature

fc212f0

[GSoC'24] Update GSoC Consensus Feature

Viditagarwal7479 and others added 12 commits December 24, 2024 17:27

Remove extra file

93410b6

Merge branch 'develop' into zm/consensus

3fbfcbe

Update db migrations

55afa1a

Fix signals

98954a2

Fix permissions

7e08e0e

Update test assets

4008c5c

Format code

bb0bba8

Format code

809703d

Fix imports

51b44ad

Update schema

fcfa8a2

Merge pull request #8870 from cvat-ai/zm/consensus

a315840

Update consensus to develop

Merge branch 'develop' of https://github.com/cvat-ai/cvat into gsoc/c…

9ad9319

…onsensus-feature

Viditagarwal7479 added 2 commits January 2, 2025 00:18

updated schema.yml

9451f3d

Merge branch 'develop' of https://github.com/cvat-ai/cvat into gsoc/c…

440d2ab

…onsensus-feature

Merge pull request #8895 from Viditagarwal7479/gsoc/consensus-feature

e81c042

Update `gsoc/consensus-feature` with `develop` and update `schema.yml`

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[GSoC'24] Consensus annotation #8434

[GSoC'24] Consensus annotation #8434

zhiltsov-max commented Sep 11, 2024 •

edited

Loading

sonarqubecloud bot commented Oct 2, 2024

Viditagarwal7479 commented Dec 26, 2024

zhiltsov-max commented Dec 26, 2024 •

edited

Loading

zhiltsov-max commented Dec 30, 2024

Viditagarwal7479 commented Jan 1, 2025

Viditagarwal7479 commented Jan 1, 2025

Viditagarwal7479 commented Jan 1, 2025

sonarqubecloud bot commented Jan 3, 2025

[GSoC'24] Consensus annotation #8434

Are you sure you want to change the base?

[GSoC'24] Consensus annotation #8434

Conversation

zhiltsov-max commented Sep 11, 2024 • edited Loading

Motivation and context

How has this been tested?

Checklist

License

Summary by CodeRabbit

sonarqubecloud bot commented Oct 2, 2024

Quality Gate failed

Viditagarwal7479 commented Dec 26, 2024

zhiltsov-max commented Dec 26, 2024 • edited Loading

zhiltsov-max commented Dec 30, 2024

Viditagarwal7479 commented Jan 1, 2025

Viditagarwal7479 commented Jan 1, 2025

Viditagarwal7479 commented Jan 1, 2025

sonarqubecloud bot commented Jan 3, 2025

Quality Gate failed

zhiltsov-max commented Sep 11, 2024 •

edited

Loading

zhiltsov-max commented Dec 26, 2024 •

edited

Loading