Skip to content

Add benchmark code for PLCC, SRCC, KRCC evaluation on MOS databases. #207

Closed
@zakajd

Description

Is your feature request related to a problem? Please describe.
Now this code is available only for me and @snk4tr as part of another project. Propose to simplify it and add as a standalone script into the library, so that everyone could verify metric performance.

Describe the solution you'd like
Add benchmark.py file into tests folder with support for TID2013 and KADID10k databases evaluation.
Create README section with results.

Additional context
I've run all the tests locally and it seems that not all implementations from our library are now consistent with results from papers. Here is table for TID2013 database
Screenshot 2021-01-15 at 12 50 57

Metadata

Assignees

Labels

featureNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions