Supervisely stores full activity log almost for every action. This app uses activity log to restore all labeeling actions in team (table can be huge) and performs some basic aggregations shown on the screenshot below. All tables can be sorted by any column. The following types of events are considered as labeling actions:
CREATE_FIGUREUPDATE_FIGUREDISABLE_FIGURERESTORE_FIGUREATTACH_TAGUPDATE_TAG_VALUEDETACH_TAGIMAGE_REVIEW_STATUS_UPDATED
Following metrics are available (every metric is calculated for the selected date-time interval):
- number of unique annotated images for every user
- number of events for every labeling action for the entire team
- number of labeling events that every user performed
- number of events for every user for every action. If you sort this table by user you will see labeling actions for every user. If you will sort this table by labeling actions, then you can compare users within every action
- number of events for every action for every labeling job. Sort table by labeling job to compare actions within one job, sort by action to compare jobs with each other
- number of events for every user for every labeling job for every action (sort by different columns to see different perspectives like described above)
Date-Time Range filter is the following:
Log in to the team, then go to Ecosystem->Apps page. Find app and press Get button. Now app is added to your team.
Go to Plugins & Apps section and press Run button in front of the app.
By default app shows maximum time interval that covers all labeling events in a team. You can change it and press Apply Filter button to see statistics for the interested period of time.
Press App settings -> Stop button right in application session
or in app sessions table.
To see history of runs go to Apps page, click to applications sessions. In front of every session you can see buttons (View and Logs). Press View button to open stopped application session in Read Only mode.