hey @vfdev-5

This is a topic I'm very much interested and willing to help.

I just looked at the distrib branch, and I see some problems with the current implementation.

I think that we could have a decorator to mark each existing metric as distributed compatible and raise a warning / error if the user tries to use the metric in a distributed scenario.

Using a sum all reduce op, does not work for every case, so we would also have to account for that.

Let me know your thought and how I can help!

Best,
Miguel

Adapt metrics to be used with distributed #568

Description

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions