Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

using TorchMetrics #2

Open
Borda opened this issue Feb 24, 2022 · 1 comment
Open

using TorchMetrics #2

Borda opened this issue Feb 24, 2022 · 1 comment

Comments

@Borda
Copy link

Borda commented Feb 24, 2022

Hello,
I am curious if you would be interested in using TorchMetrics which has recently implemented various Text-related metrics?
One of your students, @stancld have helped us with adding these metrics, so he may also advise of any potential integration... :)

Thank you for your consideration 🐰
@tuetschek
Copy link
Owner

Hi @Borda , thanks for the pointer and apologies for a rather negative reply. I haven't been developing this repo any further for the past ~2 years, so I'm not planning to include any new metrics here.

You might try asking at (or get involved in) https://github.com/GEM-benchmark/GEM-metrics, which is basically an evolution of this. (Note that there probably would need to be a metric in TorchMetrics, not yet included in GEM, for the project to consider using it.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tuetschek @Borda