Skip to content

MixIT Question #528

Closed
Closed
@JusperLee

Description

@JusperLee

❓ Questions and Help

Before asking:

  1. search the issues.
  2. search the discussions
  3. search the docs.

Open a question on the Discussions

I use the mixit example, but I find that the mixit loss does not drop and stays the same.

Activity

mpariente

mpariente commented on Jul 13, 2021

@mpariente
Collaborator

Thanks for the question.
I think @etzinis, @giorgiacantisani or @popcornell might have ideas about this?

JusperLee

JusperLee commented on Jul 22, 2021

@JusperLee
Author

I found the reason. MixIT is not effective for all 2+2 situations, and you need to enter a single source to ensure performance.

mpariente

mpariente commented on Jul 22, 2021

@mpariente
Collaborator

Samuele mentioned that he also had some problems with it.
What 2+2 situation didn't it work on please?

JusperLee

JusperLee commented on Jul 22, 2021

@JusperLee
Author
popcornell

popcornell commented on Jul 24, 2021

@popcornell
Collaborator

Should work also with 2+2 mixtures. Actually should work with arbitrary mixtures.
Okay with noise the result it's not so great but still works quite well. Check for example the model trained on YFC100 on Google separation team GitHub.

JusperLee

JusperLee commented on Jul 25, 2021

@JusperLee
Author
popcornell

popcornell commented on Jul 26, 2021

@popcornell
Collaborator

Yeah right but then it could be argued that it is not anymore unsupervised because you need single speaker speech.
You can try my implementation from here:
#320

I don't understand the one from Giorgia fully, it is much more flexible but maybe it has a bug IDK.

etzinis

etzinis commented on Jul 26, 2021

@etzinis
Contributor

Single source mixtures are not needed. What probably might be needed and actually boosts the performance is adding a percentage of mixtures of mixtures containing a single mixture and zero out the second one. If the mixtures contain independent sources (MixIT assumption), that means that this would be identical to having a mixture of two mixtures where each contains a single source.

JusperLee

JusperLee commented on Jul 26, 2021

@JusperLee
Author

@etzinis Yes, adding a certain percentage of mixtures of mixtures containing a single mixture can improve performance. But I see no problem with asteroid's MixIT implementation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      MixIT Question · Issue #528 · asteroid-team/asteroid