Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Look into Essentia (or ≠ signal processing / ML models) for music feature extraction without relying on spotify #42

Open
Sheraff opened this issue Jan 19, 2023 · 0 comments
Labels
future-proofing Surviving if some 3rd party services get cut off

Comments

@Sheraff
Copy link
Owner

Sheraff commented Jan 19, 2023

https://essentia.upf.edu/models.html

Essentia allows us to extract "simple" music features (loudness, bpm, danceability) as well as more complex features through ML (pre-trained?) models (genre, mood, instrumentation, voiciness, valence, gender, acousticness, ...)

5Go / 8M+ sqlite dataset of spotify tracks and their audio features: https://www.kaggle.com/datasets/maltegrosse/8-m-spotify-tracks-genre-audio-features

We don't have to stick to Spotify's feature list (acousticness, danceability, energy, instrumentalness, liveness, speechiness, valence) as long as we find some vectors that allow for

  • playlist creation based on human-understandable descriptions of musical feature space
  • track matching based on similarity of features, that gives satisfyingly "similar" tracks
  • varied enough vectors (i.e. 3 axes would be too little, 7 is more than enough)
@Sheraff Sheraff changed the title Look into Essentia for music feature extraction without relying on spotify Look into Essentia (or ≠ signal processing / ML models) for music feature extraction without relying on spotify Jan 19, 2023
@Sheraff Sheraff added the future-proofing Surviving if some 3rd party services get cut off label Apr 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
future-proofing Surviving if some 3rd party services get cut off
Projects
None yet
Development

No branches or pull requests

1 participant