Code

First commit of youtube transcriber#2

Code

Open

juancopi81 wants to merge 24 commits intomatallanas:mainmatallanas/whisper_gpt_pipeline:mainfrom juancopi81:mainjuancopi81/whisper_gpt_pipeline:mainCopy head branch name to clipboard

+1,310

Commits

Commits on Oct 19, 2022

• First commit of youtube transcriber

  juancopi81

  committed
  a701319

• Minor bug in name of param

  juancopi81

  committed
  1f44452

• Add apply method to whisper transcriber class

  juancopi81

  committed
  f769c26

Commits on Oct 20, 2022

• Add some tests

  juancopi81

  committed
  bd91f0b

• Add title and description to video DTO

  juancopi81

  committed
  6f10627

• Some changes on how to retrieve the title and description from an YouTube URL

  juancopi81

  committed
  de8b2bf

• Finished whispertranscriber Transcriber and add tests, working fine

  juancopi81

  committed
  f75b008

• Fix minor bug in TranscribedVideo docs

  juancopi81

  committed
  4da7306

Commits on Oct 21, 2022

• Change structure of Video objects. From raw_video to transcribe_video to just using YouTubeVideo. This was is easier to add more features

  juancopi81

  committed
  a3cffb1

• Fix minor formatting bugs

  juancopi81

  committed
  4980c7f

• Add batchtransformer to apply different transformation to many videos

  juancopi81

  committed
  112255a

• Add tests to batchtransformer, working fine!

  juancopi81

  committed
  ec7cc9c

• Fix minor bug, misspelling

  juancopi81

  committed
  5d99f47

• Add storing component to save videos in SQLite db

  juancopi81

  committed
  1ce148f

Commits on Oct 23, 2022

• Add preprocessor and datapipeline modules, plus tests

  juancopi81

  committed
  e6770e0

• Add video preprocessor a datapipeline

  juancopi81

  committed
  96d9005

Commits on Oct 24, 2022

• Add some tests to datapipeline and utils

  juancopi81

  committed
  e473f6d

• Remove test files

  juancopi81

  committed
  c6208e6

Commits on Oct 25, 2022

• Change things to add threading capabilities to data pipeline

  juancopi81

  committed
  e6d3d83

• Add main file with cli inputs

  juancopi81

  committed
  5f5adf0

• Add upload dataset to HF hub

  juancopi81

  committed
  0b6a02e

• Change number of threads

  juancopi81

  committed
  81356a0

• Add requirements file

  juancopi81

  committed
  3927e4b

Commits on Nov 15, 2022

• Add token to upload dataset. Add check to see if ds has already the video. Add parameter so users can select which whisper model to user

  juancopi81

  committed
  0457039