Skip to content

DASB pipeline implementation for Common Voice #61

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 65 commits into
base: main
Choose a base branch
from
Open

DASB pipeline implementation for Common Voice #61

wants to merge 65 commits into from

Conversation

ana-kuznetsova
Copy link

Common Voice implementation for DASB tokenizer evaluation.

  • Unification of offline token extraction extract.py
  • Unification of training and data pipeline in train.py
    Implemented for two architectures: LSTM and Branchformer.

poonehmousavi and others added 30 commits November 5, 2024 09:31
@poonehmousavi
add tokenizer_interface
a4f38bd
@poonehmousavi
add reactored version of ASR
0c2b751
@poonehmousavi
fix precommit
17898c3
@poonehmousavi
fix flake
db1590e
@poonehmousavi
fix blank index
3361ac6
@Chaanks
add tokens extraction / loading
2678a24
@Chaanks
update tokens extraction script
0694249
@Chaanks
update tokens extraction script
2c30ade
@Chaanks
update LibriSpeech ASR recipe
336dd64
@Chaanks
update LibriSpeech ASR recipe
cf40412
@poonehmousavi
change name
973e12b
@poonehmousavi
add discrete_ssl, reorgnaize folder
8dca49d
@poonehmousavi
clean code and fix speechtokenzier bug
e317d3a
@poonehmousavi
fix discrete_ssl bug
fcb5209
@poonehmousavi
fix bug
0d575d4
@poonehmousavi
fix bug
447844c
@poonehmousavi
fix discrete_ssl train.py for specifiying which layer to use
8aeaeb9
@poonehmousavi
fix discrete_ssl
c831e60
@poonehmousavi
fix bug introduced in last commit
ecf761a
@poonehmousavi
fix bug in saving pretrained embedding
0d2e309
@poonehmousavi
fix
4729007
@poonehmousavi
fix bug intriduced in prev commit
7a0ecc2
@poonehmousavi
fix bug for saveing embeedng
73dfa4d
@poonehmousavi
add vocab_size to encodec
a9e8f3b
@poonehmousavi
fix bug
4237bac
@poonehmousavi
fix embedding loading for train.py
867228e
@poonehmousavi
fix precommit
3570b63
@poonehmousavi
move tokenizer_interface to util
3ef9964
@poonehmousavi
update extract doc and comments and set to highest bitrate
ca05ac6
@poonehmousavi
add run_script.sh
a08891e
poonehmousavi and others added 28 commits December 25, 2024 21:08
@poonehmousavi
fix bug
78da6c1
@poonehmousavi
fix bug
6a3a7a5
@poonehmousavi
add hupertun for contextnet
e9ff250
@poonehmousavi
add etsting to average run
3e2fe0c
@poonehmousavi
add lr for HT for contextnet
f378aec
@poonehmousavi
Merge branch 'DASB-refactor' of https://github.com/Chaanks/benchmarks …
80238bc 
…into DASB-refactor
@poonehmousavi
add measuring time
b2bd316
@poonehmousavi
add time measure
9de6934
@poonehmousavi
update readme + minor changes
c4e2738
@poonehmousavi
fix link in readme
279e48b
@poonehmousavi
update table of contnet
7f32f1b
@poonehmousavi
fix
30fc2d6
@poonehmousavi
fix
a576ba7
@poonehmousavi
Merge pull request speechbrain#47 from Chaanks/DASB-refactor
7c75515 
Refactoring of Tokens Interface for DASB
@ana-kuznetsova
Add Common Voice tokenization
c96eefb
@ana-kuznetsova
Add linear model implementation
bd9e953
@ana-kuznetsova
upd .gitignore
9426cea
@ana-kuznetsova
adapt CV recipe
5835ade
@ana-kuznetsova
adapt cv for offline extraction
e767ebc
@ana-kuznetsova
adapt cv for offline extraction
eb2e692
@ana-kuznetsova
Merge branch 'speechbrain:main' into DASB-CV
c163db8
@ana-kuznetsova
add lstm config
b1d08dd
@ana-kuznetsova
Merge branch 'DASB-CV' of github.com:ana-kuznetsova/benchmarks into D…
8edf06c 
…ASB-CV
@ana-kuznetsova
fix lr in lstm config
6a094d2
@ana-kuznetsova
fix lr in lstm config
6b14316
@ana-kuznetsova
upd .gitignore
768b9a0
@ana-kuznetsova
fix filtering in CV extract
a1ca0ca
@ana-kuznetsova
adjust cv prepare pipeline
8662a2a
@pplantinga
Copy link
Collaborator

I have updated the main and DASB branch to address the CI failures due to a github change, merging the upstream DASB into this branch should make this CI run again.

@poonehmousavi
Copy link
Collaborator

@ana-kuznetsova could you please resolve the conflict

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@ana-kuznetsova @pplantinga @poonehmousavi @Chaanks