Open
Description
Description
Currently we use a custom training loop along with HF accelerator for training. This story is to replace that with HF Trainer similar to what we implemented for fine-tuning.
Tasks
- Implement HF Trainer in peft prompt tuning module
- Make sure all unit tests pass and add any unit tests necessary
- Evaluate newly implemented training loop with RTE and CNN datasets using:
4. Bloom-560m
5. t5-base
Acceptance Criteria
- Unit tests cover new/changed code
- Example modified to expose any new parameter we may need
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
Ready for Review