Skip to content

Replace training loop in peft_prompt_tuning with HF Trainer #175

Open
@gkumbhat

Description

@gkumbhat

Description

Currently we use a custom training loop along with HF accelerator for training. This story is to replace that with HF Trainer similar to what we implemented for fine-tuning.

Tasks

  1. Implement HF Trainer in peft prompt tuning module
  2. Make sure all unit tests pass and add any unit tests necessary
  3. Evaluate newly implemented training loop with RTE and CNN datasets using:
    4. Bloom-560m
    5. t5-base

Acceptance Criteria

  • Unit tests cover new/changed code
  • Example modified to expose any new parameter we may need

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Status

Ready for Review

Relationships

None yet

Development

No branches or pull requests

Issue actions