Meeting Note #6 04.04.2019

Location: Bogazici University Computer Engineering Building

Date/Time: 04.04.2019 / 12:00

Attendees:

• Suzan Üsküdarlı
• Onur Güngör
• Uğurcan Arıkan

1. Preparation Before Meeting

• 1.1. Create training environment at the "computer minerva"

2. Agenda

• 2.1. Pretraining BERT

3. Discussion

• 3.1. Memory issue during BERT's pretraining has been discussed

4. Outcomes

• 4.1. BERT pretraining
  • 4.1.1. BERT's pretraining will continue with different batch size and number of training steps

5. TO-DO list

Deadline: 04.04 12:00 Assignee: Uğurcan Arıkan

• 5.1. Continue pretraining BERT