Studying natural language models from the beginning

자연어 모델을 이해했는지 확인 + 공부를 위한 필기 노트입니다.

 

1. 단순 신경망

2. RNN

3. LSTM

4. GRU

5. Seq2Seq (Sequence to Sequnece)

6. Attention Mechanism

7. 교사 학습 (Teacher Forcing)

8. Beam Search Algorithm

9. Transformer (Encoder, Decoder)

10. BERT

11. RoBERTa

12. ALBERT

13. Embedding / Encoding

14. Knowledge Distillation

15. Self-Explaning

16. Sentence BERT