LLMs, A Survey

Take a trip with me through the paper Large Language Models, A Survey, published on February 9th of 2024. All figures and tables mentioned throughout the episode can be found on the Into AI Safety podcast website.

00:36 ❙ Intro and authors
01:50 ❙ My takes and paper structure
04:40 ❙ Getting to LLMs
07:27 ❙ Defining LLMs & emergence
12:12 ❙ Overview of PLMs
15:00 ❙ How LLMs are built
18:52 ❙ Limitations if LLMs
23:06 ❙ Uses of LLMs
25:16 ❙ Evaluations and Benchmarks
28:11 ❙ Challenges and future directions
29:21 ❙ Recap & outro