Prospectus

nl en

Large Language Models

Course
2024-2025

Admission requirements

None.

Description

In this course, students will learn to apply Large Language Models to the analysis of natural language. We will discuss vectorized representations of texts and we will cover deep learning-based architectures of Large Language Models, including fine-tuning, prompting, retrieval-augmented generation and function calling. The course consists of 12 lectures and home or in-class assignments. In the lectures, we will discuss the formal background of deep learning-based natural language processing, in particular LLMs, and recent relevant literature. In the assignments, students will use an online environment (Google Colab) in which they can run their experiments. Code will be provided by the teacher; students learn to adapt the code and run their own experiments.

Course objectives

Students will build up practical skills for applying (and understanding) Large Language Models. This course will help build the fundamentals for research-oriented classes in the MA track Computational Linguistics. Students will acquire analytical skills that help them to interpret algorithm outcomes. They will learn to work together, and report on their findings.

Timetable

The timetables are available through My Timetable.

Mode of instruction

Lecture

Assessment method

Assessment

Oral group presentation and written exam with open and essay questions.
Students will be evaluated through (1) a written exam (2) a joint presentation of a practical group assignment consisting of an implementation of an NLP topic (here, quality of solutions is not important; just a clear experimental narrative). Topics for the group assignment are voluntary, and will be chosen around 2/3 of the course, so that students can get timely assistance.

Weighing

The final grade will consist of an unweighted average of the scores for the written exam and the practical assignment.

Resit

The resit for the written exam will consist of an alternative partial written exam readdressing the topics of the failed questions. The resit for the group assignment will consist of a reprisal of the group presentation.

Inspection and feedback

How and when an exam review will take place will be disclosed together with the publication of the exam results at the latest. If a student requests a review within 30 days after publication of the exam results, an exam review will have to be organized.

Reading list

Stephan Raaijmakers: Deep learning for Natural Language Processing. Manning, 2022 (optional)

Literature (papers), to be distributed during the course.

Python: http://www.spronck.net/pythonbook/index.xhtml

Registration

Enrolment through MyStudyMap is mandatory.
General information about course and exam enrolment is available on the website.

RegistrationExchange

For the registration of exchange students contact Humanities International Office.

Contact

  • For substantive questions, contact the lecturer listed in the right information bar.

  • For questions about enrolment, admission, etc, contact the Education Administration Office: Reuvensplaats

Remarks

None.