Wikier

Teorimoduler - IDI

TDT13 - Large Language Models for Language Understanding and Generation

Norsk: Store språkmodeller for språkforståelse og –generering

Given by Björn Gambäck.


The course consists of a set of regular lectures and student presentations.

NB: The course content is tailored towards the needs of students writing a Master's Thesis in Language Technology and the course is thus primarily open for those students. However, it should be possible to accommodate other interested students, and there’s no prerequisite that students have taken the course TDT4310 (Intelligent Text Analytics and Language Understanding/Intelligent tekstanalyse og språkforståelse) or similar (students with such background are advised to look at TDT12 instead).

Still, all students that want to follow the course must contact the lecturer beforehand.


The course will not assume any particular background knowledge of the field, but will be most relevant for students writing a Master's Thesis in Language Technology or a related field, or those that have a specific interest in human language understanding or generation. An introduction to/overview of language technology will be the main part of the course.

This year, we will in particular discuss:

  • word embeddings and word-space modelling,
  • transfer learning, transformers and self-attention,
  • semantic representations and processing,
  • classification algorithms for language processing, applied to issues such as:
    • sentiment analysis
    • digital forensics / author profiling
    • hate speech / extremism
    • figurative language such as sarcasm and humour

Course Material

The course material (lecture recordings and slides, articles, etc.) will be published in the course Teams group.


Examination

The grading will be based on a written project report, which also should be presented to the rest of the class, with report themes selected by the students together with the lecturer.

The project can be carried out individually or in groups of two students working together.


(Prel.) Course Schedule

The course will start in week 35, on Tuesday 25.8 at 13:15-15:00 in room 454, which is on the 4th floor of IT-bygget.

The lectures thereafter will (tentatively) be every second week at the same time and in the same place, so in room 454 at 13:15-15:00 on Tuesday 8.9, 22.9 and 6.10.

The student project presentations will tentatively be given on Tuesday 17.11, at 13:15-16:00 in room 454.

The lectures and presentations will be onsite. The lectures will possibly be available to follow also online and/or recorded (though only in case a student has valid reasons not to attend a specific lecture in person); the student presentations will be in-person only.


Visiting hour

by appointment


For more information about the course, please contact Prof. Björn Gambäck.


9059 Visninger