Master in Artificial Intelligence (MAI)

Advanced Human Language Technology - Spring 2025

Instructors

Lluís Padró (coordinator) - contact - webpage

Sessions

Date	Content
February 13th	Introduction Statistical Language Models MLE practical example
February 13th	Lab Session 1 : Group 11 Task data & other stuff Guidelines and code for task 1 (NERC using ML)
February 20th	Statistical Language Models (continued) MEM practical example Exercises about estimation and smoothing
February 20th	Lab Session 1 : Group 12 Task data & other stuff Guidelines and code for task 1 (NERC using ML)
February 27	Lexical similarity. Distributional Semantics. Exercises about similarities
February 27	Lab Session 2 : Group 11 Continue work on Task 1
March 6th	Sequence Prediction Exercises about features
March 6th	Lab Session 2 : Group 12 Continue work on Task 1
March 13th	Constituency Parsing Exercises about constituent parsing
March 13th	Lab Session 3 : Group 11 Guidelines and code for task 2 (DDI using ML)
March 20th	Dependency Parsing Exercises about dependency parsing
March 20th	Lab Session 3 : Group 12 Guidelines and code for task 2 (DDI using ML)
March 27th	Recap exercises on all previous topics
March 27th	Lab Session 4 : Group 11 Continue work on Task 2
April 3th	No class (miderm exams week) (No AHLT midterm, though)
April 10th	Word Embeddings Exercises about Word Embeddings
April 10th	Lab Session 4 : Group 12 Continue work on Task 2
April 17th	No class - spring break
April 24th	Recurent Neural Networks Exercises about RNNs
April 24th	Lab Session 5 : Group 11 Guidelines and code for task 3 (NER using NN)
May 1st	No class - labour day
May 8th	Convolutional Neural Networks Exercises about CNNs
May 8th	Lab Session 5 : Group 12 Guidelines and code for task 3 (NER using NN)
May 15th	Transformers Exercises about Transformers
May 15th	Lab Session 6 : Group 11 Guidelines and code for task 4 (DDI using NN)
May 22th	Large Language Models Limitations and Ethics Exercises about LLMs
May 22th	Lab Session 6 : Group 12 Guidelines and code for task 4 (DDI using NN)
May 29th	Discussion/Review/Exercises
May 29th	Lab Session 7 : Groups 11&12 Continue work on Tasks 3&4

Important dates

April 21st: Deadline for delivery of ML report (lab tasks 1 and 2)

TBA: Deadline for delivery of NN report (lab tasks 3 and 4)

June 19th, 11:30-14:30h: Final exam

Exercise solutions

Exercises about estimation and smoothing

Exercises about similarities

Exercises about features

Exercises about constituent parsing

Exercises about dependency parsing

Exercises about word embeddings

Exercises about RNNs

Resources

Books

Alexander Clark, Chris Fox, Shalom Lappin (eds.)
The Handbook of Computational Linguistics and Natural Language Processing
Blackwell Handbooks in Linguistics, John Wiley & Sons, 2012.
R. Dale, H. Moisl, H.Somers (eds.)
Handbook of Natural Language Processing
Marcel Dekker, New York, 2000.
Nitin Indurkhya, Fred J. Damerau
Handbook of Natural Language Processing, Second Edition
Chapman & Hall/CRC Machine Learning & Pattern Recognition, 2010.
D. Jurafsky, James H. Martin
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
Prentice Hall, Upper Saddle River, N.J., 2017
C. Manning, H. Schütze
Foundations of Statistical Natural Language Processing
MIT Press, Cambridge, Mass., 1999.
R. Mitkov (ed.)
The Oxford Handbook of Computational Linguistics
Oxford University Press, 2004.

Similar Courses

Christopher Manning & Abigail See
Natural Language Processing with Deep Learning
Stanford University
Michael Collins
Natural Language Processing
Columbia University
Ivan Titov
Foundations of Natural Language Processing
University of Edinburgh
Sara Stymne
Syntactic Analysis / Syntactic parsing
Uppsala Universitet

Software

Language Processing

Machine Learning / Deep Learning

External Knowledge

Word Embeddings

Utilities

XML.dom