Probabilistic Graphical Models:
Principles and Applications
Professor:
Luis
Enrique Sucar
esucar (AT)
inaoep.mx
Text Book
L. E. Sucar, Probabilistic Graphical Models: Principles and Applications, Springer 2015
General Description
Program
Calendar
Class Sessions
Course Notes
Class 1 - Introduction [PDF]
Class 2 - Probability [PDF]
Class 3 - Graphs [PDF]
Class 4 - Bayesian classifiers [PDF]
Class 5 - Hidden Markov Models [PDF]
Class 6 - Markov Random Fields [PDF]
Class 7 - Bayesian networks: representation and inference [Part I - PDF] [Part II - PDF]
Class 8 - Bayesian networks: learning [PDF]
Class 9 - Dynamic and Temporal Bayesian Networks [PDF]
Class 10 - Decision Graphs [PDF]
Class 11 - Markov Decision Processes [PDF]
Class 12 - Relational Probabilistic Graphical Models [PDF]
Class 13 - Causal Graphical Models [PDF]
Previous Notes (in Spanish)
Clase 1: Introducción [PDF]
Clase 2: Probabilidad [PDF]
Clase 3: Teoría de Información [PDF]
Clase 4: Grafos [PDF]
Clase 5: Métodos Básicos [PDF]
Clase 6: Clasificadores [PDF] [Imprimible]
Clase 7: Modelos Ocultos de Markov [PDF] [Imprimible]
Clase 8: Campos de Markov [PDF] [Imprimible]
Clase 9: Redes Bayesianas - Representación [PDF] [Imprimible]
Clase 10: Redes Bayesianas - Inferencia (Parte I) [PDF] [Imprimible]
Clase 11: Redes Bayesianas - Inferencia (Parte II) [PDF] [Imprimible]
Clase 12: Redes Bayesianas - Aprendizaje [PDF] [Imprimible]
Clase 13: Redes Bayesianas - Extensiones y Aplicaciones [PDF]
Clase 14: Redes de Decisión [PDF]
Clase 15: Procesos de Decisión de Markov [PDF]
Clase 16: Alternativas y Extensiones [PDF]
Homework
Week 1:
- Read paper on Reasoning under Uncertainty (in References, 3 parts)
- Read paper on Interpretations of Probability (in References, Philosophical aspects)
- Read Chapter 1 - Textbook
Week 2:
- Read Chapter 2 - Textbook
- Solve the following problems from Chapter 2: 4,5,8,9
Week 3:
- Read Chapter 3 - Textbook
- Solve the following problems from Chapter 3: 1,7,8,9
Week 4:
- Read Chapter 4 - Textbook
- Solve the following problems from Chapter 4: 1, 5, 9 (Problem 9 should be handin next class)
Week 5:
- Read Chapter 5 - Textbook
- Solve the following problems from Chapter 5: 1, 3, 4, 5
Week 6:
- Read Chapter 6 - Textbook
- Solve the following problems from Chapter 6: 1, 4, 5
Week 7:
- Read Chapter 7 - Textbook
- Solve the following problems from Chapter 7: 1, 3, 5
Week 8:
- Final Project Proposal:
Handin a one page summary of your final project proposal, including:
(i) problem description, (ii) objective, (iii) PGM techniques to be
implemented, (iv) expected results.
- Download the demo version of
"Hugin" (software for Bayesian nets). Using this software: (a)
Construct using the graphical interface a BN for the example in Fig.
7.1 of the text book, defining the values for each variable and its
CPTs. (b) Perform several inferences give different evidences and
obtaing the posterior probabilities of all the variables. (c) Use the
learning tool to obtain the structure and parameters for one of the
dataset of problem 9, chapter 4. Handin a written report with the graphs and results of each part.
Week 9:
- Read Chapter 8 - Textbook
- Solve the following problems from Chapter 8: 1, 2, 7
Week 10: Midterm Exam
- It covers from Chapter 1 to Chapter 8
- Two
parts: (i) Theoretical: questions about the main concepts covered in
the course, (ii) Practical: problems related to the techniques analized
in the course (similar to the homework problems)
- Notes: you can use one letter size page of notes during the exam; any other material is not allowed
FINAL PROJECT
- Final project: report and presentation
- Report: scientific paper (Format
Lecture Notes from Springer) maximum 10 pages (without considering appendix) with the following (send via e-mail and handin printout):
- Abstract
- Introduction
- Related work
- Methodology
- Experiments and results
- Conclusions and future work
- References (standar format)
- Appendix (detailed results, code, ...)
- Presentation: 15 Minutes presentation including:
- Problem description
- Related work
- Methodology
- Results
- Conclusions
References
Philosofical aspects
Reasoning under uncertainty
Probabilistic graphical models
Markov chains and HMMs
Bayesian Networks
MDPs and POMDPs
UAI
Tools
Other external links
Software/Data:
Associations:
Conferences:
Uncertainty in
AI
Probabilistic Graphical Models:
FLAIRS -
Uncertain Reasoning Track:
Bayesian Networks:
Projects
Projects suggestions:
- Develop a more efficient way to learn semi-naive Bayesian classifiers
- Develop a SLAM (simultaneous localization an mapping) based on graphical models
- Object tracking with Kalman / Particle Filters
- Learning dynamic Bayesian networks
- Implement "testing Bayesian networks" (more expressive, similar to NNs)
- Implement inference (prediction, counterfactuals) for Bayesian causal networks
- Learn temporal / dynamic causal networks
Previous projects:
Resumen [PDF] [PPTX]