Module Description

Module: Machine Learning and Data Mining

Courses:

TitleTypeHrs/WeekPeriod
Machine Learning and Data MiningLecture2Summer Semester
Machine Learning and Data MiningRecitation Section (small)2Summer Semester

Module Responsibility:

NN

Admission Requirements:

None

Recommended Previous Knowledge:

  • Calculus
  • Stochastics

Educational Objectives:

Professional Competence

Theoretical Knowledge

Students can explain the difference between instance-based and model-based learning approaches, and they can enumerate basic machine learning technique for each of the two basic approaches, either on the basis of static data, or on the basis of incrementally incoming data . For dealing with uncertainty, students can describe suitable representation formalisms, and they explain how axioms, features, parameters, or structures used in these formalisms can be learned automatically with different algorithms. Students are also able to sketch different clustering techniques. They depict how the performance of learned classifiers can be improved by ensemble learning, and they can summarize how this influences computational learning theory. Algorithms for reinforcement learning can also be explained by students.

Capabilities

Student derive decision trees and, in turn, propositional rule sets from simple and static data tables and are able to name and explain basic optimization techniques. They present and apply the basic idea of first-order inductive leaning. Students apply the BME, MAP, ML, and EM algorithms for learning parameters of Bayesian networks and compare the different algorithms. They also know how to carry out Gaussian mixture learning. They can contrast kNN classifiers, neural networks, and support vector machines, and name their basic application areas and algorithmic properties. Students can describe basic clustering techniques and explain the basic components of those techniques. Students compare related machine learning techniques, e.g., k-means clustering and nearest neighbor classification. They can distinguish various ensemble learning techniques and compare the different goals of those techniques.

ECTS-Credit Points Module:

6 ECTS

Examination:

Written exam

Workload in Hours:

Independent Study Time: 124, Study Time in Lecture: 56


Course: Machine Learning and Data Mining

Lecturer:

Rainer Marrone

Language:

English

Period:

Summer Semester

Content:

  • Decision trees
  • First-order inductive learning
  • Incremental learning: Version spaces
  • Uncertainty
  • Bayesian networks
  • Learning parameters of Bayesian networks
    BME, MAP, ML, EM algorithm
  • Learning structures of Bayesian networks
  • Gaussian Mixture Models
  • kNN classifier, neural network classifier, support vector machine (SVM) classifier
  • Clustering
    Distance measures, k-means clustering, nearest neighbor clustering
  • Kernel Density Estimation
  • Ensemble Learning
  • Reinforcement Learning
  • Computational Learning Theory

Literature:

  1. Artificial Intelligence: A Modern Approach (Third Edition), Stuart Russel, Peter Norvig, Prentice Hall, 2010, Chapters 13, 14, 18-21
  2. Machine Learning: A Probabilistic Perspective, Kevin Murphy, MIT Press 2012
Back to Overview