Topic Name Description
File Module Information

Key information about how the module will run.

Lecture Notes File Full Notes (Sections 1-9.5, last updated 14/12/23)
Week 1 - Markov Chain Basics File Warm-up Problems

This module builds on your first and second year probability modules. Have a go at this sheet to check you are up to speed with the background material you will need. This sheet will be used in the Week 1 seminars.

File Problem Sheet 1

This sheet will not be assessed. We will discuss selected parts in the seminars in Week 2.

File Problem Sheet 1 Solutions
Week 2 - First Step Analysis File Problem Sheet 2

This sheet will not be assessed. We will discuss selected parts in the seminars in Week 3.

File Problem Sheet 2 Solutions
Week 3 - Long-term Behaviour I File Problem Sheet 3

This sheet will not be assessed (but see below for one part to submit). We will discuss selected questions in the seminars in Week 4.

File Problem Sheet 3 Solutions
Week 4 - Long-term behaviour II File Problem Sheet 4
File Problem Sheet 4 Solutions
Week 5 - More on limiting and equililbrium distributions/Recurrence and Transience File Problem Sheet 5
File Problem Sheet 5 Solutions
File Assessment 1 (small update to 1(b) 26/10/2023)

This is the first sheet for Assessment. Details of what you need to do are in the document. Submission will be via the tool in the Week 7 topic (to appear). This assessment contributes 10% towards your mark for the module.

File Solutions to Assessment 1
Week 6 - Recurrence and Transience File Problem Sheet 6
File Problem Sheet 6 Solutions
Week 8 - Poisson Process Definition File Problem Sheet 7
File Problem Sheet 7 Solutions
Week 9 - More on the Poisson Process File Problem Sheet 8
File Problem Sheet 8 Solutions
File Assessment 2 (small update to Question 1 30/11/2023)

This is the second sheet for Assessment. Details of what you need to do are in the document. Submission will be via the tool in the Week 11 topic (to appear). This assessment contributes 10% towards your mark for the module.

See the Student Forum for posts answering some student questions on this Assessment.

File Solutions to Assessment 2
Week 10 - Birth Processes File Problem Sheet 9
File Problem Sheet 9 Solutions
Week 11 - Continuous-time Markov Chains File Problem Sheet 10
File Problem Sheet 10 Solutions
Assessment information File Exam Guidance

Information on what you can expect in the exam and how to prepare for it.

File January 2022 Exam Solutions
File January 2023 Exam Solutions