CE811-7-AU-CO:
Game Artificial Intelligence
2024/25
Computer Science and Electronic Engineering (School of)
Colchester Campus
Autumn
Postgraduate: Level 7
Current
Thursday 03 October 2024
Friday 13 December 2024
15
27 June 2024
Requisites for this module
(none)
(none)
(none)
(none)
(none)
MSC G400CH Advanced Computer Science,
MSC G411CH Artificial Intelligence,
MSC G61012 Computer Games,
MSC G456N4 Computing
This module covers a range of Artificial Intelligence techniques employed in games, and teaches how games are and can be used for research in Artificial Intelligence.
The module explores algorithms for creating agents that play classical board games (such as chess or checkers) and real-time games (Mario or PacMan), including applying deep learning and reinforcement learning to play games.
The course also covers Procedural Content Generation, and explores the techniques used to simulate intelligence in the latest videogames.
Students should either be strong programmers or have some previous Python programming experience to take this module. The module starts assuming students have proficiency in Python programming from the very first week's lab exercise.
The aims of this module are:
- To provide the student with the core knowledge of the techniques behind the most popular algorithms for Artificial Intelligence.
- To program the agents that play a range of different games, either by themselves or as opponents the player must face.
- To teach how automatic generation of content (complete games, rules, levels and gameplay elements) can be achieved by means of Artificial Intelligence.
- To teach the basics of deep learning and reinforcement learning, and how these can be used to create agents which are capable of playing a range of different games.
By the end of this module, students will be expected to be able to:
- Understand the techniques behind algorithms that play real-time video games and adversarial board games.
- Design and program agents that are able to play any given real-time or adversarial board game.
- Design and program algorithms that generate content for games procedurally, according to some predefined goals.
- Design and program non-player character behaviours for video games that create the illusion of intelligence.
Syllabus
- Basics of Reinforcement Learning: Value Iteration, Policy iteration, Monte Carlo, Temporal Difference Learning, Q-Learning. The Multi-Armed Bandit Problem, Upper Confidence Bound for Trees, Monte Carlo Tree Search.
- Nature Inspired Intelligence: Neural Networks and Genetic Algorithms Adversarial Games: Minimax, Alpha-Beta Search, Monte Carlo Tree Search.
- A Case Study: Deep Learning in Game Playing Steering Behaviours for Autonomous Characters.
- Path-finding: A*, Dijkstra's algorithm, Waypoint-based path-finding, Navigational Meshes.
- Agent Behaviour: Finite State Machines, Hierarchical FSMs, Behaviour Trees.
- Simulating Intelligence: Sensory Systems, Animations, Goal-Oriented Action Planning. Procedural Content Generation for Games. Refresher information on Vectors, Probability and Calculus will be provided during this module. The course will be taught via lectures and extensive laboratory exercises, using Python as the main programming language. Note that students should either be strong programmers, or have previous Python programming experience, to take this module, as the Python programming will be fairly demanding as soon as the module starts.
This module will be delivered via:
- Eight 2-hour lectures.
- Ten 2-hour labs.
- Two 1-hour progress tests (in weeks 6 and 11).
- Weekly Moodle Quizzes.
- Additional video lectures.
-
Millington, I. (2019)
AI for Games. 3rd edn. Boca Raton, USA: CRC Press. Available at:
https://doi.org/10.1201/9781351053303.
-
Yannakakis, G.N. and Togelius, J. (2018)
Artificial Intelligence and Games. Cham, CH: Springer. Available at:
https://link-springer-com.uniessexlib.idm.oclc.org/book/10.1007/978-3-319-63519-4.
-
Shaker, N., Togelius, J. and Nelson, M.J. (2016)
Procedural Content Generation in Games. Cham, CH: Springer. Available at:
https://ebookcentral.proquest.com/lib/universityofessex-ebooks/detail.action?docID=6315325.
-
Reynolds, C. (1999) ‘Steering Behaviors For Autonomous Characters’. Available at:
http://www.red3d.com/cwr/steer/gdc99/.
-
Sutton, R.S. and Barto, A.G. (2018)
Reinforcement Learning: An Introduction. 2nd edn. Cambridge, USA: The MIT Press. Available at:
https://ebookcentral.proquest.com/lib/universityofessex-ebooks/detail.action?docID=3338821.
The above list is indicative of the essential reading for the course.
The library makes provision for all reading list items, with digital provision where possible, and these resources are shared between students.
Further reading can be obtained from this module's
reading list.
Assessment items, weightings and deadlines
Coursework / exam |
Description |
Deadline |
Coursework weighting |
Coursework |
Progress Test 1 (In person, open book restricted, MCQ) |
|
20% |
Coursework |
Progress Test 2 (In person, open book restricted, MCQ) |
|
20% |
Coursework |
Moodle Tasks for Lab Sessions |
|
20% |
Coursework |
Assignment 1: Programming Game-AI techniques |
13/11/2024 |
20% |
Coursework |
Assignment 2: Programming intelligent game-playing agents |
09/12/2024 |
20% |
Additional coursework information
The course will include the use of open-source game frameworks.
Exam format definitions
- Remote, open book: Your exam will take place remotely via an online learning platform. You may refer to any physical or electronic materials during the exam.
- In-person, open book: Your exam will take place on campus under invigilation. You may refer to any physical materials such as paper study notes or a textbook during the exam. Electronic devices may not be used in the exam.
- In-person, open book (restricted): The exam will take place on campus under invigilation. You may refer only to specific physical materials such as a named textbook during the exam. Permitted materials will be specified by your department. Electronic devices may not be used in the exam.
- In-person, closed book: The exam will take place on campus under invigilation. You may not refer to any physical materials or electronic devices during the exam. There may be times when a paper dictionary,
for example, may be permitted in an otherwise closed book exam. Any exceptions will be specified by your department.
Your department will provide further guidance before your exams.
Overall assessment
Reassessment
Module supervisor and teaching staff
Dr Michael Fairbank, email: m.fairbank@essex.ac.uk.
Dr Michael Fairbank
School Office, email: csee-schooloffice (non-Essex users should add @essex.ac.uk to create full e-mail address), Telephone 01206 872770
Yes
No
Yes
Dr MARJORY CRISTIANY Da COSTA ABREU
Sheffield Hallam University
Senior Lecturer
Available via Moodle
Of 508 hours, 0 (0%) hours available to students:
508 hours not recorded due to service coverage or fault;
0 hours not recorded due to opt-out by lecturer(s).
Disclaimer: The University makes every effort to ensure that this information on its Module Directory is accurate and up-to-date. Exceptionally it can
be necessary to make changes, for example to programmes, modules, facilities or fees. Examples of such reasons might include a change of law or regulatory requirements,
industrial action, lack of demand, departure of key personnel, change in government policy, or withdrawal/reduction of funding. Changes to modules may for example consist
of variations to the content and method of delivery or assessment of modules and other services, to discontinue modules and other services and to merge or combine modules.
The University will endeavour to keep such changes to a minimum, and will also keep students informed appropriately by updating our programme specifications and module directory.
The full Procedures, Rules and Regulations of the University governing how it operates are set out in the Charter, Statutes and Ordinances and in the University Regulations, Policy and Procedures.