What differs? - Deep Learning for Anomaly and Out of Distribution Detection in Computer Vision (Visual AI) Applications

About the project

About the Project Anomaly detection , and the synonymous topics of novelty and out-of-distribution detection, addresses the computer vision ("visual AI") challenge of automatically identifying outliers within the scene or image based on their appearance, motion or behaviour characteristics. Essentially asking - "what differs and why?" - but doing this algorithmically in the age of Large Language Models (LLM) and Vision Language Models (VLM) tools. This represents an important and application-relevant challenge within both computer vision and the broader field of artificial intelligence that can be applied both across a wide range of data sources (e.g. images/video, 3D LiDAR/radar/point cloud data, bio-signals etc) and the imaging spectrum (visible, thermal infrared, X-ray etc). This project aims to focus on the use of deep learning based computer vision approaches for this task, with a particular focus on developing approaches that can address the challenges of dataset imbalance, continuous learning and/or complex scene contexts. There are a wide range of applications for automatic anomaly and out of distribution detection approaches, that could form the basis for a specific PhD project: on-line learning for continuous automated wide area surveillance in CCTV applications 2D and 3D security X-ray image screening for transportation and border security applications outlier detection within vehicle perception systems for future autonomous road vehicles automated wide area search and detect for automating future drone-based search and rescue operations automated in-situ infrastructure inspection using varying sensor capabilities mounted on autonomous robotics and/or drones Supporting Resources The Department of Computer Science at Durham University hosts well-equipped labs with on-site capabilities comprising vehicle-mounted sensors (LiDAR, radar, camera, GPS/IMU), drone operations, on/off-road robotics, high-precision geo-localisation, BCI/EEG bio-signal data collection, robotic arm manipulation, X-ray security imaging, virtual reality and on-demand wide-area surveillance video feeds. In addition Durham University hosts the UK regional supercomputer, Bede (128 NVIDIA V100 GPUs) which complements our departmental NVIDIA CUDA Compute Cluster (80+ GPUs up to NVIDIA A100) to cater for the increasing GPU compute demands of modern AI-driven research projects. The department itself is based in the newly built Mathematical and Computer Sciences building - a £42 million, 9,160m 2 state of the art teaching, learning and research facility, located on the University's Upper Mountjoy Campus co-located with the Department of Mathematics. All PhD students are allocated desk and/or lab space to support their research work and PhD student research projects are additionally supported by an annual equipment/travel allowance spanning the duration of the PhD study period. Supervision You will be supervised by Prof. Toby Breckon ( https://breckon.org/toby/ ) , Professor of Computer Vision and Image Processing in both the Department of Computer Science and Department of Engineering, and Head of Visual Computing (Computer Science) at Durham University in collaboration with one or more staff from the VIViD research group . The work of Prof. Breckon's research team relates to all aspects of computer vision and robotic sensing – the automatic understanding of images by computer as an aspect of artificial intelligence using deep learning (i.e. "visual AI" ). Within this domain his team specializes in several industry-facing problem domains spanning X-ray image understanding , automotive vision (autonomous vehicles), visual surveillance , robotic sensing and general topics in object detection/classification . This has resulted in over £29+ million of research income (to 2026+), collaboration with 40+ government and industry partners, over 200 research publications and supported the development of AI software start-up COSMONiO by former team members (acquired by Intel, 2020). During the PhD study, you will receive extensive training and research guidance via regular one-to-one supervision meetings with Prof. Breckon, in addition to weekly research team meetings, to allow you to both develop your research potential and consolidate your technical skill-base. Prof. Breckons’s research team has a diverse and collaborative culture that aims to facilitate the realisation of each individual's abilities against a range of available research opportunities . Previous PhDs from the team have published their research in a range of prestigious venues (e.g. CVPR, ICCV, ECCV, BMVC) and graduated to a range of careers in the AI industry . Durham University Durham University is a world top-100 university (QS), a European top-50 university (QS), ranked the 5th in the UK (Times, 2024) and a member of the research-intensive Russell Group of UK universities, focussing on research excellence delivered by world-leading academics. Durham is the third oldest university in England, following Oxford and Cambridge, founded in 1832 and situated in the ancient City of Durham, a relatively small city by international standards (pop. ~50,000) situated in the North East of England with long-established historical roots (including an on-campus UNESCO world heritage site comprising Durham Cathedral and Castle). Today the university offers a strong and unique collegiate student experience, with each student being a member of one of the university's 17 constituent colleges, with a relatively low cost of living compared to other parts of the UK . Entry Requirements First class honours (or high 2.1 at undergraduate or equivalent Masters) degree in an Engineering, Physics, Maths or Computer Science based subject (internationally: GPA 3.3+ or equiv). Strong understanding of computing/engineering applications and mathematical problem solving. Knowledge of modern programming languages (ideally including one of Python, C++/C or Rust). Excellent written and spoken communication skills in English, meet the Durham University English language requirements ( https://www.dur.ac.uk/study/international/entry-requirements/english-language-requirements/ ). Prior experience in research, industry and/or AI based research topics is beneficial but not essential. How to Apply Please send an email with your CV, degree transcripts and any supporting documents to Professor Toby Breckon toby.breckon@durham.ac.uk for an initial pre-application discussion.

Research areas