Artificial Intelligence

Beyond the Ego: V2X-Assisted Introspection for Trustworthy Perception in Autonomous Vehicles

Queen's University Belfast

School of Electronics, Electrical Engineering and Computer Science

Location
Belfast, United Kingdom
Funding
Home Studentship (covering tuition fees and maintenance stipend); £21,805 per annum; Yes
Application deadline
See university guidance

About the project

  • Share Facebook Twitter Linkedin Email
  • Facebook
  • Twitter
  • Linkedin
  • Email
  • Postgraduate Research 2026
  • PhD Opportunities
  • Find a PhD Supervisor

Beyond the Ego: V2X-Assisted Introspection for Trustworthy Perception in Autonomous Vehicles

  • Beyond the Ego: V2X-Assisted Introspection for Trustworthy Perception in Autonomous Vehicles: School of Electronics, Electrical Engineering and Computer Science | PHD
  • Project details
  • Subject information
  • Course content
  • Entry Requirements
  • Fees and Funding
  • Apply

Overview

Automated driving systems (ADS) rely on deep neural networks (DNNs) to detect and track surrounding road users from onboard cameras, LiDAR(s) and radar(s). Despite major advances, these detectors can still fail under adverse weather, occlusions, sensor degradation and previously unseen conditions. Perception introspection, also known as perception integrity monitoring, lets an ADS assess the reliability of its own perception at runtime and flag likely detection failures. However, existing introspection approaches rely only on onboard sensor information. This PhD project will look beyond the ego vehicle, investigating a new generation of V2X-assisted perception introspection systems that exploit complementary observations received from the roadside infrastructure. By combining onboard introspection outputs with infrastructure detections received over vehicle-to-everything (V2X) communication, the project aims to improve the detection of safety-critical perception failures while reducing unnecessary false alarms.

State-of-the-art introspection methods, including our own [1, 2], exploit neural activation patterns from different layers of an object detector’s backbone, to predict whether the detector has made an error. These introspection systems operate alongside the object detector and can identify potential detection failures without requiring ground truth information at runtime. However, the object detector and the introspection system may be affected by the same sensing limitations, potentially preventing the identification of certain detection failures. Meanwhile, recent advances in V2X-assisted cooperative perception have shown that roadside detections can improve object detection and tracking [3, 4]. Using offboard perception information to monitor the integrity of onboard object detection, rather than simply improving detection through sensor fusion, remains underexplored. The key challenge is to determine whether inconsistencies between onboard and offboard detections indicate genuine perception failures or merely arise from differences in sensor coverage, occlusions, measurement uncertainty or communication delays. Objectives The primary objective is to develop V2X-assisted integrity monitoring for autonomous vehicle perception. You will: Develop methods to associate onboard detections with V2X-received objects and tracks, accounting for spatio-temporal alignment, measurement uncertainty, sensor coverage and age of information. Design novel integrity monitors that use infrastructure perception as an independent reference to detect failures of the onboard detector, combining it with onboard introspection outputs. Extend these monitors to cooperative perception, assessing the reliability of the final output that fuses onboard and infrastructure information, where the two sources are no longer considered independent. Evaluate the developed methods against onboard-only introspection baselines in terms of failure detection and false alarm rates, using public cooperative perception datasets and CARLA-based simulations, supported by real-world data collection using QUB's autonomous research vehicle platform. Collaborations and Impact This PhD project will build on ongoing research at QUB on perception introspection and V2X-assisted cooperative perception, including activities within the recently launched Horizon Europe CONCENTRA project. It will leverage collaborations with leading automotive OEMs and technology providers across the UK and Europe, offering opportunities to engage with industrial researchers and address practical challenges in perception systems of self-driving vehicles. The successful candidate will develop expertise in deep learning, computer vision, V2X communication systems, cooperative perception and safety-critical AI, including relevant standards (ISO 21448/SOTIF). They will also gain practical skills in ROS 2, C++/Python, CARLA, large-scale cooperative perception datasets, and real vehicle sensors using QUB’s autonomous vehicle platform. The research is expected to generate experimental demonstrators and scientific publications, providing a strong foundation for careers in autonomous systems in industrial R&D or academia. References [1] H. Yatbaz, M. Dianati, K. Koufos, and R. Woodman, “Run-time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patterns,” Proceedings of the IEEE/CVF CVPR Workshops, 2024. [2] H. Yatbaz, K. Koufos, M. Dianati, and R. Woodman, “Multi-Layer Self-Assessment with Filtering for 3D Object Detection in Autonomous Vehicles”, ACM Transactions on Intelligent Systems and Technology, 2025. [3] H. Yu et al., "V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecasting," IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [4] E. Arnold, M. Dianati et al., “Cooperative Perception for 3D Object Detection in Driving Scenarios Using Infrastructure Sensors”, IEEE Transactions on Intelligent Transportation Systems, 2022.

Funding Information

To be eligible for consideration for a Home Studentship (covering tuition fees and maintenance stipend of approx. £21,805 per annum), a candidate must satisfy all the eligibility criteria based on nationality, residency and academic qualifications. To be classed as a Home student, candidates must meet the DfE/EPSRC residency requirements and the following criteria: • Be a UK National, or • Have settled status, or • Have pre-settled status, or • Have indefinite leave to remain or enter the UK. Irish nationals also qualify for Home student funding. Previous PhD study MAY make candidates ineligible to be considered for funding. Please note that other terms and conditions also apply. For further information about the residency and nationality requirements please see: DFE:https://www.economy-ni.gov.uk/sites/default/files/publications/economy/postgraduate-studentships-terms-conditions.pdf EPSRC: https://www.ukri.org/publications/terms-and-conditions-for-training-funding/ Please note that any available PhD studentships will be allocated on a competitive basis across a number of projects currently being advertised by the School. International Candidates: A small number of international awards will be available for allocation across the School. An international award is not guaranteed to be available for this project, and these awards will be highly competitive. International candidates are permitted to apply for a maximum of TWO projects across the entire school. Applications for more than two projects may be rejected due to a lack of relevance in research interests. Applicants must also upload complete documentation for their Bachelor’s degree and, where applicable, their Master’s degree. Failure to provide the required academic documentation may result in the application being marked as withdrawn. Academic Requirements: The minimum academic requirement for admission is normally an Upper Second Class Honours degree from a UK or ROI Higher Education provider in a relevant discipline, or an equivalent qualification acceptable to the University.

Professor Mehrdad Dianati

More Information

m.dianati@qub.ac.uk

Research Profile

Full-time: 3 or 3.5 years

Electrical & Electronic Engineering overview

The School of Electronics, Electrical Engineering and Computer Science (EEECS) aims to enhance the way we use technology in communication, data science, computing systems, cyber security, power electronics, intelligent control, and many related areas. You’ll be part of a dynamic doctoral research environment and will study alongside students from over 40 countries worldwide. We supervise students undertaking research in key areas of electronics and electrical engineering, including: - Power Electronics, - Robotics - Wireless Communications, - Cybersecurity - Sensor-based Systems. Within the School we have a number of specialist research centres. As part of a lively community of over 100 full-time and part-time research students you’ll have the opportunity to develop your research potential in a vibrant research community that prioritises the cross-fertilisation of ideas and innovation in the advancement of knowledge. Many PhD studentships attract scholarships and top-up supplements. PhD programmes provide our students with the opportunity to acquire an extensive training in research techniques.

Research students are encouraged to play a full and active role in relation to the wide range of research activities undertaken within the School and there are many resources available including:

  • ECIT brings together, in one building, internationally recognised research groups specialising in key areas of advanced digital and communications technology.
  • CSIT brings together research specialists in complementary fields such as data security, network security systems, wireless-enabled security systems, intelligent surveillance systems; and serves as the national point of reference for knowledge transfer in these areas.
  • Electric Power and Energy Systems research is focused on problems related to distributed sources of energy and their integration into power networks. The cluster is a member of the IET Power Academy and is a major collaborator on all-island energy research.
  • SoCaM is dedicated to the design of advanced, integrated, high-speed wireless and couples activities in High Frequency Electronics, System-on-Chip, Signals and Systems and Digital Signal Processing, and for Gigabit/sec wireless.
  • The Institute of Electronics, Communications and Information Technology, with state-of-the-art technology, offers a bespoke research environment.
  • You will be working under the supervision of leading international academic experts.
  • A wide range of personal development and specialist training courses offered through the Personal Development programme
  • Access to the Queen's University Postgraduate Researcher Development Programme
  • Office accommodation with access to computing facilities and support to attend conferences for full-time PhD students

Course content

Associated Research Research within the School is organised into research themes. ECIT brings together, in one building, internationally recognised research groups specialising in key areas of advanced digital and communications technology. Electric Power and Energy Systems research is focused on problems related to distributed sources of energy and their integration into power networks. The cluster is a member of the IET Power Academy and is a major collaborator on all-island energy research. SoCaM is dedicated to the design of advanced, integrated, high-speed wireless and couples activities in High Frequency Electronics, System-on-Chip, Signals and Systems and Digital Signal Processing, and for Gigabit/sec wireless.

PhD Opportunities PhD opportunities are available in a wide range of subjects in electronics and electrical engineering, aligned to the specific expertise of our PhD supervisors.

Research Impact Queen’s is a leader in commercial impact and one of the five highest performing universities in the UK for intellectual property commercialisation. We have created over 80 spin-out companies. Three of these - Kainos, Andor Technology and Fusion Antibodies - have been publicly listed on the London Stock Exchange.

Research Projects Queen’s has strong collaborative links with industry in Northern Ireland, and internationally. It has a strong funding track record with EPSRC and the EC H2020 programme.

Introduction For further information on career opportunities at PhD level please contact the Faculty of Engineering and Physical Sciences Student Recruitment Team on askEPS@qub.ac.uk. Our advisors - in consultation with the School - will be happy to provide further information on your research area, possible career prospects and your research application.

Assessment processes for the Research Degree differ from taught degrees. Students will be expected to present write up their work at regular intervals to their supervisor who will provide written and oral feedback; a formal assessment process takes place annually. This Annual Progress Review requires students to present their work in writing and orally to a panel of academics from within the School. Successful completion of this process will allow students to register for the next academic year. The final assessment of the doctoral degree is both oral and written. Students will submit their thesis to an internal and external examining team who will review the written thesis before inviting the student to orally defend their work at a Viva Voce.

Supervisors will offer feedback on the research work at regular intervals throughout the period of registration on the degree.

Full time PhD students will have access to a shared office space and access to a desk with personal computer and internet access.

Entrance requirements

Graduate The minimum academic requirement for admission to a research degree programme is normally an Upper Second Class Honours degree from a UK or ROI HE provider, or an equivalent qualification acceptable to the University. Further information can be obtained by contacting the School.

For information on international qualification equivalents, please check the specific information for your country .

Evidence of an IELTS score of 6.0, with not less than 5.5 in any component, or equivalent qualification acceptable to the University is required (taken within the last 2 years).

International students wishing to apply to Queen's University Belfast (and for whom English is not their first language), must be able to demonstrate their proficiency in English in order to benefit fully from their course of study or research. Non-EEA nationals must also satisfy UK Visas and Immigration (UKVI) immigration requirements for English language for visa purposes.

For more information on English Language requirements for EEA and non-EEA nationals see: www.qub.ac.uk/EnglishLanguageReqs .

If you need to improve your English language skills before you enter this degree programme, INTO Queen's University Belfast offers a range of English language courses. These intensive and flexible courses are designed to improve your English ability for admission to this degree.

Tuition Fees

Northern Ireland (NI) 1 | TBC

Republic of Ireland (ROI) 2 | TBC

England, Scotland or Wales (GB) 1 | TBC

EU Other 3 | £28,900

International | £28,900

1 EU citizens in the EU Settlement Scheme, with settled or pre-settled status, are expected to be charged the NI or GB tuition fee based on where they are ordinarily resident, however this is provisional and subject to the publication of the Northern Ireland Assembly Student Fees Regulations. Students who are ROI nationals resident in GB are expected to be charged the GB fee, however this is provisional and subject to the publication of the Northern Ireland Assembly student fees Regulations.

2 It is expected that EU students who are ROI nationals resident in ROI will be eligible for NI tuition fees. The tuition fee set out above is provisional and subject to the publication of the Northern Ireland Assembly student fees Regulations.

3 EU Other students (excludes Republic of Ireland nationals living in GB, NI or ROI) are charged tuition fees in line with international fees.

All tuition fees quoted relate to a single year of study unless stated otherwise. All fees will be subject to an annual inflationary increase, unless explicitly stated otherwise.

More information on postgraduate tuition fees .

Electrical & Electronic Engineering costs

There are no specific additional course costs associated with this programme.

Additional course costs

Depending on the programme of study, there may also be other extra costs which are not covered by tuition fees, which students will need to consider when planning their studies . Students can borrow books and access online learning resources from any Queen's library. If students wish to purchase recommended texts, rather than borrow them from the University Library, prices per text can range from £30 to £100. Students should also budget between £30 to £100 per year for photocopying, memory sticks and printing charges. Students may wish to consider purchasing an electronic device; costs will vary depending on the specification of the model chosen. There are also additional charges for graduation ceremonies, and library fines. In undertaking a research project students may incur costs associated with transport and/or materials, and there will also be additional costs for printing and binding the thesis. There may also be individually tailored research project expenses and students should consult directly with the School for further information.

Some research programmes incur an additional annual charge on top of the tuition fees, often referred to as a bench fee. Bench fees are charged when a programme (or a specific project) incurs extra costs such as those involved with specialist laboratory or field work. If you are required to pay bench fees they will be detailed on your offer letter. If you have any questions about Bench Fees these should be raised with your School at the application stage. Please note that, if you are being funded you will need to ensure your sponsor is aware of and has agreed to fund these additional costs before accepting your place.

How do I fund my study?

Find PhD opportunities and funded studentships by subject area.

We offer numerous opportunities for funded doctoral study in a world-class research environment. Our centres and partnerships, aim to seek out and nurture outstanding postgraduate research students, and provide targeted training and skills development.

The Government offers doctoral loans of up to £26,445 for PhDs and equivalent postgraduate research programmes for English- or Welsh-resident UK and EU students.

Information on Postgraduate Research scholarships for international students .

The Funding & Scholarship Finder helps prospective and current students find funding to help cover costs towards a whole range of study related expenses.

How to Apply

Apply using our online Postgraduate Applications Portal and follow the step-by-step instructions on how to apply .

If you're interested in a particular project, we suggest you contact the relevant academic before you apply, to introduce yourself and ask questions.

To find a potential supervisor aligned with your area of interest, or if you are unsure of who to contact, look through the staff profiles linked here .

You might be asked to provide a short outline of your proposal to help us identify potential supervisors.

Download Postgraduate Prospectus

Research areas

Artificial IntelligenceArtificial intelligenceAutonomous SystemsComputer Vision

Related PhD opportunities

PhD Artificial Intelligence

Queen's University Belfast

Queen's University Belfast

This project is available in CDT Fort- https://www.fort-cdt.ac.uk/. More information on the details of this programme is below.

Location
Belfast, United Kingdom
Deadline
See university guidance
Funding
CSC-PHD | Courses | Queen's University Belfast