Artificial Intelligence

Neuromorphic Touch for Fast, Contact-Aware Vision-Language-Action Robot Manipulation

Queen's University Belfast

School of Electronics, Electrical Engineering and Computer Science

Location
Belfast, United Kingdom
Funding
REF: EEECS27/GS1 - CSC-PHD
Application deadline
See university guidance

About the project

  • Share Facebook Twitter Linkedin Email
  • Facebook
  • Twitter
  • Linkedin
  • Email
  • Postgraduate Research 2026
  • PhD Opportunities
  • Find a PhD Supervisor

Neuromorphic Touch for Fast, Contact-Aware Vision-Language-Action Robot Manipulation

  • Neuromorphic Touch for Fast, Contact-Aware Vision-Language-Action Robot Manipulation: School of Electronics, Electrical Engineering and Computer Science | PHD
  • Project details
  • Subject information
  • Course content
  • Entry Requirements
  • Fees and Funding
  • Apply

Overview

Robots are learning to follow everyday instructions, such as “pour 100 ml of water into the beaker”, through vision-language-action (VLA) models: large AI models that turn camera images and language into motor commands. Today’s VLA models, however, act mostly by sight. They plan short bursts of motion a few times per second, and anything that happens in between must wait for the next plan. A slipping grasp, a jammed part or the moment liquid starts to flow can therefore go unnoticed for hundreds of milliseconds. Humans avoid such errors through touch, adjusting their grip almost instantly when something changes. This PhD will give VLA robots a fast sense of touch. It will use neuromorphic (event-based) tactile fingertips, which report changes in skin deformation as a stream of microsecond-timed events rather than as slow video frames. It will develop AI methods that let a large robot model exploit this signal: recognising contact, deciding when touch matters and how strongly it should steer the action, and triggering fast corrections only when they are needed. A flagship demonstration will be a robot that pours a requested volume of liquid by feeling the changing weight in its fingertips. The project is a collaboration with tactile robotics researchers at the University of Bristol (Bristol Robotics Laboratory), where the NeuroTac neuromorphic tactile sensor was developed.

Background Vision-language-action (VLA) models such as π0, π0.5 and OpenVLA [1–3] have shown that one pretrained model can perform many manipulation tasks from natural-language instructions. They remain weak, however, at contact-rich and time-critical manipulation: inserting a part, sliding along a surface, holding an object that begins to slip, or pouring a precise amount. In these tasks the decisive information is local and fleeting (shear, slip or a sudden change in load). It is often invisible to cameras and must be acted on within tens of milliseconds. Recent tactile VLA and slow–fast policies [4, 5] show the value of feeding touch into the policy at a higher rate. Event-based optical tactile sensors such as NeuroTac and Evetac [6, 7] go further. They pair a soft, marker-patterned skin with a neuromorphic event camera and report sparse, asynchronous events with microsecond resolution exactly when the contact changes. A fast sensor alone is not enough, though. The whole loop from sensing to a revised motor command must also be fast, and the meaning of a tactile signal depends on the task: the same shear may mean “keep sliding”, “push less” or “grip tighter”. How to bring such sensing into large, comparatively slow, pretrained robot models is an open question, and it is the focus of this PhD. Aim and objectives The aim is to develop and validate event-driven vision-language-action control, in which neuromorphic touch determines both how strongly tactile feedback influences the robot’s actions and when those actions are updated. O1 – Event-based contact representation. Design causal, low-latency neural encoders that turn asynchronous tactile events from two fingertips, together with robot proprioception, into a persistent contact memory. The memory should capture contact onset, shear, incipient slip, release and held load. It must stay reliable during event silence, when a stable grasp produces no new events, and tell that state apart from release or a sensor fault. O2 – Touch-aware VLA policies. Connect this contact state to a pretrained VLA model through lightweight gated adapters, so that the task context modulates the influence of touch while the model’s vision-language knowledge is preserved. A learned, event-triggered scheduler will decide when it is worth computing a fast correction to the part of the plan not yet executed. The target is an end-to-end tactile reaction time of around 10 ms within a fixed computing budget. O3 – Simulation and data for neuromorphic touch. Build a physics-based simulator of event-based tactile fingertips, modelling soft-skin deformation and event generation (e.g., with v2e [8]), inside robot simulators such as MuJoCo and Genesis, including liquid-pouring scenes. Calibrate it against real sensor recordings and use it to generate large, automatically labelled datasets for pre-training and sim-to-real transfer. O4 – Real-world evaluation. Evaluate on a robot arm with neuromorphic tactile fingertips across contact-rich, time-critical tasks: pouring a commanded volume (e.g., 100 ml to within ±10 ml) by sensing load through fingertip shear, peg insertion under perturbations, and recovery from slip. Compare against vision-only, frame-based tactile and fixed-rate slow–fast policies at matched compute. Measure reaction latency, success rate, pouring accuracy and false triggers. Methodology and timeline The project is simulation-first, so early progress does not depend on hardware availability. Year 1 – Literature review and core training. Build the simulation pipeline and a benchmark of contact-rich tasks (O3). Reproduce frame-based tactile VLA baselines by fine-tuning open-source VLA models. Year 2 – Develop the event encoder and contact memory (O1), and the gated adapter and event-triggered scheduler (O2). Train them in simulation and on recorded real event data, and submit first papers to leading venues. Year 3 – Integrate and evaluate on real hardware, including the pouring demonstration (O4), with research visits to Bristol for real-robot experiments. Release the code, simulator and datasets as open source, and write the thesis. Expected outcomes and impact The project will deliver (i) new methods for coupling fast, asynchronous sensors with large robot foundation models; (ii) an open-source simulator and benchmark for event-based tactile manipulation; (iii) publications at leading robotics and AI venues (e.g., ICRA, IROS, CoRL, RSS, NeurIPS, CVPR, IEEE T-RO and RA-L); and (iv) a real-robot demonstration of touch-guided pouring. Robots that can feel and react quickly are a step towards safe, flexible automation in manufacturing, food and drink processing, laboratory automation and assistive care. Research environment and training The student will join the Data Science and Scalable Computing research centre in EEECS at Queen’s. The principal supervisor, Dr Guanxiong Sun, works on spatio-temporal video understanding, efficient temporal modelling, generative models and multimodal learning, and now applies this work to robot learning. Event streams are spatio-temporal signals, so this expertise transfers directly. The project is a collaboration with tactile robotics researchers at the University of Bristol, where NeuroTac was developed, and includes research visits for real-robot experiments. The student will have access to GPU computing and will receive training in robot learning, foundation models and neuromorphic sensing, alongside the Queen’s Graduate School training programme. Graduates with these skills are in high demand in industry and academia. Informal enquiries are welcome: please contact Dr Guanxiong Sun at g.sun@qub.ac.uk Key references [1] K. Black et al., “π0: A vision-language-action flow model for general robot control,” arXiv:2410.24164, 2024. [2] Physical Intelligence et al., “π0.5: A vision-language-action model with open-world generalization,” arXiv:2504.16054, 2025. [3] M. J. Kim et al., “OpenVLA: An open-source vision-language-action model,” Conference on Robot Learning (CoRL), 2024. [4] H. Xue et al., “Reactive Diffusion Policy: Slow-fast visual-tactile policy learning for contact-rich manipulation,” Robotics: Science and Systems (RSS), 2025. [5] D. Niu et al., “T-Rex: Tactile-reactive dexterous manipulation,” arXiv:2606.17055, 2026. [6] B. Ward-Cherrier, N. Pestell and N. F. Lepora, “NeuroTac: A neuromorphic optical tactile sensor applied to texture recognition,” IEEE ICRA, 2020. [7] N. Funk et al., “Evetac: An event-based optical tactile sensor for robotic manipulation,” IEEE Transactions on Robotics, 2024. [8] Y. Hu, S.-C. Liu and T. Delbruck, “v2e: From video frames to realistic DVS events,” CVPR Workshops, 2021.

Funding Information

To be eligible for consideration for a Home Studentship (covering tuition fees and maintenance stipend of approx. £21,805 per annum), a candidate must satisfy all the eligibility criteria based on nationality, residency and academic qualifications. To be classed as a Home student, candidates must meet the DfE/EPSRC residency requirements and the following criteria: • Be a UK National, or • Have settled status, or • Have pre-settled status, or • Have indefinite leave to remain or enter the UK. Irish nationals also qualify for Home student funding. Previous PhD study MAY make candidates ineligible to be considered for funding. Please note that other terms and conditions also apply. For further information about the residency and nationality requirements please see: DFE:https://www.economy-ni.gov.uk/sites/default/files/publications/economy/postgraduate-studentships-terms-conditions.pdf EPSRC: https://www.ukri.org/publications/terms-and-conditions-for-training-funding/ Please note that any available PhD studentships will be allocated on a competitive basis across a number of projects currently being advertised by the School. International Candidates: A small number of international awards will be available for allocation across the School. An international award is not guaranteed to be available for this project, and these awards will be highly competitive. International candidates are permitted to apply for a maximum of TWO projects across the entire school. Applications for more than two projects may be rejected due to a lack of relevance in research interests. Applicants must also upload complete documentation for their Bachelor’s degree and, where applicable, their Master’s degree. Failure to provide the required academic documentation may result in the application being marked as withdrawn. Academic Requirements: The minimum academic requirement for admission is normally an Upper Second Class Honours degree from a UK or ROI Higher Education provider in a relevant discipline, or an equivalent qualification acceptable to the University. Applicants should have a degree in Computer Science, Electrical/Electronic Engineering, Robotics or Mechatronics, Mechanical Engineering, Mathematics, Physics or a closely related discipline. A relevant Master’s degree is desirable but not essential. Essential: strong programming skills in Python; a good grounding in machine learning and its mathematical foundations (linear algebra, probability, optimisation); practical experience with a deep-learning framework such as PyTorch or JAX. Desirable (training will be provided): experience in one or more of robotics or robot control (e.g., ROS), computer vision, imitation or reinforcement learning, physics simulation (e.g., MuJoCo, Isaac Sim or Genesis), event cameras or tactile sensing, and C++. The project involves hands-on experiments with robot hardware and short research visits to the University of Bristol.

Dr Guanxiong Sun

g.sun@qub.ac.uk

Research Profile

Full-time: 3 or 3.5 years

Computer Science overview

The School of Electronics, Electrical Engineering and Computer Science (EEECS) aims to enhance the way we use technology in communication, data science, computing systems, cyber security, power electronics, intelligent control, and many related areas. You’ll be part of a dynamic doctoral research environment and will study alongside students from over 40 countries world-wide. We supervise students undertaking research in key areas of computer science, including: - Artificial Intelligence - Cybersecurity - Computing Systems - Power Electronics - Robotics - Sensor-based Systems - Wireless Communications Within the School we have a number of specialist research centres. As part of a lively community of over 100 full-time and part-time research students you’ll have the opportunity to develop your research potential in a vibrant research community that prioritises the cross-fertilisation of ideas and innovation in the advancement of knowledge. Many PhD studentships attract scholarships and top-up supplements. PhD programmes provide our students with the opportunity to acquire an extensive training in research techniques.

Research students are encouraged to play a full and active role in relation to the wide range of research activities undertaken within the School and there are many resources available including:

  • Queen’s researchers have strong links with the local industry, which boasts a rich mix of local startups and multi-nationals. Belfast is the second fastest growing region in the UK in terms of Knowledge Economy activity (Northern Ireland Economy Report, 2018).
  • CSIT brings together research specialists in complementary fields such as data security, network security systems, wireless-enabled security systems, intelligent surveillance systems; and serves as the national point of reference for knowledge transfer in these areas.
  • The state-of-the-art £14m Computer Science Building and the Institute of Electronics, Communications and Information Technology offer bespoke research environments. The Institute of Electronics, Communications and Information Technology (ECIT), with state-of-the-art technology, offers a bespoke research environment.
  • You will be working under the supervision of leading international academic experts.
  • A wide range of personal development and specialist training courses offered through the Personal Development Programme
  • Access to the Queen's University Postgraduate Researcher Development Programme
  • Office accommodation with access to computing facilities and support to attend conferences for full-time PhD students

Course content

Associated Research Research within the School is organised into research themes combining strengths by working together on major projects, in many cases in collaboration with key technology companies. ECIT brings together internationally recognised research groups specialising in key areas of advanced digital and communications technology.

PhD Opportunities PhD Opportunities are available in a wide range of computer science subjects, aligned to the specific expertise of our PhD supervisors.

Research Impact Queen’s is a leader in commercial impact and one of the five highest performing universities in the UK for intellectual property commercialisation. We have created over 80 spin-out companies. Three of these - Kainos, Andor Technology and Fusion Antibodies - have been publicly listed on the London Stock Exchange.

Research Projects Queen’s has strong collaborative links with industry in Northern Ireland, and internationally. It has a strong funding track record with EPSRC and the EC H2020 programme.

Research Success The research profile produced by the 2014 UK Research Excellence Framework (REF) graded 80 per cent of our research activity as 'world-leading' or 'internationally excellent', confirming the School's reputation as an internationally-leading department.

Introduction For further information on career opportunities at PhD level please contact the Faculty of Engineering and Physical Sciences Student Recruitment Team on askEPS@qub.ac.uk. Our advisors - in consultation with the School - will be happy to provide further information on your research area, possible career prospects and your research application.

Full time PhD students will have access to a shared office space and access to a desk with personal computer and internet access.

  • Assessment processes for the Research Degree differ from taught degrees. Students will be expected to present write up their work at regular intervals to their supervisor who will provide written and oral feedback; a formal assessment process takes place annually. This Annual Progress Review requires students to present their work in writing and orally to a panel of academics from within the School. Successful completion of this process will allow students to register for the next academic year. The final assessment of the doctoral degree is both oral and written. Students will submit their thesis to an internal and external examining team who will review the written thesis before inviting the student to orally defend their work at a Viva Voce.
  • Supervisors will offer feedback on the research work at regular intervals throughout the period of registration on the degree.

Entrance requirements

Graduate The minimum academic requirement for admission to a research degree programme is normally an Upper Second Class Honours degree from a UK or ROI HE provider, or an equivalent qualification acceptable to the University. Further information can be obtained by contacting the School.

For information on international qualification equivalents, please check the specific information for your country .

Evidence of an IELTS score of 6.0, with not less than 5.5 in any component or equivalent qualification acceptable to the University is required (taken within the last 2 years).

International students wishing to apply to Queen's University Belfast (and for whom English is not their first language), must be able to demonstrate their proficiency in English in order to benefit fully from their course of study or research. Non-EEA nationals must also satisfy UK Visas and Immigration (UKVI) immigration requirements for English language for visa purposes.

For more information on English Language requirements for EEA and non-EEA nationals see: www.qub.ac.uk/EnglishLanguageReqs .

If you need to improve your English language skills before you enter this degree programme, INTO Queen's University Belfast offers a range of English language courses. These intensive and flexible courses are designed to improve your English ability for admission to this degree.

Tuition Fees

Northern Ireland (NI) 1 | TBC

Republic of Ireland (ROI) 2 | TBC

England, Scotland or Wales (GB) 1 | TBC

EU Other 3 | £28,900

International | £28,900

1 EU citizens in the EU Settlement Scheme, with settled or pre-settled status, are expected to be charged the NI or GB tuition fee based on where they are ordinarily resident, however this is provisional and subject to the publication of the Northern Ireland Assembly Student Fees Regulations. Students who are ROI nationals resident in GB are expected to be charged the GB fee, however this is provisional and subject to the publication of the Northern Ireland Assembly student fees Regulations.

2 It is expected that EU students who are ROI nationals resident in ROI will be eligible for NI tuition fees. The tuition fee set out above is provisional and subject to the publication of the Northern Ireland Assembly student fees Regulations.

3 EU Other students (excludes Republic of Ireland nationals living in GB, NI or ROI) are charged tuition fees in line with international fees.

All tuition fees quoted relate to a single year of study unless stated otherwise. All fees will be subject to an annual inflationary increase, unless explicitly stated otherwise.

More information on postgraduate tuition fees .

Computer Science costs

There are no specific additional course costs associated with this programme.

Additional course costs

Depending on the programme of study, there may also be other extra costs which are not covered by tuition fees, which students will need to consider when planning their studies . Students can borrow books and access online learning resources from any Queen's library. If students wish to purchase recommended texts, rather than borrow them from the University Library, prices per text can range from £30 to £100. Students should also budget between £30 to £100 per year for photocopying, memory sticks and printing charges. Students may wish to consider purchasing an electronic device; costs will vary depending on the specification of the model chosen. There are also additional charges for graduation ceremonies, and library fines. In undertaking a research project students may incur costs associated with transport and/or materials, and there will also be additional costs for printing and binding the thesis. There may also be individually tailored research project expenses and students should consult directly with the School for further information.

Some research programmes incur an additional annual charge on top of the tuition fees, often referred to as a bench fee. Bench fees are charged when a programme (or a specific project) incurs extra costs such as those involved with specialist laboratory or field work. If you are required to pay bench fees they will be detailed on your offer letter. If you have any questions about Bench Fees these should be raised with your School at the application stage. Please note that, if you are being funded you will need to ensure your sponsor is aware of and has agreed to fund these additional costs before accepting your place.

How do I fund my study?

Find PhD opportunities and funded studentships by subject area.

We offer numerous opportunities for funded doctoral study in a world-class research environment. Our centres and partnerships, aim to seek out and nurture outstanding postgraduate research students, and provide targeted training and skills development.

The Government offers doctoral loans of up to £26,445 for PhDs and equivalent postgraduate research programmes for English- or Welsh-resident UK and EU students.

Information on Postgraduate Research scholarships for international students .

The Funding & Scholarship Finder helps prospective and current students find funding to help cover costs towards a whole range of study related expenses.

How to Apply

Apply using our online Postgraduate Applications Portal and follow the step-by-step instructions on how to apply .

If you're interested in a particular project, we suggest you contact the relevant academic before you apply, to introduce yourself and ask questions.

To find a potential supervisor aligned with your area of interest, or if you are unsure of who to contact, look through the staff profiles linked here .

You might be asked to provide a short outline of your proposal to help us identify potential supervisors.

Download Postgraduate Prospectus

Research areas

Artificial IntelligenceArtificial intelligenceComputer VisionRobotics

Related PhD opportunities

PhD Artificial Intelligence

Queen's University Belfast

Queen's University Belfast

This project is available in CDT Fort- https://www.fort-cdt.ac.uk/. More information on the details of this programme is below.

Location
Belfast, United Kingdom
Deadline
See university guidance
Funding
CSC-PHD | Courses | Queen's University Belfast