Adapting knowledge in machine learning models
Not stated
- Funding
- Competition Funded PhD Project (UK Students Only)
- Application deadline
- Year-round applications
About the project
About the Project This project will develop machine learning algorithms to cheaply and efficiently adapt knowledge in machine learning / AI models. This includes scenarios such as: sequentially updating models with new data without forgetting previous knowledge (continual learning); training a model on data split over many locations such as across hospitals (federated learning); and removing undesired data or concepts from a model (unlearning). The focus will be on developing algorithms that can be applied across all such knowledge adaptation tasks. These algorithms will be designed using probabilistic methods, such as Bayesian-inspired methods to incrementally update models: these provide a sound theoretical framework to unify knowledge adaptation tasks. Overall, the goal of this research is to develop cheaper, more robust, and theoretically-sound algorithms across knowledge adaptation tasks. There will also be opportunities to work at the intersection of knowledge adaptation and (i) AI policy, and/or (ii) human-AI interaction. Essential: degree in Mathematics, Computer Science, or similar; course(s) in machine learning (covering topics including optimisation, Bayesian models eg Bayesian Linear Regression); coding skills (such as Python). Desired: course on probabilistic machine learning or similar (potentially covering topics such as variational inference, Bayesian deep learning, sampling, Gaussian Processes); experience training neural networks or foundation models. Don't be discouraged if you don't feel like you check all of these boxes: note that these skills can be replaced by the willingness and capacity to learn them. Please contact the advisor (Dr Siddharth Swaroop) directly with questions or if interested. Applications from underrepresented groups in computer science are strongly encouraged.