Saumya Jetley

As an AI Scientist I've designed algorithms for real-time scene understanding during my DPhil at the University of Oxford, broadening out to other domains and modalities with privacy-preserving ML, and optimal transport meets causal reasoning for tackling job market congestion at INRIA-Paris Saclay (France's national research institute).

What draws me to problems is my top-down vision of what needs solving in the world; coupled with a first-principles approach to problem solving. An early researcher at FiveAI, I kickstarted their first project on AI safety, unravelling the adversarial proneness of deep visual models. At Plaksha, I became the 2nd founding faculty in CSAI, leading charge of a future-ready tech programme design. I delivered their 1st courses on computational thinking, and computer vision, wrote the first drafts of digital centres on Water and Agriculture, became the first associate director of the flagship AI program ran in partnership with UC Berkeley, led the first conference on AI for sustainability.

In this next phase, I am intent on bringing my AI expertise, coding skills & the latest in AI prowess to 0-1 frontier tech building beyond mission AdhyaAI. In envisioning the role of AI not as standalone features driving the UI or a conversation piece but as multiple, reasoning AI agents that are able to work cohesively and seamlessly in co-solving a complex task - I am looking to go full-time in my domain of interest - AI & sustainable futures.

Co-solving is key because human-users will be critical, even leading, elements of any futuristic system.

Work

  • 2025: I have been invited to Plaksha as a Visiting faculty. Why? To be the Suez Canal for the oceans of academia and research. :)
    I am looking for a challenging AI Systems/ AI Operations/ AI associate role in a dynamic startup to bring my energetic self to. I am passionate about: BioTech (humans/plants), ClimateTech, HealthTech, and EdTech.

  • 2024-25: At VascAI, I've been the Chief AI Officer. On ground, I have learned that domain understanding and knowledge mapping is step-1 of product building. AI can 'enhance' this process when used smartly. Step-2 is roadmapping. Step 3, algorithm design, building, and deployment. I got a chance to implement and trial (with real clinicians) 2 core AI modules for clinical decision-assistance in cardiovascular care. Now working on coaching agents for symptom tracking and management. CTM: bedrock of systems approach - think data bootstrapping channels & hairy/detailed project documents.

  • 2024: I consulted Vitally Health (U.S.) on omics research for precision heart care. What a ripe area, not simply for the challenges in multi-modal data modelling but for the great potential for global synergies, data collaboration, and first-class systems thinking.

  • 2023-present: I started my independent AI/ML consulting where I work on frontier problems helping tech startups realise that MVP vision they have through my project AdhyaAI; Project advisor @ KaggleX fellowship program 2023 in DS for Africa; mentor @ Manara.

  • 2022-23: Associate Director of Academics for the flagship program Technology Leaders Fellowship.

  • 2021-23: Founding Faculty and Assistant Professor at Plaksha University

  • 2019-21: Postdoctoral research fellow with Michele Sebag at the TAU Team, INRIA-Paris Saclay. I work on causal inference, education recommendation, and optimal flow (on algorithmic side) to relieve congestion in job markets. We work with industrial partners QAPA and dataiku. Another exciting project is on privacy-preserving predictive analysis for French covid data.

  • 2014-19: I completed my PhD in computer vision and machine learning algorithms for AI systems, with a special focus on interpretability and robustness, under Phil Torr at Oxford University.

News

02/25: So stoked to hear that Plaksha is launching a School of AI. Together we'll travel far!
12/24: Freelancing as Chief AI Officer for VascAI. We'll be building AI tools for patient and clinical care flows in Cardiovascular healthcare.
07/24: Started consulting for Vitally.health. Can we better understand the etiology of heart failure using molecular data ? What ontologies can we develop for effective and personalised treatments ? I will use research studies to help guide problem definition, and AI modelling and solutions.
06/23: India today published my article on data skills for ground challenges
02/23: We are getting ready to launch our innovation hubs/ our in-house digital research centres for Clean Water-Food-Energy nexus
08/22: I led a panel discussion @Infinity 2.0 - from agriculture to defense: the data we need
03/22: I will be co-chairing the 1st Conference on AI with a special focus on AI for Sustainability
10/21: I have joined Plaksha University as a founding faculty in CSAI.
10/19: I am joining TAU Team as a postdoc on causal learning and inference. *Book of Why* has opened new doorways!
08/19: I spent this summer visiting ISI, Kolkata and IIT, Kharagpur as an invited guest.
06/19: I gave an invited talk at the Willow team - INRIA-Paris Central.
04/19: I successfully defended my thesis to an examining panel of Prof. Andrew Zisserman and Prof. Tinne Tuytelaars.
03/19: I gave a talk at the TAU team - INRIA-Paris Saclay, details.
02/19: I will be a visiting researcher at FiveAI starting this month.
01/19: I submitted my thesis, wohoo! 'Use and Examination of CNNs for Scene Understanding'.
12/18: I gave a talk at the newly inaugurated Wadhwani Institute, Mumbai. Such energy, great leadership, AI for social good in India, ftw!
10/18: Excited to be giving a talk on my academic journey and work at an event by EF and Researc/hers code.


Older news


Publications

Supported by ERC, US DoD, Five AI, and French national research institute, my work on frontier problems has been published in top-tier CV and ML conferences (NeurIPS, CVPR, ICLR), was selected for the FDL NASA programme 2019, invited to workshops (WiML, DL Edinburgh, Reconfigured Vision), and seminars at institutes such as AI Wadhwani, ISI Kolkata, IIT Kharagpur, INRIA Paris.

[2021]
Extremely Private Supervised Learning, Armand Lacombe, Saumya Jetley, Michele Sebag ICLR 2021 workshop on Synthetic Data Generation Quality, Privacy, Bias; CAp 2021 [pdf] [code] [bibtex]

[2019]
Straight to Shapes++: Real-time Instance Segmentation Made More Accurate, Laurynas Miksys, Saumya Jetley, Michael Sapienza, Stuart Golodetz, Philip H.S. Torr, Arxiv preprint 2019 [pdf] [code] [bibtex]

[2018]
With Friends Like These, Who Needs Adversaries?, Saumya Jetley*, Nicholas A. Lord*, Philip H.S. Torr, Proceedings of the 32nd conference on Neural Information Processing Systems (NIPS) 2018 [pdf] [code] [poster] [bibtex]

Learn to pay attention, Saumya Jetley, Nicholas A. Lord, Namhoon Lee, Philip H.S. Torr, Proceedings of the 6th International conference on learning representations (ICLR) 2018 [pdf] [code] [bibtex]

[2017]
End-to-end Saliency Mapping via Probability Distribution Prediction, Saumya Jetley, Naila Murray, Eleonora Vig, U.S. Patent 9,830,529 with Xerox Corp (now Naver Labs) [details]

Straight to Shapes: Real-time Detection of Encoded Shapes, Saumya Jetley*, Michael Sapienza*, Stuart Golodetz, Philip H.S. Torr, Proceedings of the International conference on Computer Vision and Pattern Recognition (CVPR) 2017 [pdf] [code] [bibtex]

[2016]
End-to-End Saliency Mapping via Probability Distribution Prediction, Saumya Jetley, Naila Murray, Eleonora Vig, Proceedings of the International conference on Computer Vision and Pattern Recognition (CVPR) 2016 [pdf] [code] [bibtex]

[2015]
Prototypical Priors: From Improving Classification to Zero-Shot Learning, Saumya Jetley, Bernardino Romera-Paredes, Sadeep Jayasumana, Philip H.S. Torr, Proceedings of the British Machine Vision Conference (BMVC) 2015 [pdf] [code] [bibtex]

[2014]
3D Activity Recognition Using Motion History and Binary Shape Templates, Saumya Jetley, Fabio Cuzzolin, Workshop proceedings of the Asian Conference on Computer Vision (ACCV) 2014 [pdf] [bibtex]

Multi-script Identification from Printed Words, Saumya Jetley, Kapil Mehrotra, Atish Vaze, Swapnil Belhe, proceedings of the International conference on Image Analysis and Recognition (ICIAR) 2014 [pdf] [bibtex]

[2013]
Automatic flag recognition using texture based color analysis and gradient features , Saumya Jetley, Atish Vaze, Swapnil Belhe, Proceedings of the International conference on Image Information Processing (ICIIP) 2013 [pdf] [bibtex]

Unconstrained handwritten Devanagari character recognition using convolutional neural networks, Kapil Mehrotra, Saumya Jetley, Akash Deshmukh, Swapnil Belhe, Proceedings of the 4th International workshop on Multilingual OCR (MOCR) 2013 [pdf] [bibtex]

[2012]
Hindi handwritten word recognition using HMM and symbol tree, Swapnil Belhe, Chetan Paulzagade, Akash Deshmukh, Saumya Jetley, Kapil Mehrotra, Proceeding of the workshop on Document Analysis and Recognition (DAR) 2012 [pdf] [bibtex]

Two-Stage hybrid binarization around fringe map based text line segmentation for document images, Saumya Jetley, Swapnil Belhe, V.K. Koppula, Atul Negi, Proceedings of the 21st International Conference on Pattern Recognition (ICPR) 2012 [pdf] [bibtex]


Datasets

Long long time ago, I gathered a dataset of 'Country Flags in the Wild'. It contains 12,854 train images and 6,110 test images of the flags of 224 different countries harvested from the world wide web and manually cropped to loosely fit to the inlying flags. More details can be found in this paper. To get access to the dataset, please get in touch with me by email. The demo of our android app using an ML model trained on this dataset can found here.


Talks

08/19: Visiting speaker at ISI, Kolkata and IIT, Kharagpur.
06/19: Invited speaker at Willow team - INRIA-Paris Central.
06/19: Presentation to the IET awards panel. Slides and accompanying video.
03/19: Invited speaker at TAU team - INRIA-Paris Saclay, details.
12/18: Invited talk on robustness properties of classification CNNs at AI Wadhwani Institute, Mumbai. Slides here.
10/18: Invited talk on my research work and academic journey at an event jointly organised by EF and Researc/hers code.
07/17: Invited talk on real-time instance segmentation at the Cambridge office of FiveAI. Slides here, demo here.
06/17: Demo'ed our instance segmentation algorithm at the Reconfigured Vision Workshop in London.
03/17: Invited talk on real-time instance segmentation at the Deep Learning Workshop'17 in Edinburgh. Recording, slides, and demo.


Teaching

I helmed the Technology Leaders Program in Data Science and AI.
- taught the wildly popular course on Computer Vision
- Search methods in AI

I helped co-design the BTech CSAI program at Plaksha University. Taught the first course on,
- Computational Thinking: a project-based foundational course on python programming

I like teaching and have tutored for the following courses at the department of Engineering Science during my PhD:
- Attention in AI (Special exchange programme, Designed and taught the 10-hour course alongside Nick Lord, Michaelmas'18)
- B14 course on Image Analysis (Preparatory course, Trinity'17)
- B14 course on Signal Analysis (Hilary'17)
- B14 course on Image Analysis (Michaelmas'16)
- B16 course on Operating Systems (Hilary'16)

I have also been a laboratory demonstrator for the courses below:
- B14 Lab course on Image Analysis (Hilary'17)
- P5 Matlab software programming course (Michaelmas'16, Hilary'17, Trinity'17)


Reviewer duties


- Technical Program co-chair of 2nd Conference on AI 2023
- Founding Program co-chair of 1st Conference on AI 2022
- I will be on the program committee for IJCAI'21.
- I have served as a reviewer for NeurIPS'18, ECCV'20, NeurIPS'20.
- I served on the program committee of CVPR 2020 Workshop on Adversarial Machine Learning in Computer Vision.
- I co-organised the Frontiers of Computer Vision workshop at the Deep Learning Indaba'18.


Outreach

As a member of several initiatives to encourage STEM education, I have frequently conducted coding sessions and educational talks for school students at science festivals and organised learning events for families and adults in science museums. Over the years, I have enjoyed pursuing scientific ideas for impact design and value discovery for different communities, and continue to do so.

09/18: I presented my work on realtime instance segmentation at the CS dept. open-day to prospective students and their parents.
06/18: I will be the Outreach & Scholarship officer for OxWoCS for the academic year 2018-19.
06/18: I co-organised a coding masterclass for girls aged 9-12 using spheros as part of the InspireHer! series.
05/18: I co-organised a coding workshop for students aged 12-13 at the Hay Science Festival.
06/17: I will be the Industry coordinator and External relations officer with OxWoCS for the academic year 2017-18.
05/17 to 06/17: As a student outreach ambassador for the Department of Engineering Science, University of Oxford, I have engaged with yr. 11-13 students at a host of events including - Lubbock lectures for schools, International Women in Engineering Day and Engineering Open Days. One set of slides especially popular amongst students during my classroom talks can be found here.
06/17: I gave a talk under the theme of 'Mobile Robotics' for the Looking Forward initiative of the Department of Computer Science, University of Oxford to encourage and motivate girls aged 14-15 towards STEM.
02/17 - 05/17: I served as a student volunteer with the Robots exhibition at the Science Museum London, supported by the Royal Academy of Engineering. More details here.


Awards

2019: Winner of the IET Postgraduate research award.
2017: Winner of the Tri-innovate challenge - Oxford university business innovation challenge.
2016: Amongst the top-10 algorithms for breast cancer prognosis challenge (lookout for Team HERcules).
2015: Best internship presentation award at Xerox Research Centre Europe, Grenoble (now Naver Labs).
2015: Honorary Mention for Originality for the Technical Essay entry at the International Computer Vision Summer School'15.
2014-15: Recipient of the Sir Richard Stapley academic scholarship.
2012: Best Performer– 2012 & Best Team – 2012 awardee at CDAC-Pune for outstanding research work.
2010: Winner of tech innovation award at Society for Computer Science Technology and Research's tech symposium
2006: All India Rank 102 in 5th National Cyber Olympiad of the Science Olympiad Foundation.