About

I’m a Principal Research Scientist at Fujitsu Research of Europe. My work sits at the intersection of AI security and cybersecurity—from computer vision in the early years to today’s language‑centric and distributed AI systems. I design evaluation methods, open datasets, and practical defenses for LLM/LMM safety, agentic RAG systems, and adversarial robustness. Recent projects include inference‑time safety for LLMs, disparity auditing via single‑token probes (TFDP), and secure orchestration for tool‑using agents. I care about results that hold up under scrutiny: measured improvements, reproducible benchmarks, and deployments that make systems safer in practice. Selected work appears at EMNLP 2025 and ACL 2025, with prior contributions at BMVC, ECCV, and ACML, alongside a granted US patent (12183118) and open datasets for red‑teaming and disparity evaluation.

10+
Patents Filed
13+
Publications
6
Years Research
40K+
Safety Benchmarks

Academic Excellence & Leadership

🥇

University Gold Medal

Highest Grade in University
Bachelor of Technology, Agricultural Engineering
Vasantrao Naik Marathwada Krishi Vidyapeeth (2013-2017)

🥈

Institute Silver Medal

Highest Grade in Postgraduate Batch
Master of Technology, Industrial Engineering & Operations Research
Indian Institute of Technology Bombay (2017-2019)

🏸

Badminton Nationals

Played at National West Zone and Inter-Zonal Championships, demonstrating sustained excellence in competitive athletics at senior level (2015-16)

🏆

Athletic Achievement Awards

🥇 Gold Medal: Kho-Kho Championship (Udghosh-2017, IIT Kanpur)
🥈 Silver Medals (2×): Badminton Inter-Collegiate Championships (2015-17)

The discipline and strategic thinking developed through competitive athletics have been instrumental in my research methodology—fostering systematic problem-solving, rigorous performance evaluation, and effective collaborative research in machine learning and AI safety.

Research Focus

Trustworthy Multimodal Agentic Systems

I build and evaluate agentic systems that reason over text, code, and images—with an emphasis on reliability, safety, and red‑teaming. This includes benchmark design, safety instrumentation, and failure analysis for complex reasoning pipelines.

Decentralized & Collaborative AI

I focus on orchestrated-decentralized frameworks for peer-to-peer LLM federation, enabling collaborative learning and knowledge exchange without raw data sharing—bridging the gap between privacy and performance in distributed systems.

Large Language/Multimodal Model Security

I work on verification and assessment methods for LLMs/LMMs—guardrails, inference‑time safety, and privacy‑aware training in distributed settings—grounded in measured risk and reproducible evaluation.

AI‑Centric Cybersecurity

I bridge conventional security with AI‑specific attack surfaces across pipelines: orchestrator red teaming, retrieval poisoning defenses, and secure toolchains with useful telemetry for operations.

Adversarial Robustness and Metric Learning

Earlier work focused on adversarial robustness in metric learning, with impact on production image retrieval systems. I continue to use those lessons when stress‑testing modern multimodal pipelines.

Algorithmic Disparity Assessment

I study disparities in LLM behavior, including TFDP’s single‑token masked probing and multi‑scale alignment, to quantify differences precisely and efficiently.

Computer Vision Security

Work on biometric systems and physical‑world attacks/defenses laid the groundwork for my approach to robustness and safety in current multimodal systems.

Training Data Attribution

I study attribution and provenance in generative models to help answer practical questions about data influence and copyright in diffusion‑based systems.

Recent Highlights

2026
AAAI 2026 Acceptance: P2P LLM Federation
Paper titled "Learning to Collaborate: An Orchestrated-Decentralized Framework for Peer-to-Peer LLM Federation" accepted at AAAI 2026. Introduces KNEXA-FL for privacy-preserving, decentralized AI collaboration.
2025
TFDP accepted at EMNLP 2025
Single‑token masked evaluation for autoregressive LLMs (TFDP) with multi‑scale alignment—precise disparity audits with far fewer tokens.
2025
Agentic RAG red‑teaming dataset released
36K adversarial scenarios for RAG systems: retrieval poisoning (text/image), direct queries, and orchestrator attacks. CC BY 4.0.
2025
PDD‑Extended Bench open sourced
Minimally contrastive proverb pairs with single‑token masks for TFDP disparity audits (climate misinformation and gender equality).
2025
ACL 2025 Acceptance: LLM Safety Enhancement
Research on lightweight inference-time safety mechanisms for language models accepted at the Annual Meeting of the Association for Computational Linguistics, addressing fundamental challenges in real-time LLM safety enhancement.
2024
Patent Grant: US12183118
Received patent grant for simultaneous adversarial attacks on multiple face recognition system components, establishing foundational intellectual property in AI security methodologies (September 30, 2024).
2024
BMVC 2024 Acceptance: Oral Presentation
Delivered oral presentation on multimodal robustness framework achieving state-of-the-art performance in image search applications at the British Machine Vision Conference (acceptance rate <3%).
2024
ECCV 2024 Acceptance: Generative Model Attribution
Contributed to research on training data attribution for generative diffusion models accepted at the European Conference on Computer Vision, addressing copyright protection in AI-generated content.
2024
ACML 2024 Acceptance: Adversarial Robustness
Presented theoretical advances in deep metric learning robustness with demonstrated improvements of +2.95% Recall@1 and 2.12× robustness enhancement at the Asian Conference on Machine Learning.
2024
ACM ICSE Workshop Acceptance: LLM Vulnerability Analysis
Published comprehensive analysis of existing LLM vulnerability scanning frameworks at the ACM International Conference on Software Engineering workshop on Responsible AI in Engineering.

Selected Publications

Learning to Collaborate: An Orchestrated-Decentralized Framework for Peer-to-Peer LLM Federation
I Singh*, E Vissol-Gaudin, A Otung, M Sekiya
AAAI 2026 - AAAI Conference on Artificial Intelligence
TFDP: Token-Efficient Disparity Audits for Autoregressive LLMs via Single-Token Masked Evaluation
I Singh*, R Srinivasan, R Vainshtein, H Kojima
EMNLP 2025 - Conference on Empirical Methods in Natural Language Processing
DIESEL: A Lightweight Inference-Time Safety Enhancement for Language Models
B Ganon, A Zolfi, O Hofman, I Singh, H Kojima, Y Elovici, A Shabtai
ACL 2025 - Annual Meeting of the Association for Computational Linguistics
ATLANTIS: A Framework for Automated Targeted Language-guided Augmentation Training for Robust Image Search Oral
I Singh*, R Vainshtein, A Zolfi, A Shabtai, J Brokman, O Hofman, K Fumiyoshi, T Kentarou, H Kojima
BMVC 2024 - British Machine Vision Conference
MONTRAGE: Monitoring Training for Attribution of Generative Diffusion Models
J Brokman, O Hofman, R Vainshtein, A Giloni, T Shimizu, I Singh, O Rachmil, A Zolfi, A Shabtai, Y Unno, H Kojima
ECCV 2024 - European Conference on Computer Vision
Advancing Deep Metric Learning With Adversarial Robustness Long Talk
I Singh*, K Kakizaki, T Araki
ACML 2024 - Asian Conference on Machine Learning
Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysis
J Brokman, O Hofman, O Rachmil, I Singh, PRS Aishvariya, V Pahuja, A Giloni, R Vainshtein, H Kojima
ACM ICSE 2024 - Workshop on Responsible AI in Engineering
Simultaneous Adversarial Attacks On Multiple Face Recognition System Components
I Singh*, K Kakizaki, T Araki
arXiv preprint | Patent: US12183118 (Granted)
Powerful Physical Adversarial Examples Against Practical Face Recognition Systems
I Singh*, T Araki, K Kakizaki
WACV 2022 - IEEE/CVF Winter Conference on Applications of Computer Vision
Evaluating the Cybersecurity Risk of Real-world, Machine Learning Production Systems
R Bitton*, N Maman*, I Singh*, S Momiyama, Y Elovici, A Shabtai
ACM Computing Surveys 2023
On Brightness Agnostic Adversarial Examples Against Face Recognition Systems
I Singh*, S Momiyama, K Kakizaki, T Araki
BIOSIG 2021 - International Conference of the Biometrics Special Interest Group

Open Datasets & Benchmarks

Agentic RAG Red Teaming Dataset Dataset
I Singh*, V Pahuja, A P R Sabapathy
Fujitsu Research 2025 — 36K adversarial scenarios for agentic RAG safety evaluation (Hugging Face)
PDD-Extended Bench (Proverbs Disparity Dataset) Dataset
I Singh*, R Srinivasan, R Vainshtein, H Kojima
EMNLP 2025 supporting benchmark — single-token masked contrastive probes for TFDP disparity audits (Hugging Face)
Complete Publication List on Google Scholar →

Collaboration

I enjoy working on grounded problems in AI security—LLM/LMM safety, agentic systems, and applied cybersecurity. If you have a project that needs careful evaluation, targeted red‑teaming, or practical defenses, feel free to reach out.

Key Research Areas for Collaboration

  • Large Language/Multimodal Model Safety and Security
  • Trustworthy Multimodal Agentic Systems
  • Adversarial Robustness in Deep Learning
  • Automated Red-teaming and Safety Benchmarking
  • AI System Disparity Assessment and Mitigation