Abhinav Bhatele

Associate Professor, Department of Computer Science and UMIACS
Affiliate Faculty Member, AIM (AI Institute at Maryland) and AMSC Program
Director, Parallel Software and Systems Group (PSSG)
University of Maryland, College Park

Brendan Iribe Center for Computer Science and Engineering
8125 Paint Branch Drive, College Park, MD 20742
E-mail:

IRB 5218
(301) 405-4507

Self-driven, motivated undergraduate/graduate students (studying computer science) interested in conducting research in my group should drop me an e-mail and mention some topics on the PSSG research page that might interest them.

Students enrolled in the UMD science academy or professional masters of engineering programs: Do NOT e-mail me about GA/RA/TA/Grader positions. I do not have the bandwith to take on students whose major is not Computer Science.

Recent Publications

Loki: Low-Rank Keys for Efficient Sparse Attention
Prajwal Singhania, Siddharth Singh, Shwai He, Soheil Feizi, and Abhinav Bhatele
Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems. December 2024.

Democratizing AI: Open-source scalable LLM training on GPU-based supercomputers
Siddharth Singh, Prajwal Singhania, Aditya Ranjan, John Kirchenbauer, Jonas Geiping, Yuxin Wen, Neel Jain, Abhimanyu Hans, Manli Shu, Aditya Tomar, Tom Goldstein and Abhinav Bhatele
Proceedings of the ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis. November 2024.
ACM Gordon Bell Prize Finalist

Full list >>

Teaching (at UMD)

Systems for Machine Learning (CMSC828G)
    Spring 2026 | Spring 2025
Introduction to Parallel Computing (CMSC416) / Foundations of Parallel Computing (CMSC616)
    Fall 2025 | Fall 2024 | Spring 2024 | Fall 2023 | Fall 2022 | Fall 2021 | Fall 2020
Advanced Scientific Computing I & II (CMSC663, CMSC664)
    Fall 2022 & Spring 2023
High Performance Computing Systems (CMSC714)
    Spring 2021 | Fall 2019

Tutorials

HPC Programming Bootcamp Winter 2020

Work/Education History

2019-2022 Assistant Professor, Department of Computer Science and UMIACS, University of Maryland
2018-2019 Principal Computer Scientist, Center for Applied Scientific Computing, Lawrence Livermore National Laboratory
2012-2018 Senior Computer Scientist, CASC, Lawrence Livermore National Laboratory
2011-2012 Post-doctoral Research Scholar, CASC, Lawrence Livermore National Laboratory
2010-2011 Post-doctoral Research Associate, Department of Computer Science, University of Illinois at Urbana-Champaign
Aug 2010 Ph. D., Computer Science, University of Illinois at Urbana-Champaign
Dec 2007 M. S., Computer Science, University of Illinois at Urbana-Champaign
May 2005 B. Tech., Computer Science and Engineering, Indian Institute of Technology, Kanpur