Projects
Confidence Estimation for Text-to-SQL Generation
B.Tech. Project · IIT Bombay · 2023–2024
I explored methods for estimating the confidence of SQL queries generated by language models. This involved inference-based approaches using similar examples, as well as training a transformer-based error model to identify incorrect parts of generated SQL using relational algebra trees. I also investigated schema perturbations for fine-grained error detection, evaluating the approaches on Spider and BIRD.
Data Curation for BharatGPT
R&D Project · IIT Bombay · 2023–2024
I worked on data curation and processing for BharatGPT’s English foundation model. I developed a preprocessing pipeline for large-scale web datasets, incorporating quality filtering, repetition removal, and MinHash-based deduplication. I also worked on designing the pre-training data mixture and identifying India-specific data sources for continued pre-training.
LPython
Google Summer of Code · 2023
I contributed to LPython, a high-performance typed Python compiler, as part of Google Summer of Code 2023. I implemented sets using linear probing and separate chaining, extended support for nested lists, tuples, and dictionaries, and added several built-in operations.