Projects

Confidence Estimation for Text-to-SQL Generation

B.Tech. Project · IIT Bombay · 2023–2024

I explored methods for estimating the confidence of SQL queries generated by language models. This involved inference-based approaches using similar examples, as well as training a transformer-based error model to identify incorrect parts of generated SQL using relational algebra trees. I also investigated schema perturbations for fine-grained error detection, evaluating the approaches on Spider and BIRD.

Data Curation for BharatGPT

R&D Project · IIT Bombay · 2023–2024

I worked on data curation and processing for BharatGPT’s English foundation model. I developed a preprocessing pipeline for large-scale web datasets, incorporating quality filtering, repetition removal, and MinHash-based deduplication. I also worked on designing the pre-training data mixture and identifying India-specific data sources for continued pre-training.

LPython

Google Summer of Code · 2023

I contributed to LPython, a high-performance typed Python compiler, as part of Google Summer of Code 2023. I implemented sets using linear probing and separate chaining, extended support for nested lists, tuples, and dictionaries, and added several built-in operations.