Below is a list of things I’m working on or have worked on (and the places where I did it)!

Now

RL environments, LLM evals, Building an agent product for fintech startup.

X dot com is where you’ll find the most recent updates of what I’m upto in life.

Composio: https://github.com/composiohq/composio

  • Last product I worked on was Rube.
  • Worked on the platform, API and documentation. Rebuilt and re-wrote the entire documentation (twice) while I was there :P
  • Initially I started with trying to improve tools and tool quality for LLMs. Ran evals (BFCL etc) and optimised the automated pipeline to write better tool schemas.

Lossfunk / LogQL Paper

  • Wrote a paper with Vishwanath on fine-tuning LLMs for observability and log query languages.
  • Spoke about it at HasGeek RootConf 2024. Talk here
  • Also did this while I was brushing up on math during Lossfunk — an AI residency out in Bangalore.

Julephttps://github.com/julep-ai/julep

  • Worked on the repo. I once screwed up the git history while cleaning it lol. Actually contributing to a work-in-progress but well-designed architecture was eye-opening.
  • Ran evals on fine-tuned models, Made a dataset, that reached HN front page and helped clean some other datasets. First time getting my hands dirty with local llms, fine-tuning, inference, quantization, etc.
  • got much better at talking to ppl/customers and understanding what to build. social battery +10%!

Nous (Archived): https://github.com/noushq/

  • Built a bookmark search engine in 6 weeks. Got to ~300 ppl in a waitlist, 100 installs, and paying customers! Saw this as an absolute win.
  • Tried (& failed) to hit ramen profitability. I’ve written more about this part of my life on a Substack

IMDEA Research Institute

  • Worked on a research hypothesis trying to test the security of third party domains and the public suffix list which describes the effective top-level domains. Went down the rabbit hole of so many papers, blogs and even old mozilla bug threads!
  • Made an actual, usable ML pipeline for the first time! Did everything from scraping arbitrary domains from the internet concurrently, establishing the ground-truth, and then classifying it.

CloudSEK

  • Really fun security engineering internship where I ran phishing campaigns by chaining two vulnerabilities and gave an internal talk about it.
  • Made a service that used heuristics to identify the services used by websites. Made another service to scan for vulnerable Log4j servers. First time where I was thrown in front of a client and demoed a product (they converted too!)
  • Learnt so much about working in a cohesive team. Could just walk over to ppl and pick up projects for them. Discovered how to be high agency in a startup.

Miscellaneous stuff

  • Replicated a vulnerability in Microsoft’s N-RPC with a CVSS of 10. Write Up
  • Made an IMSI sniffer and saw all the repeating TMSI numbers around me. imsi-catcher! Also gave my first talk in front of people about software defined radio and hacking radio devices that semester. Video
  • Gave a talk about container runtimes and their internals at a systems and security meetup. Video