Skip to content
View MihirKohli's full-sized avatar
πŸ–₯️
Developing
πŸ–₯️
Developing
  • Vadodara, Gujarat
  • 03:37 (UTC +05:30)

Block or report MihirKohli

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
MihirKohli/README.md

Hey πŸ‘‹, I'm Mihir Kohli

LinkedIn GitHub Email

Backend Engineer | AI Infrastructure | Distributed Systems


🎯 What I Do

I break things, experiment, rewrite, and push engineering boundaries.

Backend engineer who owns AI infrastructure end-to-end. I build systems that scale, systems that stay up, and systems where the engineering decisions actually matter. No handoffs, no ticketsβ€”if there's a problem, I fix it.

Currently at Remotus, building the entire AI backend alone: APIs, LLM pipelines, vector search, async infrastructure, you name it.


πŸš€ Recent Work

lama-cypher: Document-to-Dashboard Intelligence Pipeline

Multi-CSV ingestion β†’ GraphQL schema β†’ LLM-powered analytics

  • Ingested unstructured data (CSV, PDF, sheets) and mapped to queryable GraphQL schema
  • Built RAG pipeline achieving 98% query accuracy on structured data
  • Auto-generated dashboards with custom insights and complex calculations
  • Solved the hard part: normalizing messy real-world data so LLMs can reason over it

Tech: FastAPI, PostgreSQL, Qdrant, LangChain, GraphQL, AWS SageMaker

ChatStack: Custom WebSocket Library for Parallel LLM Streaming

Because off-the-shelf solutions couldn't keep up

  • Dropped response times from 5s β†’ 2s through parallel streaming
  • Built on async WebSocket architecture, handling high concurrency
  • Real-time token streaming for better UX

Tech: FastAPI, WebSockets, async Python, event-driven architecture

Nifty Options Chain Analyzer (Personal Project)

Live trading signal generation using Fyers API

  • Real-time options chain processing every 60 seconds
  • Computed OI signals, PCR, IV skew, max pain, gamma blast detection
  • Dashboard + React-based strike picker for options trading decisions
  • Built because existing tools didn't give me the signal I needed

Tech: FastAPI, Fyers API, Redis, React, real-time data pipelines

Collaborative Backend at Scale

Handling 10,000+ concurrent users on a single web-space

  • Architected CRDT-based design using YJS for race condition elimination
  • Solved data sync issues in high-concurrency environments
  • Maintained 99.9% uptime under production load

Tech: WebSockets, CRDT, async Python, connection pooling

ML Training Pipeline on AWS SageMaker

  • Automated model training and hosting workflow
  • 30% cost reduction through intelligent resource management
  • End-to-end pipeline from data ingestion to deployment

Tech: AWS SageMaker, Python, MLflow, Unsloth

Vector Search Optimization

  • Scaled Qdrant to 8M vectors maintaining 90%+ retrieval accuracy
  • 50% reduction in storage footprint
  • 30% faster semantic search through index tuning and chunking strategy

Tech: Qdrant, embedding optimization, hybrid search strategies


πŸ’‘ Key Skills

Languages: Python, JavaScript, Java, C++, Bash

Backend: FastAPI, Django, Node.js, async I/O, microservices

Databases: PostgreSQL, MongoDB, Neo4j, Qdrant, Redis, ClickHouse

AI/ML: LLMs (OpenAI, Anthropic, open-source), RAG, prompt engineering, function-calling, LangChain, vector databases, model serving

Infrastructure: AWS (EC2, SageMaker, S3), Docker, Kubernetes, CI/CD, Terraform

Distributed Systems: Event-driven architecture, async queues (BullMQ, Celery), WebSocket streaming, load balancing, connection pooling

Tools & Practices: Git, GitHub, system design, SOLID principles, API design (REST, GraphQL), observability, monitoring


πŸ“š What I'm Learning

  • Agentic AI architectures β€” multi-step orchestration, tool use, state management
  • LLMOps & evals β€” building evaluation frameworks for production LLM systems
  • Advanced prompt engineering β€” reasoning, chain-of-thought, structured outputs
  • Production AI systems β€” reliability, observability, cost optimization at scale

πŸ”¨ Recent Tech Deep Dives

  • Built a hierarchical agent workflow where parent tasks split into specialized sub-agents that further decompose work based on input
  • Solved infinite context memory management in LLM pipelines (one of the hard problems nobody talks about)
  • Optimized LLM API costs by 40% through intelligent caching, prompt compression, and request deduplication
  • Designed event-driven streaming architectures with Kafka and Redis Streams for real-time inference

🌱 Open Source Contributions

Actively contributing to projects that solve real problems:

  • Cheshire Cat β€” Refactored backend endpoints, improved architecture
  • db-agent β€” LLM integration and hallucination reduction (8+ PRs)
  • db-pilot β€” LLM integration and model serving improvements
  • GitHub Issue Metrics β€” Documentation refactoring
  • PyVista β€” Fixed execution path issues
  • SkriptLang β€” Updated build scripts and core infrastructure
  • AcadVault β€” Backend improvements

πŸŽ“ Education

Master's in Information Technology
Dhirubhai Ambani Institute of Information and Communication Technology (DAIICT)
CPI: 8.0/10.0 (Jul 2022 - Jun 2024)

Bachelor's in Computer Application
The Maharaja Sayajirao University of Baroda
CPI: 8.53/10.0 (Jul 2019 - May 2022)


🧠 How I Think About Problems

  • Systems, not features β€” Architecture decisions matter more than code velocity
  • Ownership mindset β€” I debug at 2am because the problem exists, not because someone asked
  • Production first β€” Code that doesn't run in production isn't code
  • Measure before optimizing β€” I use metrics, logs, and profiling to find real bottlenecks
  • Trade-offs over perfection β€” Fast and working beats slow and perfect
  • Learn from others' code β€” Open source contributions teach faster than writing solo

πŸ“Š What Success Looks Like to Me

βœ… Systems I build stay up without constant babysitting
βœ… Architecture decisions that compound in value over months
βœ… Teammates saying "this code is easy to understand"
βœ… Finding the bottleneck in 30 minutes instead of 3 hours
βœ… Building something that didn't exist before


πŸ’Ό Currently Looking For

Backend Engineer | AI Infrastructure | LLM Integration roles at:

  • Well-funded startups building AI systems (not just wrapping APIs)
  • Product companies solving real problems at scale
  • Organizations where engineering decisions matter

Ideal setup: Remote, fast-moving team, ownership from day one, hard problems that compound learning


πŸ”— Let's Talk

Have an interesting problem? Building something ambitious? Hit me up.


"I break things, experiment, rewrite, and push boundaries. That's just how I work."

Popular repositories Loading

  1. Mscit Mscit Public

    This collection of exam papers is dedicated to MScIT students.

    14 2

  2. Finance-Administrator Finance-Administrator Public

    Portfolio management system.

    CSS 2 2

  3. ReturnBack ReturnBack Public

    Never lose your undo history when VSCode closes

    TypeScript 1

  4. Ma-Laxmi Ma-Laxmi Public

    Full Stack Ecommerce built using Django.

    JavaScript

  5. MihirKohli MihirKohli Public

  6. AcadVault AcadVault Public

    Forked from Tikam02/AcadVault

    A living open-source repository of academic resources for DA-IICT

    Jupyter Notebook