Skip to content
View ABHAY1937's full-sized avatar

Block or report ABHAY1937

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ABHAY1937/README.md

Hi, I'm Abhay 👋

AI Engineer — Agentic AI & Enterprise Automation

I build AI systems that hold up outside the notebook: agentic RPA that replaces costly bot licences, MCP tool servers and LLM gateways that let agents act inside real enterprise software, retrieval-driven LLM systems, and computer vision at the edge. I start with the business case (process discovery, scope and ROI), then architect, evaluate and ship.

Portfolio Resume LinkedIn Email Instagram


🛠️ What I'm working on

  • 🏢 AI/ML Engineer @ NGXP Technologies (Kochi): leading AI & automation discovery for a large enterprise. 600+ processes assessed and 100+ process cycles shortlisted for rollout, each with scope and ROI.
  • 🤖 Designing an agentic RPA platform: custom LLM agents on the open-source Cua computer-use framework, cutting the per-bot licensing cost of tools like UiPath.
  • 🔌 Architecting MCP tool servers for ERP/CRM behind an LLM gateway (routing, fallback, cost control) with human-in-the-loop approvals.
  • 📏 Defining AI evals + LangSmith tracing to verify agent accuracy before rollout.

📈 Highlights

3+ yrs building production AI, from edge CV to agentic systems
~80% lower LLM inference cost via 4-bit quantization + RunPod serverless
95% accuracy in deployed real-time vision models
180+ FPS zero-GPU ANPR on CPU (HOG + PaddleOCR)
~58% Acc@0.5 RefCOCO visual grounding on an 8GB GPU (SpatialVLM)

🚀 Featured projects

Project What it is Stack
Hivefloor Local-first desktop office for AI coding agents: real terminals, a boss agent that routes work, shared memory, Docker sandboxing, approval gates TypeScript · Electron · node-pty
SpatialVLM Grounding head on 4-bit Qwen2-VL-7B for pixel-precise object localization Qwen2-VL · PyTorch
VLM-Guided Anomaly Detection Zero-label defect detection: CLIP patches + VLM normality priors guiding PatchCore, MVTec AD benchmark CLIP · PatchCore · OpenVINO
SpatialVLM Auto-Annotator Auto-labels images for detection, segmentation and pose with a VLM, no manual annotation Qwen2-VL · Python
WebRTC Video Calling P2P browser calls + GStreamer pipeline exposing calls as RTSP / YouTube Live for YOLO vision WebRTC · Socket.io · GStreamer
Transcript → Knowledge Graph Whisper transcription → semantic chunking → local-LLM extraction → Neo4j graph Whisper · Ollama · Neo4j
Medical NLP Chatbot Clinical Q&A with hybrid retrieval (SQL + vector RAG) and a local LLM FastAPI · ChromaDB · SQLite

🧰 Tech stack

Agentic AI & LLMOps: MCP Servers · Agentic RPA (Cua) · Computer-Use Agents · LLM Gateway · AI Evals · LangSmith · LangChain · LangGraph · Code Mode · OpenCode

GenAI & LLMs: Claude API · LLaMA · Qwen2-VL · Hugging Face · Ollama · vLLM · RAG · 4-bit Quantization · NLLB

Computer Vision & Edge: YOLO · OpenCV · DeepStream · OpenVINO · TensorRT · GStreamer · NVIDIA Jetson · Pose Estimation · Knowledge Distillation

Data & Infra: Docker · AWS · RunPod Serverless · FastAPI · Kafka · WebRTC · PostgreSQL · MongoDB · Supabase · FAISS · ChromaDB · Milvus · Qdrant · Neo4j

Python PyTorch TensorFlow Hugging Face LangChain Ollama Anthropic OpenCV NVIDIA Docker AWS FastAPI Kafka PostgreSQL MongoDB Supabase Neo4j WebRTC

📊 GitHub stats



Built for production, not demos.

Pinned Loading

  1. Hivefloor Hivefloor Public

    Local-first desktop office for AI coding agents: real terminals, a boss agent that routes work, shared memory, Docker sandboxing, and human approval for risky actions.

    TypeScript

  2. VLM-Guided-Unsupervised-Anomaly-Detection VLM-Guided-Unsupervised-Anomaly-Detection Public

    Zero-label anomaly detection: CLIP patch embeddings + VLM normality priors guiding PatchCore, benchmarked on MVTec AD, edge-ready via OpenVINO

    Python 1

  3. Webrtc_calling_app Webrtc_calling_app Public

    P2P WebRTC video calling with Socket.io signalling, plus GStreamer RTSP/YouTube Live output for YOLO computer vision

    JavaScript 1

  4. spatialvlm-annotator spatialvlm-annotator Public

    Auto-annotate images for detection, segmentation and pose with Qwen2-VL — no manual labelling

    HTML 1

  5. compliance-agent compliance-agent Public

    Report-drafting agent in a 4-agent AI compliance pipeline: maps validated metrics to regulatory reports with Claude

    HTML

  6. atlas atlas Public

    Enterprise Agentic Automation Platform for Building Intelligent Digital Employees