Fullstack computer vision engineer specializing in deploying models on edge devices for real-time inference.
Explore my webpage »
Projects · Blogs · LinkedIn · X · About
|
|
Accelerate inference speed for PyTorch image models using ONNX Runtime and TensorRT optimizations. Achieve up to 123x speedup over the original PyTorch model on CPU. 📅 September 30, 2024 |
|
|
PyTorch at the Edge: Deploying Over 964 TIMM Models on Android with TorchScript and Flutter. Deploy PyTorch models on Android using TIMM, Fastai, TorchScript, and Flutter. Select a model from TIMM's 900+ models, train with Fastai, export to TorchScript, and create an Android app with Flutter for inference. 📅 February 7, 2023 |
|
|
Supercharging YOLOv5: How I Got 182.4 FPS Inference Without a GPU. Optimize YOLOv5 model for CPU inference using Neural Magic's SparseML and DeepSparse. Train on custom data, apply sparsification techniques like pruning and quantization, and achieve up to 180+ FPS on a CPU with only 4 cores. 📅 June 7, 2022 |
|
|
Faster than GPU: How to 10x your Object Detection Model and Deploy on CPU at 50+ FPS. Optimize a YOLOX object detection model deploy on a CPU. Train with custom data, convert to ONNX and OpenVINO IR formats, and apply post-training quantization. This results in a 10x speed improvement, making real-time inference possible on CPU, even outperforming GPU performance. 📅 April 30, 2022 |
|
|
I Made It to GitHub Trending - My Open Source Journey I was listed in GitHub's trending developers list for my open-source work on x.infer, a framework agnostic computer vision inference library. Thank you for supporting my work! 📅 October 28, 2024 |
|
|
Celebrating a Milestone in the Top 2% of Global Scientists Honored to be recognized among the top 2% of global scientists by Stanford University in 2023. Reflecting on my 10-year journey from academia to industry in AI/ML. 📅 November 17, 2023 |
|
Framework agnostic computer vision inference. Run inference on any 1000+ models with 3 lines of code.
|
|
Evaluate your multimodal retrieval pipeline with any model.
|
|
Multimodal Search and Retrieval from PostgreSQL database using Python.
|
|
Vector/Hybrid Search & Retrieval on PostgreSQL database your favorite Vision Language Model.
|
| Deep Learning |
|
| Hyperparameter Optimization |
|
| Experiment Management |
|
| Model Deployment |
|
| Hardware |
|
| Software Engineering |
|
| Data |
|
| Frontend |
|
|
|
|
|---|---|
|
|
|
|
|
|
Creating free machine learning contents doesn't pay my bills. Support me in creating more free contents like these. Consider buying me a coffee. Your support means a lot to me.