Skip to content
#

deep-learning-inference

Star

Here are 8 public repositories matching this topic...

Language: All
Filter by language
All 8 Python 2 C 1 C++ 1 Cuda 1 HTML 1 Jupyter Notebook 1

mann-uofg / vision-rt

Star 1

Real-time multi-camera object detection with every stage on the GPU: NVDEC decode, a fused CUDA preprocessing kernel, TensorRT FP16/INT8 from CUDA graphs, batched GPU NMS. 2,264 fps across 32 cameras on one RTX 5070 Ti, with each stage's latency measured.

real-time computer-vision ffmpeg cpp gpu cuda nvidia nms object-detection tensorrt multi-stream video-analytics nvdec inference-optimization deep-learning-inference int8-quantization yolox livestock-monitoring cuda-graphs
  • Updated Oct 18, 2026
  • C++

syedtaha22 / riscv-assembly-cnn

Star 0

This GitHub repository showcases a Convolutional Neural Network (CNN) implemented in RISC-V assembly, leveraging the Vector Extension (RVV). The project focuses on efficient deep learning inference on RISC-V platforms. It aims to demonstrate the feasibility of mapping CNN operations to low-level RISC-V instructions for embedded AI applications.

computer-vision cnn mnist assembly-language risc-v embedded-ai deep-learning-inference vector-extension-rvv
  • Updated Aug 9, 2025
  • C

FlosMume / cpp-cuda-deepvision-rtx-starter

Star 0

CUDA C++ practice project for RTX 4070 SUPER — explore GPU concurrency, pinned memory, and Nsight profiling. Includes SAXPY and 2D blur kernels to train optimization, stream overlap, and timing analysis for NVIDIA Developer Technology Engineering skillset.

cpp gpu cuda nvidia high-performance-computing cuda-kernels gpu-optimization nsight parrallel-computing deep-learning-inference gpu-profiling cuda-streams pinned-memory
  • Updated Nov 18, 2025
  • Cuda

Add this topic to your repo

To associate your repository with the deep-learning-inference topic, visit your repo's landing page and select "manage topics."

Learn more