Training neural networks in TensorFlow 2.0 with 5x less memory
-
Updated
Feb 21, 2022 - Python
#
gpu-memory
Here are 30 public repositories matching this topic...
A Toolkit for Training, Tracking, Saving Models and Syncing Results
-
Updated
Mar 12, 2020 - Python
A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
-
Updated
May 30, 2026 - Python
Demonstration of generating mini-batches in Tensorlfow from GPU memory.
-
Updated
Apr 20, 2017 - Python
A prefix-cache advisor for LLM serving infrastructure that recommends KV-cache capacity and eviction policies from your request traces/logs.
-
Updated
Aug 7, 2026 - Python
Dynamic GPU Layer Swapping: Train large models on consumer GPUs with intelligent memory management
-
Updated
Sep 12, 2025 - Python
Phase-manifold registration of 4D-CT: full-resolution (1 mm) deformable registration of 144 million voxels in ~2.4-3.3 GB of GPU memory, with an executable verification suite.
pytorch medical-imaging gpu-memory reproducibility respiratory-motion deformable-image-registration 4d-ct
-
Updated
Sep 25, 2026 - Python
Detailed VRAM profiler for transformer inference with per-layer breakdown, activation analysis, and a predictive memory model that predicts VRAM with <1.2% error. Shows that FFN layers dominate static memory and that measured runtime VRAM exceeds KV-cache estimates by 2-4x.
benchmarking capacity-planning transformers pytorch gpu-memory profiling memory-analysis vram kv-cache llm-inference
-
Updated
Jul 14, 2026 - Python
Event-driven benchmark of adaptive batch composition policies for LLM serving, measuring how prefill and decode interference affects TTFT, TPOT, and throughput under different memory pressure regimes.
python performance-engineering benchmark simulation latency scheduler inference batching systems decode gpu-memory throughput serving prefill event-driven-simulation kv-cache llm continuous-batching
-
Updated
Jul 24, 2026 - Python
Gradient checkpointing and VRAM auto-tuning for spiking neural network training. O(sqrt(T)) activation memory with bit-identical gradients.
python deep-learning pytorch gpu-memory spiking-neural-networks neuromorphic memory-optimization gradient-checkpointing bptt snntorch
-
Updated
Aug 27, 2026 - Python
A CLI tool for estimating GPU VRAM requirements for Hugging Face models, supporting various data types, parallelization strategies, and fine-tuning scenarios like LoRA.
gpu-memory vram huggingface pipeline-parallelism memory-estimation huggingface-models hugging-face-transformers huggingface-datasets vram-monitoring vram-calculator vram-memory-estimation
-
Updated
Oct 22, 2025 - Python
High-throughput Paged KV-Cache LLM inference engine & GPU memory management runtime in PyTorch
pytorch gpu-memory systems-engineering kv-cache vllm llm-inference paged-attention deep-learning-runtime
-
Updated
Oct 1, 2026 - Python
CLI toolkit for LLM inference preflight, vLLM serving configuration, benchmarking, telemetry, and capacity analysis.
-
Updated
Sep 5, 2026 - Python
Deadline-aware KV-cache scheduling for protecting decode-critical request-state under long-context LLM inference pressure.
inference gpu-memory memory-management nvme hbm kv-cache memory-tiering cxl llm long-context vllm pagedattention ai-infrastructure systems-research
-
Updated
Jun 19, 2026 - Python
Research harness for evaluating query-time bounded elimination of reconstructable KV-cache witnesses in long-context transformer inference workloads. Related provisional filing: IN 202641062451.
transformer gpu-memory memory-systems kv-cache cxl long-context llm-inference transformer-memory ai-infrastructure flashattention transformer-optimization systems-research long-context-inference attention-optimization
-
Updated
May 18, 2026 - Python
Preflight checks and collision prevention for local AI inference workloads
launchd ai gpu developer-tools gpu-memory process-management mlx port-management apple-silicon local-ai ollama
-
Updated
Sep 27, 2026 - Python
Calibrated simulation benchmark for real-time LLM request routing, comparing complexity signals, output-length awareness, cost savings, and quality-risk trade-offs.
performance-engineering benchmark simulation latency routing inference cost-model systems gpu-memory request-routing perplexity kv-cache llm long-context llm-serving machine-learning-infrastructure model-routing draft-model
-
Updated
Jul 25, 2026 - Python
Research prototype for short-horizon working-set residency in Mixture-of-Experts inference
-
Updated
Jul 22, 2026 - Python
Tiered GPU memory architecture for consumer AI inference. VRAM as execution cache, system RAM as passive staging layer.
inference pytorch transformer gpu-memory memory-management offloading vram llm local-ai consumer-gpu vram-optimization
-
Updated
Jun 11, 2026 - Python
📊 A command line monitoring tool (graph) for NVIDIA GPUs
-
Updated
Apr 22, 2020 - Python
Add this topic to your repo
To associate your repository with the gpu-memory topic, visit your repo's landing page and select "manage topics."