gradient-checking

Here are 8 public repositories matching this topic...

philwhln / deriv8-no-deps

Python Machine Learning Deep Neural Network implementation written from scratch with no dependencies. For fun and learning.

python machine-learning dataset mnist-dataset machinelearning machinelearning-python gradient-checking

Updated Dec 15, 2020
Python

Sherlock-LXL / gift-chooser

Star

A small neural-network-based gift preference prediction project.

machine-learning neural-network numpy cross-validation regression recommendation-system gradient-descent backpropagation multilayer-perceptron gradient-checking

Updated Aug 10, 2026
Python

commit4am / neural-nets-from-scratch

Star

A small neural network library in NumPy alone — hand-derived gradients for dense, conv, pooling and dropout layers, verified against central finite differences.

python deep-learning numpy neural-networks backpropagation from-scratch gradient-checking

Updated Sep 11, 2026
Python

tahasiddiquii / neural-net-from-scratch

Star

A multilayer perceptron from scratch in pure numpy: forward pass, hand-derived backprop, SGD with momentum, trained on a non-linear spiral, with a gradient check proving the math (~1e-8) and an accuracy gate. No DL framework.

python machine-learning deep-learning neural-network numpy sgd mlp backpropagation from-scratch gradient-checking

Updated Jul 1, 2026
Python

tkgo1599-max / lora-efficiency-lab

Star

LoRA implemented from the paper math in NumPy with finite-difference gradient checks. Rank-2 hits 99.7% accuracy training 0.4% of params with 226x less optimizer memory; a paired experiment shows exactly when LoRA cannot work (no domain coverage: 0.66 vs 1.0).

python machine-learning deep-learning numpy transformers lora backpropagation fine-tuning peft gradient-checking llm parameter-efficient-fine-tuning

Updated Jul 31, 2026
Python

MariaAntoniadou / computer-vision-image-classifier

Star

Python implementation of image classification models for CIFAR data, including linear classifiers, softmax stability checks, gradient checking, and a two-layer neural network.

python machine-learning computer-vision deep-learning neural-network image-classification softmax gradient-checking