PyTorchDeep LearningThe “Ghost in the Machine”: Tracking Variable Names and Metadata in PyTorchFebruary 10, 20264 min read#deep-learning#pytorch#machine-learning#python-programming+1Read article
Deep LearningModel EfficiencyLow-Bit Precision Training in PyTorch: Techniques and Code ExamplesAugust 21, 20254 min read#deep-learning#pytorch#quantization#mixed-precision+1Read article
Distributed TrainingDeep LearningThe Practical Guide to Distributed Training using PyTorch — Part 5: Distributing Everything using…July 11, 20259 min read#deep-learning#pytorch#distributed-training#fsdp+1Read article
Distributed TrainingHigh Performance ComputingThe Practical Guide to Distributed Training using PyTorch — Part 4: On Multiple Nodes using SLURMJune 26, 20257 min read#deep-learning#pytorch#distributed-training#slurm+1Read article
Distributed TrainingPyTorchThe Practical Guide to Distributed Training using PyTorch — Part 3: On Multiple Nodes using…June 19, 20257 min read#deep-learning#pytorch#distributed-training#multi-nodeRead article
Distributed TrainingPyTorchThe Practical Guide to Distributed Training using PyTorch — Part 2: On a Single Node using TorchrunJune 9, 20254 min read#deep-learning#pytorch#distributed-training#torchrun+1Read article
Distributed TrainingPyTorchThe Practical Guide to Distributed Training using PyTorch — Part 1: On a Single Node using torch.mulJune 8, 20257 min read#deep-learning#pytorch#distributed-training#gpuRead article
Deep LearningModel EfficiencyUnderstanding and Calculating MACs and FLOPs in PyTorch ModelsMay 20, 20255 min read#deep-learning#pytorch#model-profiling#flops+1Read article
Deep LearningPyTorchThe most PyTorch way to extract output from any intermediate layer in a pre-trained modelApril 8, 20245 min read#deep-learning#pytorch#feature-extraction#torchvisionRead article
Computer VisionDeveloper ToolsInstalling detectron2 in 9 easy stepsAugust 24, 20233 min read#detectron2#docker#wsl2#computer-vision+1Read article
Deep LearningPyTorchHow to get Model Summary in PyTorchAugust 25, 20225 min read#deep-learning#pytorch#model-summary#torchinfoRead article
PyTorchDeveloper ToolsQuick Tips #1: How to obtain environment information using PyTorchJanuary 25, 20221 min read#python#pytorch#cuda#troubleshootingRead article
PyTorchDeveloper ToolsInstalling PyTorch XLA in Google Colab without errors!!September 11, 20212 min read#pytorch#colab#tpu#deep-learningRead article
Explainable AIComputer VisionGradCAM in PyTorchJuly 31, 20213 min read#deep-learning#pytorch#explainable-ai#gradcam+1Read article
Self-Supervised LearningDeep LearningSimCLR in PyTorchJune 30, 20216 min read#deep-learning#pytorch#self-supervised-learning#simclr+1Read article
Deep LearningPyTorchUsing forward_hooks to Extract Intermediate Layer Outputs from a Pre-trained ResNet Model in…January 9, 20216 min read#deep-learning#pytorch#feature-extraction#hooksRead article
Deep LearningPyTorchExtracting Features from an Intermediate Layer of a Pretrained VGG-Net in PyTorchJanuary 7, 20213 min read#deep-learning#pytorch#computer-vision#vgg+1Read article
Deep LearningPyTorchExtracting Features from an Intermediate Layer of a Pretrained ResNet Model in PyTorch (Hard Way)December 20, 20205 min read#deep-learning#pytorch#computer-vision#resnet+1Read article
Deep LearningFrameworksKeras vs PyTorchJuly 24, 20205 min read#deep-learning#pytorch#keras#pythonRead article
Machine LearningFederated LearningUnderstanding Federated Learning: Privacy-Preserving Distributed TrainingOctober 15, 20244 min read#privacy#distributed-systems#pytorch#transformers+1Read article