About this Hub

• As a group, we need to improve our knowledge of the fast-growing field of deep learning and its application.
• As an educator, we include a (growing) list of tutorials and resources to educate students in our undergraduate/graduate programs, to help new members in my lab with basic tutorials, and to help current members understand advanced topics better.
• We hope this website helps people who share similar research interests or those interested in learning advanced topics about deep learning.
• Please feel free to email me (zwqin@sfsu.edu), if you have comments, questions, or recommendations.

Online Courses

Basic

• Machine Learning @ Coursera by Prof. Andrew Ng
• Python (and programming) @ Coursera by Prof. Jennifer Campbell and Prof. Paul Gries
• Machine Learning with Python @ freeCodeCamp
• Deep Learning @ Stanford by Prof. Andrew Ng
  • C1 Neural Networks and Deep Learning @ Coursera
  • C2 Improving Deep Neural Networks @ Coursera
  • C3 Structuring Machine Learning Projects @ Coursera
  • C4 Convolutional Neural Networks @ Coursera
  • C5 Sequence Models @ Coursera

Advanced

• Neural Networks for Machine Learning by Prof. Geoffrey Hinton
• Deep Learning for Computer Vision @ Stanford by Prof. Fei-Fei Li
• Tiny Machine Learning @ Harvard by Prof. Vijay Janapa Reddi
• Hardware for Machine Learning @ UC, Berkeley by Prof. Sophia Shao
• Machine Learning Completion @CMU, Prof. Tianqi Chen [Summer 2022]
• [book] Deep Learning by Ian Goodfellow, Yoshua Bengio and Aaron Courville

Softwares

Framework

• [General Idea] Deep Learning Frameworks: Computation Graphs
• Pytorch Vs Tensorflow
• Pytorch, Mobile
• Tensorflow, Lite, Microcontrollers, Playground
• TVM: An Automated End-to-End Optimizing Compiler for Deep Learning, Github
• TensorRT, Github
• Nvidia NGC

library

• Nvidia Deep Learning Examples Github (Pyotch/Tensorflow Models)
• Facebook Detectron2

Development Platform

• Android Development for Beginners @ freeCodeCamp
• Edge Impulse
• Docker

Hardwares

• Nvidia Jetson, Nano
• Sony Spresense

Resources

• Browse State-of-the-Art
• Machine Learning Roadmap, Github, Video
• A Free Machine Learning University
• TinyML
• Awesome Pruning
• Neural-Networks-on-Silicon
• Awesome Incremental Learning

Readings

Applications

• Understanding SSD MultiBox — Real-Time Object Detection In Deep Learning
• SSD object detection: Single Shot MultiBox Detector for real-time processing
• Review: SSD — Single Shot Detector (Object Detection)
• YOLO Algorithm by Andrew Ng

Algorithms

• The Evolution of Mobile CNN Architectures
• A Basic Introduction to Separable Convolutions

Awesome Pruning

Awesome Model Quantization

Awesome Incremental Learning / Lifelong learning

Awesome AutoML and Lightweight Models

ENGR 859 On-device Machine Learning

Graduate-Level Course SP’23

ENGR 844 Embedded Systems 

Graduate-Level Course FL’20

ENGR 456 Computer Systems

Undergraduate-Level Course SP’21, FL’21, SP’22, FL’22

ENGR213 Introduction to C programing for Engineers

Undergraduate-Level Course FL’ 20, SP’21, FL’21, SP’22, FL’22, SP’23