A Meticulous Guide to Advances in Deep Learning Efficiency over the Years
Alex L. Zhang1 wrote an excellent review2 about deep learning algorithms, hardware, libraries, compilers over the years. His article focuses on how these have evolved and have become more efficient. Take a look at it, pretty good content.