Thanks for the correction and references. I just followed my “common sense” from lectures and other pieces.
What do you think made AlexNet stand out? Is it the depth and use of GPUs?
lennart
Karma: 270
Thanks for the feedback, Gunnar. You’re right—it’s more of a recap and introduction. I think the “newest” insight is probably the updates in Section 2.3.
I also would be curious to know in which aspects and questions you’re most interested in.
Thanks!
I’m working with a colleague on the trends of the three components (compute, memory, and interconnect) over time of compute systems and then comparing it to our best estimates for the human brain (or other biological anchors). However, this will still take some time but I hope we will be able to share it in the future (≈ till the end of the year).