Bonus Assignment 8. Stochastic gradient descent for classification and regression


You can purchase a Bonus Assignments pack with the best non-demo versions of assignments. Select the “Bonus Assignments” tier.

Details of the deal is still in self-paced mode but we offer you Bonus Assignments with solutions for a contribution of $17/month. The idea is that you pay for ~1-5 months while studying the course materials, but a single contribution is still fine and opens your access to the bonus pack.

Note: the first payment is charged at the moment of joining the Tier Patreon, and the next payment is charged on the 1st day of the next month, thus it's better to purchase the pack in the 1st half of the month. is never supposed to go fully monetized (it's created in the wonderful open community and will remain open and free) but it'd help to cover some operational costs, and Yury also put in quite some effort into assembling all the best assignments into one pack. Please note that unlike the rest of the course content, Bonus Assignments are copyrighted. Informally, Yury's fine if you share the pack with 2-3 friends but public sharing of the Bonus Assignments pack is prohibited.

This assignment is an extended version of the demo assignment where SDG regressor is implemented. Also, we go deeper into the math behind this wonderful optimization algorithm. Here is one of the questions:

Finally, we implement both an SGD regressor and an SGD classifier from scratch and validate both with real-world datasets.