Effective Data Science Infrastructure_Ville Tuulos.pdf

MEAP Edition Manning Early Access Program Effective Data Science Infrastructure How to make data scientists productive Version 7 Copyright 2022 Manning Publications For more information on this and other Manning titles go to manning.com ©Manning Publications Co. To comment go to liveBook ©Manning Publications Co. To comment go to liveBook welcome Thanks for purchasing the MEAP for Effective Data Science Infrastructure. As noted in the introduction of the book, the biggest paradigm shifts in computing happen not when impossible things become possible, but when possible things become easy. Our industry, call it machine learning, artificial intelligence, or data science, is on the cusp of becoming radically more approachable than ever before: More people will be able to build more, smarter applications. This is super exciting! You can make the change happen. This book helps you design and build a radically approachable and productive data science infrastructure for yourself and your colleagues. The chapters distill my experiences in building such systems over the past 20 years. I hope the book manages to convey the main thing I have learned: Infrastructure exists to make people productive, so it makes sense to focus on the user experience. However, as you will learn, providing the best possible user experience requires a bunch of smart technical choices. Earlier, infrastructure of this nature was only achievable to the largest and most technically sophisticated companies, like Netflix, where many of the ideas presented in this book were developed and tested in practice. The advent of cloud computing has changed the picture dramatically: You are standing on the shoulders of giants and you can single-handedly build and operate systems that would have required teams of engineers in the past. This may sound like a daunting task but the book will teach you how. We will walk through the full software stack required by effective data scie