Book: Evaluating Machine Learning Models

Data science today is a lot like the Wild West: there’s endless opportunity and excitement, but also a lot of chaos and confusion. If you’re new to data science and applied machine learning, evaluating a machine-learning model can seem pretty overwhelming. Now you have help. With this O’Reilly report, machine-learning expert Alice Zheng takes you through the model evaluation basics.

In this overview, Zheng first introduces the machine-learning workflow, and then dives into evaluation metrics and model selection. The latter half of the report focuses on hyperparameter tuning and A/B testing, which may benefit more seasoned machine-learning practitioners.

With this report, you will:

  • Learn the stages involved when developing a machine-learning model for use in a software application
  • Understand the metrics used for supervised learning models, including classification, regression, and ranking
  • Walk through evaluation mechanisms, such as hold?out validation, cross-validation, and bootstrapping
  • Explore hyperparameter tuning in detail, and discover why it’s so difficult
  • Learn the pitfalls of A/B testing, and examine a promising alternative: multi-armed bandits
  • Get suggestions for further reading, as well as useful software packages

Get the Free Ebook, here.

More information here

Posted by Emmanuelle Rieuf on March 10, 2017 at 8:00am

 

Facebooktwittergoogle_plusredditpinterestlinkedintumblrmail

Strata & Hadoop World Business Summit

Make data work for business.

Tailored for executives, business leaders, and strategists, Strata Business Summit is the missing MBA for data-driven business.

From banking to biotech, retail to government, entertainment to energy—every sector is changing in the face of abundant data. And fundamentally, data should serve the strategic imperatives of the business.

At Strata Business Summit, learn how some of the world’s leading companies build modern data strategies. You’ll discover game-changing technologies and their business applications—and how to move your enterprise forward to bridge the gap. You’ll also receive a hand-picked lineup of executive briefings on key issues such as: predictive analytics and machine learning, Cloud strategy, governance security and privacy, IoT, and artificial intelligence, and more.

In just 3 days, you’ll have the intel you need to build strategies and data-driven business models that deliver customer insight, drive efficiency and innovation in products & services, modernize architecture, reduce costs, and lower risk.

Link to Strata & Hadoop World Business Summit

 

Facebooktwittergoogle_plusredditpinterestlinkedintumblrmail