Category Archives: Mathematics

A Surprising Pitfall of Human Judgement and How to Correct It

Introduction Algorithms based on machine learning, deep learning, and AI are in the news these days. Evaluating the quality of these algorithms is usually done using human judgment. For example, if an algorithm claims to detect whether an image contains a pet, the claim can be checked by selecting a sample of images, using human
Continue Reading »

Significance Testing for Ratio Metrics in Experiments

  Written by the Experimentation Analytics Team (with Experimentation Platform Product Team) What’s new? We recently improved the ASP (Average Selling Price) metric calculation on our experimentation platform. As of Oct 31, 2016, we are reporting the ASP shift between test and control for all experiments. However, one question may come to your mind — how do
Continue Reading »