In this video, we will take a deep dive into the fundamentals of metrics in A/B Testing. By the end of the video, you will have a solid understanding of the common types of metrics and tips for applying them in real-world A/B testing applications. Some ideas are inspired by the book Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing. I'm sure this video will be extremely helpful for both interview preparation and day-to-day work as a DS.
Blog post by Rob and me:
https://towardsdatascience.com/the-ultimate-guide-to-cracking-business-case-interviews-for-data-scientists-part-1-cb768c37edf4
Part 1 of the tutorial:
https://www.youtube.com/watch?v=VpTlNRUcIDo
Part 2 of the tutorial:
https://www.youtube.com/watch?v=VuKIN9S8Ivs
🟢Get all my free data science interview resources
https://www.emmading.com/resources
🟡 Product Case Interview Cheatsheet https://www.emmading.com/product-case-cheat-sheet
🟠Statistics Interview Cheatsheet https://www.emmading.com/statistics-interview-cheat-sheet
🟣 Behavioral Interview Cheatsheet https://www.emmading.com/behavioral-interview-cheat-sheet
Data Science Resume Checklist https://www.emmading.com/data-science-resume-checklist
We work with Experienced Data Scientists to help them land their next dream jobs. Apply now: https://www.emmading.com/coaching
// Comment
Got any questions? Something to add?
Write a comment below to chat.
// Let's connect on LinkedIn:
https://www.linkedin.com/in/emmading001/
====================
Contents of this video:
====================:
0:00 Intro
1:13 Goal Metric
3:13 Driver Metric
4:42 Guardrail Metric
6:14 Application of Metrics
8:17 Metrics for experiments