Courses
Books
Blog
My Courses / Log In
Contact
Help
Cart

A/B Test Gotchas

Back to: Machine Learning, Data Science, and Generative AI with Python

Previous Lesson

Determining How Long to Run an Experiment

You must enroll in this course to access course content.

Deep Learning Pre-Requisites

You must enroll in this course to access course content.

Leave a Reply Cancel reply

You must be logged in to post a comment.

Lessons

Getting Started
- Introduction
- Installation: Getting Started
- [Activity] WINDOWS: Installing and Using Anaconda & Course Materials
- [Activity] MAC: Installing and Using Anaconda & Course Materials
- [Activity] LINUX: Installing and Using Anaconda & Course Materials
- Python Basics, Part 1 [Optional]
- [Activity] Python Basics, Part 2 [Optional]
- [Activity] Python Basics, Part 3 [Optional]
- [Activity] Python Basics, Part 4 [Optional]
- Introducing the Pandas Library [Optional]
Statistics and Probability Refresher, and Python Practice
- Types of Data
- Mean, Median, Mode
- [Activity] Using mean, median, and mode in Python
- [Activity] Variation and Standard Deviation
- Probability Density Function; Probability Mass Function
- Common Data Distributions
- [Activity] Percentiles and Moments
- [Activity] A Crash Course in matplotlib
- [Activity] Advanced Visualization with Seaborn
- [Activity] Covariance and Correlation
- [Exercise] Conditional Probability
- Exercise Solution: Conditional Probability
- Bayes’ Theorem
Predictive Models
- [Activity] Linear Regression
- [Activity] Polynomial Regression
- [Activity] Multiple Regression, and Predicting Car Prices
- Multi-Level Models
Machine Learning with Python
- Supervised vs. Unsupervised Learning, and Train/Test
- [Activity] Using Train/Test to Prevent Overfitting
- Bayesian Methods: Concepts
- [Activity] Implementing a Spam Classifier with Naive Bayes
- K-Means Clustering
- [Activity] Clustering People Based on Income and Age
- Measuring Entropy
- [Activity] WINDOWS: Installing GraphViz
- [Activity] MAC: Installing GraphViz
- [Activity] LINUX: Installing GraphViz
- Decision Trees: Concepts
- [Activity] Decision Trees: Predicting Hiring Decisions
- Ensemble Learning
- [Activity] XGBoost
- Support Vector Machines (SVM) Overview
- [Activity] Using SVM to Cluster People using scikit-learn
Recommender Systems
- User-Based Collaborative Filtering
- Item-Based Collaborative Filtering
- [Activity] Finding Movie Similarities
- [Activity] Improving the Results of Movie Similarities
- [Activity] Making Movie Recommendations to People
- [Exercise] Improve the Recommender’s Results
More Data Mining and Machine Learning Techniques
- K-Nearest-Neighbors: Concepts
- [Activity] Using KNN to Predict a Rating for a Movie
- Dimensionality Reduction; Principal Component Analysis (PCA)
- [Activity] PCA Example with the Iris Data Set
- Data Warehousing Overview: ETL and ELT
- Reinforcement Learning
- [Activity] Reinforcement Learning and Q-Learning with Gym
- Understanding a Confusion Matrix
- Measuring Classifiers (Precision, Recall, F1, AUC, ROC)
Dealing with Real-World Data
- Bias / Variance Tradeoff
- [Activity] K-Fold Cross-Validation
- Data Cleaning and Normalization
- [Activity] Cleaning Web Log Data
- Normalizing Numerical Data
- [Activity] Detecting Outliers
- Feature Engineering and the Curse of Dimensionality
- Imputation Techniques for Missing Data
- Handling Unbalanced Data: Oversampling, Undersampling, and SMOTE
- Binning, Transforming, Encoding, Scaling, and Shuffling
Apache Spark: Machine Learning on Big Data
- Warning about Java 21+!
- [Activity] Installing Spark
- Spark Introduction
- Spark and the Resilient Distributed Dataset
- Introducing MLLib
- Introduction to Decision Trees in Spark
- [Activity] K-Means Clustering in Spark
- TF / IDF
- [Activity] Searching Wikipedia with Spark
- [Activity] Using the Spark 2.x DataFrame API for MLLib
Experimental Design / ML in the Real World
- Deploying Models to Real-Time Systems
- A/B Testing Concepts
- T-Tests and P-Values
- [Activity] Hands-on With T-Tests
- Determining How Long to Run an Experiment
- A/B Test Gotchas
Deep Learning and Neural Networks
- Deep Learning Pre-Requisites
- The History of Artificial Neural Networks
- [Activity] Deep Learning in the Tensorflow Playground
- Deep Learning Details
- Introducing Tensorflow
- [Activity] Using Tensorflow, Part 1
- [Activity] Using Tensorflow, Part 2
- [Activity] Introducing Keras
- [Activity] Using Keras to Predict Political Affiliations
- Convolutional Neural Networks (CNN’s)
- [Activity] Using CNN’s for Handwriting Recognition
- Recurrent Neural Networks (RNN’s)
- [Activity] Using a RNN for Sentiment Analysis
- [Activity] Transfer Learning
- Tuning Neural Networks: Learning Rate and Batch Size Hyperparameters
- Deep Learning Regularization with Dropout and Early Stopping
- The Ethics of Deep Learning
- Learning More about Deep Learning
Generative Models
- Variational Auto-Encoders (VAE’s)
- VAE’s Hands-On: Fashion MNIST
- Generative Adversarial Networks (GAN’s)
- GAN Demos and Live Training (Painting with AI!)
- GAN Hands-On: Creating Synthetic Images of Clothing
Generative AI: GPT, ChatGPT, Transformers, Self-Attention
- The Transformer Architecture (encoders, decoders, self-attention)
- Self-Attention, Masked-Self Attention, and Multi-Headed Self-Attention
- Applications of Transformers
- How GPT Works, Part 1: The GPT Transformer Architecture
- How GPT Works, Part 2: Tokenization, Positional Encoding, Embedding
- Fine Tuning / Transfer Learning with Transformers
- [Activity] Tokenization with Google CoLab and HuggingFace
- [Activity] Positional Encoding
- [Activity] Masked, Multi-Headed Self-Attention with BERT, BERTViz, and exBERT
- [Activity] Using small and large GPT models with HuggingFace and Google CoLab
- [Activity] Fine Tuning GPT with the IMDb Dataset
- From GPT to ChatGPT: Deep Reinforcement Learning, Proximal Policy Gradients
- From GPT to ChatGPT: Reinforcement Learning from Human Feedback and Moderation
The OpenAI API (Developing with GPT and ChatGPT)
- [Activity] The OpenAI Chat Completions API
- [Activity] Using Functions in the OpenAI Chat Completion API
- [Activity] The Images API in OpenAI (DALL-E)
- [Activity] The Embeddings API in OpenAI: Finding Similarities Between Words
- The Fine-Tuning API for GPT models in OpenAI
- [Demo] Fine-Tuning OpenAI’s Davinci Model to Simulate Data from Star Trek
- Fine-Tuning with the new API to tune GPT for Data from Star Trek
- [Activity] The OpenAI Moderation API
- [Activity] The OpenAI Audio API (speech to text)
Retrieval Augmented Generation (RAG) and LLM Agents
- Retrieval Augmented Generation: How it works, with some examples.
- Demo: Using Retrieval Augmented Generation (RAG) to simulate Data from Star Trek
- RAG Metrics: The RAG Triad, relevancy, recall, precision, accuracy and more
- [Activity] Evaluating our RAG-based Cdr. Data using RAGAS and langchain
- Advanced RAG: Pre-Retrieval; chunking; semantic chunking; data extraction.
- Advanced RAG: Query Rewriting
- Advanced RAG: Prompt Compression, and More Tuning Opportunities
- [Activity] Simulating Cdr. Data with Advanced RAG and langchain
- LLM Agents and Swarms of Agents
- [Activity] Building a Cdr. Data Chatbot with LLM Agents, web search, and math tools.
Final Project
- Your Final Project Assignment
- Final Project Review
You Made It!
- More to Explore
- Continue Your Learning!

#1626 (no title)
Apache Spark with Scala – Course Materials
Apache Spark with Scala – Hands On with Big Data! Getting Started
Autonomous Cars: Deep Learning and Computer Vision in Python (Course Materials)
AWS Certified Data Analytics: Course Materials
AWS Certified Data Engineer – Hands On! Course Materials
AWS Certified Machine Learning – Course Materials
AWS Certified Machine Learning Engineer MLA-C01 Hands On! Course Materials
AWS Lambda Course
Books
Books OLD
Build a Serverless App with AWS Lambda – Hands On! Course Materials
Building Recommender Systems with Machine Learning and AI: Getting Started
Cart
Checkout
Contact Us
Course Catalog
Course Materials: Breaking Into Tech
Course Materials: Data Science and Machine Learning with Python – Hands On!
Course Materials: Deep Learning with Python, Tensorflow, and Keras – Hands On!
Course Materials: Elasticsearch and the Elastic Stack – In Depth and Hands On!
Course Materials: Machine Learning, Data Science, and Deep Learning with Python
Course Materials: The Ultimate Hands-On Hadoop
Dashboard
Data Science Course
Hadoop Ecosystem Course
Hadoop on AWS / EMR
Help
Home
Home v2
MapReduce Course
Mastering AWS Certified AI Practitioner – Hands On! Course Materials
Mastering the System Design Interview: Getting Started
Membership Catalog
My Account
Privacy Policy
Purchase
Share your success story!
Spark on AWS / EMR
Spark Streaming Course
Spark with Python Course
Spark with Scala Course
Student Directory
Taming Big Data with Apache Spark and Python – Getting Started
Taming Big Data with Spark Streaming and Scala – Getting Started
Taming Big Data with Spark Streaming and Scala – Getting Started with IntelliJ IDEA
Terms of Service
The Sundog Blog
Timeline
Under Maintenance

(C) Copyright 2021-2024 Sundog Software LLC. All rights reserved worldwide.

Theme LaunchPad by LifterLMS