Hyperparameter Tuning Tips that 99% of Data Scientists Overlook

In this video you will learn about hyperparameter tuning for XGBoost models using optuna. We also will leverage XGBoost 3.0's GPU support for 5-15x speedup (no code changes required) while training the models.

Kaggle notebook here: https://bit.ly/RobMullaXGBoostGPUNotebook

Timeline:
00:00 Intro
01:23 Parameter Tuning Must Knows
03:57 Environment Setup
05:11 Why Hyperparameter Tuning?
06:57 Dataset Prep
08:48 Parameter Search Example
10:49 Tuning with Optuna
14:20 Speed up XGBoost with GPU Acceleration
16:12 Fully GPU Accelerated Pipeline
17:37 Optuna Visualizations