AutoGluon_Baseball_Pitch_Prediction.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "c9mR5Q0NAhOd"
      },
      "source": [
        "# AutoGluon for Sports Analytics: Baseball Pitch Prediction\n",
        "\n",
        "Name: John Hodge\n",
        "\n",
        "Date: 04/19/24"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Riyfxj09C6aa"
      },
      "source": [
        "## Introduction\n",
        "\n",
        "Welcome to our tutorial on leveraging AutoGluon for sports analytics, specifically for the task of predicting baseball pitch types. AutoGluon, a powerful automated machine learning (AutoML) tool, simplifies the process of model building and deployment, making it accessible even to those with limited machine learning expertise. In this tutorial, we will guide you through the steps of installing dependencies, preparing your dataset, defining the prediction task, training the model, and making predictions. This hands-on guide aims to provide you with practical experience in using AutoGluon for real-world sports data, helping you unlock new insights and enhance your analytical capabilities."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9VpQ23WOAhOe"
      },
      "source": [
        "## Install dependencies"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 5,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "XShb2JnuAhOe",
        "outputId": "3b4386e0-356a-45fd-f136-4040084ead2f"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Requirement already satisfied: autogluon in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (1.1.0)\n",
            "Requirement already satisfied: autogluon.core==1.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core[all]==1.1.0->autogluon) (1.1.0)\n",
            "Requirement already satisfied: autogluon.features==1.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon) (1.1.0)\n",
            "Requirement already satisfied: autogluon.tabular==1.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.tabular[all]==1.1.0->autogluon) (1.1.0)\n",
            "Requirement already satisfied: autogluon.multimodal==1.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon) (1.1.0)\n",
            "Requirement already satisfied: autogluon.timeseries==1.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries[all]==1.1.0->autogluon) (1.1.0)\n",
            "Requirement already satisfied: numpy<1.29,>=1.21 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.24.2)\n",
            "Requirement already satisfied: scipy<1.13,>=1.5.4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.9.1)\n",
            "Requirement already satisfied: scikit-learn<1.4.1,>=1.3.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.4.0)\n",
            "Requirement already satisfied: networkx<4,>=3.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (3.2.1)\n",
            "Requirement already satisfied: pandas<2.3.0,>=2.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (2.1.4)\n",
            "Requirement already satisfied: tqdm<5,>=4.38 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (4.65.2)\n",
            "Requirement already satisfied: requests in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (2.28.2)\n",
            "Requirement already satisfied: matplotlib in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (3.8.4)\n",
            "Requirement already satisfied: boto3<2,>=1.10 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.34.88)\n",
            "Requirement already satisfied: autogluon.common==1.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.1.0)\n",
            "Requirement already satisfied: ray<2.11,>=2.10.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (2.10.0)\n",
            "Requirement already satisfied: hyperopt<0.2.8,>=0.2.7 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.core[all]==1.1.0->autogluon) (0.2.7)\n",
            "Requirement already satisfied: Pillow<11,>=10.0.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (10.3.0)\n",
            "Requirement already satisfied: torch<2.2,>=2.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (2.1.2)\n",
            "Requirement already satisfied: lightning<2.2,>=2.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (2.1.4)\n",
            "Requirement already satisfied: transformers<4.39.0,>=4.38.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from transformers[sentencepiece]<4.39.0,>=4.38.0->autogluon.multimodal==1.1.0->autogluon) (4.38.2)\n",
            "Requirement already satisfied: accelerate<0.22.0,>=0.21.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.21.0)\n",
            "Requirement already satisfied: jsonschema<4.22,>=4.18 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (4.21.1)\n",
            "Requirement already satisfied: seqeval<1.3.0,>=1.2.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (1.2.2)\n",
            "Requirement already satisfied: evaluate<0.5.0,>=0.4.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.4.1)\n",
            "Requirement already satisfied: timm<0.10.0,>=0.9.5 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.9.16)\n",
            "Requirement already satisfied: torchvision<0.17.0,>=0.16.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.16.2)\n",
            "Requirement already satisfied: scikit-image<0.21.0,>=0.19.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.20.0)\n",
            "Requirement already satisfied: text-unidecode<1.4,>=1.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (1.3)\n",
            "Requirement already satisfied: torchmetrics<1.3.0,>=1.2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (1.2.1)\n",
            "Requirement already satisfied: nptyping<2.5.0,>=1.4.4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (2.4.1)\n",
            "Requirement already satisfied: omegaconf<2.3.0,>=2.1.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (2.2.3)\n",
            "Requirement already satisfied: pytorch-metric-learning<2.4,>=1.3.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (2.3.0)\n",
            "Requirement already satisfied: nlpaug<1.2.0,>=1.1.10 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (1.1.11)\n",
            "Requirement already satisfied: nltk<4.0.0,>=3.4.5 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (3.8.1)\n",
            "Requirement already satisfied: openmim<0.4.0,>=0.3.7 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.3.9)\n",
            "Requirement already satisfied: defusedxml<0.7.2,>=0.7.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.7.1)\n",
            "Requirement already satisfied: jinja2<3.2,>=3.0.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (3.1.3)\n",
            "Requirement already satisfied: tensorboard<3,>=2.9 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (2.16.2)\n",
            "Requirement already satisfied: pytesseract<0.3.11,>=0.3.9 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (0.3.10)\n",
            "Requirement already satisfied: nvidia-ml-py3==7.352.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (7.352.0)\n",
            "Requirement already satisfied: pdf2image<1.19,>=1.17.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.multimodal==1.1.0->autogluon) (1.17.0)\n",
            "Requirement already satisfied: xgboost<2.1,>=1.6 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.tabular[all]==1.1.0->autogluon) (2.0.3)\n",
            "Requirement already satisfied: fastai<2.8,>=2.3.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.tabular[all]==1.1.0->autogluon) (2.7.14)\n",
            "Requirement already satisfied: lightgbm<4.4,>=3.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.tabular[all]==1.1.0->autogluon) (4.3.0)\n",
            "Requirement already satisfied: catboost<1.2,>=1.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.tabular[all]==1.1.0->autogluon) (1.1.1)\n",
            "Requirement already satisfied: joblib<2,>=1.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (1.4.0)\n",
            "Requirement already satisfied: pytorch-lightning<2.2,>=2.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (2.1.4)\n",
            "Requirement already satisfied: gluonts<0.14.4,>=0.14.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.14.3)\n",
            "Requirement already satisfied: statsforecast<1.5,>=1.4.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (1.4.0)\n",
            "Requirement already satisfied: mlforecast<0.10.1,>=0.10.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.10.0)\n",
            "Requirement already satisfied: utilsforecast<0.0.11,>=0.0.10 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.0.10)\n",
            "Requirement already satisfied: orjson~=3.9 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (3.10.1)\n",
            "Requirement already satisfied: optimum<1.19,>=1.17 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (1.18.1)\n",
            "Requirement already satisfied: psutil<6,>=5.7.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.common==1.1.0->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (5.9.8)\n",
            "Requirement already satisfied: setuptools in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from autogluon.common==1.1.0->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (60.2.0)\n",
            "Requirement already satisfied: packaging>=20.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from accelerate<0.22.0,>=0.21.0->autogluon.multimodal==1.1.0->autogluon) (24.0)\n",
            "Requirement already satisfied: pyyaml in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from accelerate<0.22.0,>=0.21.0->autogluon.multimodal==1.1.0->autogluon) (6.0.1)\n",
            "Requirement already satisfied: botocore<1.35.0,>=1.34.88 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from boto3<2,>=1.10->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.34.88)\n",
            "Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from boto3<2,>=1.10->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (0.10.0)\n",
            "Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from boto3<2,>=1.10->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (0.10.1)\n",
            "Requirement already satisfied: graphviz in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from catboost<1.2,>=1.1->autogluon.tabular[all]==1.1.0->autogluon) (0.20.3)\n",
            "Requirement already satisfied: plotly in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from catboost<1.2,>=1.1->autogluon.tabular[all]==1.1.0->autogluon) (5.21.0)\n",
            "Requirement already satisfied: six in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from catboost<1.2,>=1.1->autogluon.tabular[all]==1.1.0->autogluon) (1.16.0)\n",
            "Requirement already satisfied: datasets>=2.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (2.19.0)\n",
            "Requirement already satisfied: dill in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (0.3.8)\n",
            "Requirement already satisfied: xxhash in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (3.4.1)\n",
            "Requirement already satisfied: multiprocess in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (0.70.16)\n",
            "Requirement already satisfied: fsspec>=2021.05.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from fsspec[http]>=2021.05.0->evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (2024.3.1)\n",
            "Requirement already satisfied: huggingface-hub>=0.7.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (0.22.2)\n",
            "Requirement already satisfied: responses<0.19 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (0.18.0)\n",
            "Requirement already satisfied: pip in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (24.0)\n",
            "Requirement already satisfied: fastdownload<2,>=0.0.5 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (0.0.7)\n",
            "Requirement already satisfied: fastcore<1.6,>=1.5.29 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (1.5.29)\n",
            "Requirement already satisfied: fastprogress>=0.2.4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (1.0.3)\n",
            "Requirement already satisfied: spacy<4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (3.7.4)\n",
            "Requirement already satisfied: pydantic<3,>=1.7 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from gluonts<0.14.4,>=0.14.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (2.7.0)\n",
            "Requirement already satisfied: toolz~=0.10 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from gluonts<0.14.4,>=0.14.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.12.1)\n",
            "Requirement already satisfied: typing-extensions~=4.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from gluonts<0.14.4,>=0.14.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (4.11.0)\n",
            "Requirement already satisfied: future in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from hyperopt<0.2.8,>=0.2.7->autogluon.core[all]==1.1.0->autogluon) (1.0.0)\n",
            "Requirement already satisfied: cloudpickle in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from hyperopt<0.2.8,>=0.2.7->autogluon.core[all]==1.1.0->autogluon) (3.0.0)\n",
            "Requirement already satisfied: py4j in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from hyperopt<0.2.8,>=0.2.7->autogluon.core[all]==1.1.0->autogluon) (0.10.9.7)\n",
            "Requirement already satisfied: MarkupSafe>=2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from jinja2<3.2,>=3.0.3->autogluon.multimodal==1.1.0->autogluon) (2.1.5)\n",
            "Requirement already satisfied: attrs>=22.2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.1.0->autogluon) (23.2.0)\n",
            "Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.1.0->autogluon) (2023.12.1)\n",
            "Requirement already satisfied: referencing>=0.28.4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.1.0->autogluon) (0.34.0)\n",
            "Requirement already satisfied: rpds-py>=0.7.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from jsonschema<4.22,>=4.18->autogluon.multimodal==1.1.0->autogluon) (0.18.0)\n",
            "Requirement already satisfied: lightning-utilities<2.0,>=0.8.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from lightning<2.2,>=2.1->autogluon.multimodal==1.1.0->autogluon) (0.11.2)\n",
            "Requirement already satisfied: numba in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from mlforecast<0.10.1,>=0.10.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.59.1)\n",
            "Requirement already satisfied: window-ops in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from mlforecast<0.10.1,>=0.10.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.0.15)\n",
            "Requirement already satisfied: gdown>=4.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.1.0->autogluon) (5.1.0)\n",
            "Requirement already satisfied: click in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from nltk<4.0.0,>=3.4.5->autogluon.multimodal==1.1.0->autogluon) (8.1.7)\n",
            "Requirement already satisfied: regex>=2021.8.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from nltk<4.0.0,>=3.4.5->autogluon.multimodal==1.1.0->autogluon) (2024.4.16)\n",
            "Requirement already satisfied: antlr4-python3-runtime==4.9.* in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from omegaconf<2.3.0,>=2.1.1->autogluon.multimodal==1.1.0->autogluon) (4.9.3)\n",
            "Requirement already satisfied: colorama in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (0.4.6)\n",
            "Requirement already satisfied: model-index in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (0.1.11)\n",
            "Requirement already satisfied: opendatalab in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (0.0.10)\n",
            "Requirement already satisfied: rich in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (13.4.2)\n",
            "Requirement already satisfied: tabulate in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (0.9.0)\n",
            "Requirement already satisfied: coloredlogs in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from optimum<1.19,>=1.17->optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (15.0.1)\n",
            "Requirement already satisfied: sympy in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from optimum<1.19,>=1.17->optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (1.12)\n",
            "Requirement already satisfied: onnx in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (1.16.0)\n",
            "Requirement already satisfied: onnxruntime>=1.11.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (1.16.3)\n",
            "Requirement already satisfied: protobuf>=3.20.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (4.25.3)\n",
            "Requirement already satisfied: python-dateutil>=2.8.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from pandas<2.3.0,>=2.0.0->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (2.8.2)\n",
            "Requirement already satisfied: pytz>=2020.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from pandas<2.3.0,>=2.0.0->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (2023.3.post1)\n",
            "Requirement already satisfied: tzdata>=2022.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from pandas<2.3.0,>=2.0.0->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (2023.3)\n",
            "Requirement already satisfied: filelock in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray<2.11,>=2.10.0->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (3.13.3)\n",
            "Requirement already satisfied: msgpack<2.0.0,>=1.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray<2.11,>=2.10.0->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (1.0.8)\n",
            "Requirement already satisfied: aiosignal in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray<2.11,>=2.10.0->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (1.3.1)\n",
            "Requirement already satisfied: frozenlist in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray<2.11,>=2.10.0->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (1.4.1)\n",
            "Requirement already satisfied: aiohttp>=3.7 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (3.9.5)\n",
            "Requirement already satisfied: aiohttp-cors in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.7.0)\n",
            "Requirement already satisfied: colorful in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.5.6)\n",
            "Requirement already satisfied: py-spy>=0.2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.3.14)\n",
            "Requirement already satisfied: opencensus in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.11.4)\n",
            "Requirement already satisfied: prometheus-client>=0.7.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.20.0)\n",
            "Requirement already satisfied: smart-open in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (6.4.0)\n",
            "Requirement already satisfied: virtualenv!=20.21.1,>=20.0.24 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (20.25.3)\n",
            "Requirement already satisfied: grpcio>=1.32.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (1.62.2)\n",
            "Requirement already satisfied: tensorboardX>=1.9 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (2.6.2.2)\n",
            "Requirement already satisfied: pyarrow>=6.0.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (15.0.2)\n",
            "Requirement already satisfied: charset-normalizer<4,>=2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from requests->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (3.3.2)\n",
            "Requirement already satisfied: idna<4,>=2.5 in /Users/johnhodge/.local/lib/python3.9/site-packages (from requests->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (2.10)\n",
            "Requirement already satisfied: urllib3<1.27,>=1.21.1 in /Users/johnhodge/.local/lib/python3.9/site-packages (from requests->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.25.11)\n",
            "Requirement already satisfied: certifi>=2017.4.17 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from requests->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (2024.2.2)\n",
            "Requirement already satisfied: imageio>=2.4.1 in /Users/johnhodge/.local/lib/python3.9/site-packages (from scikit-image<0.21.0,>=0.19.1->autogluon.multimodal==1.1.0->autogluon) (2.9.0)\n",
            "Requirement already satisfied: tifffile>=2019.7.26 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from scikit-image<0.21.0,>=0.19.1->autogluon.multimodal==1.1.0->autogluon) (2024.4.18)\n",
            "Requirement already satisfied: PyWavelets>=1.1.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from scikit-image<0.21.0,>=0.19.1->autogluon.multimodal==1.1.0->autogluon) (1.6.0)\n",
            "Requirement already satisfied: lazy_loader>=0.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from scikit-image<0.21.0,>=0.19.1->autogluon.multimodal==1.1.0->autogluon) (0.4)\n",
            "Requirement already satisfied: threadpoolctl>=2.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from scikit-learn<1.4.1,>=1.3.0->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (3.4.0)\n",
            "Requirement already satisfied: statsmodels>=0.13.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from statsforecast<1.5,>=1.4.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.14.2)\n",
            "Requirement already satisfied: absl-py>=0.4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.1.0->autogluon) (2.1.0)\n",
            "Requirement already satisfied: markdown>=2.6.8 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.1.0->autogluon) (3.6)\n",
            "Requirement already satisfied: tensorboard-data-server<0.8.0,>=0.7.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.1.0->autogluon) (0.7.2)\n",
            "Requirement already satisfied: werkzeug>=1.0.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from tensorboard<3,>=2.9->autogluon.multimodal==1.1.0->autogluon) (3.0.2)\n",
            "Requirement already satisfied: safetensors in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from timm<0.10.0,>=0.9.5->autogluon.multimodal==1.1.0->autogluon) (0.4.3)\n",
            "Requirement already satisfied: tokenizers<0.19,>=0.14 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from transformers<4.39.0,>=4.38.0->transformers[sentencepiece]<4.39.0,>=4.38.0->autogluon.multimodal==1.1.0->autogluon) (0.15.2)\n",
            "Requirement already satisfied: sentencepiece!=0.1.92,>=0.1.91 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from transformers[sentencepiece]<4.39.0,>=4.38.0->autogluon.multimodal==1.1.0->autogluon) (0.2.0)\n",
            "Requirement already satisfied: contourpy>=1.0.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from matplotlib->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.2.1)\n",
            "Requirement already satisfied: cycler>=0.10 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from matplotlib->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (0.12.1)\n",
            "Requirement already satisfied: fonttools>=4.22.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from matplotlib->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (4.51.0)\n",
            "Requirement already satisfied: kiwisolver>=1.3.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from matplotlib->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (1.4.5)\n",
            "Requirement already satisfied: pyparsing>=2.3.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from matplotlib->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (3.1.2)\n",
            "Requirement already satisfied: importlib-resources>=3.2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from matplotlib->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (6.4.0)\n",
            "Requirement already satisfied: multidict<7.0,>=4.5 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from aiohttp>=3.7->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (6.0.5)\n",
            "Requirement already satisfied: yarl<2.0,>=1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from aiohttp>=3.7->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (1.9.4)\n",
            "Requirement already satisfied: async-timeout<5.0,>=4.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from aiohttp>=3.7->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (4.0.3)\n",
            "Requirement already satisfied: pyarrow-hotfix in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from datasets>=2.0.0->evaluate<0.5.0,>=0.4.0->autogluon.multimodal==1.1.0->autogluon) (0.6)\n",
            "Requirement already satisfied: beautifulsoup4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from gdown>=4.0.0->nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.1.0->autogluon) (4.12.3)\n",
            "Requirement already satisfied: zipp>=3.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from importlib-resources>=3.2.0->matplotlib->autogluon.core==1.1.0->autogluon.core[all]==1.1.0->autogluon) (3.17.0)\n",
            "Requirement already satisfied: importlib-metadata>=4.4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from markdown>=2.6.8->tensorboard<3,>=2.9->autogluon.multimodal==1.1.0->autogluon) (7.1.0)\n",
            "Requirement already satisfied: llvmlite<0.43,>=0.42.0dev0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from numba->mlforecast<0.10.1,>=0.10.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.42.0)\n",
            "Requirement already satisfied: flatbuffers in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from onnxruntime>=1.11.0->optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (24.3.25)\n",
            "Requirement already satisfied: annotated-types>=0.4.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from pydantic<3,>=1.7->gluonts<0.14.4,>=0.14.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.6.0)\n",
            "Requirement already satisfied: pydantic-core==2.18.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from pydantic<3,>=1.7->gluonts<0.14.4,>=0.14.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (2.18.1)\n",
            "Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.11 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (3.0.12)\n",
            "Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (1.0.5)\n",
            "Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (1.0.10)\n",
            "Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (2.0.8)\n",
            "Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (3.0.9)\n",
            "Requirement already satisfied: thinc<8.3.0,>=8.2.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (8.2.3)\n",
            "Requirement already satisfied: wasabi<1.2.0,>=0.9.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (1.1.2)\n",
            "Requirement already satisfied: srsly<3.0.0,>=2.4.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (2.4.8)\n",
            "Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (2.0.10)\n",
            "Requirement already satisfied: weasel<0.4.0,>=0.1.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (0.3.4)\n",
            "Requirement already satisfied: typer<0.10.0,>=0.3.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (0.9.4)\n",
            "Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (3.3.0)\n",
            "Requirement already satisfied: patsy>=0.5.6 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from statsmodels>=0.13.2->statsforecast<1.5,>=1.4.0->autogluon.timeseries==1.1.0->autogluon.timeseries[all]==1.1.0->autogluon) (0.5.6)\n",
            "Requirement already satisfied: distlib<1,>=0.3.7 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from virtualenv!=20.21.1,>=20.0.24->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.3.8)\n",
            "Requirement already satisfied: platformdirs<5,>=3.9.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from virtualenv!=20.21.1,>=20.0.24->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (4.2.0)\n",
            "Requirement already satisfied: humanfriendly>=9.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from coloredlogs->optimum<1.19,>=1.17->optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (10.0)\n",
            "Requirement already satisfied: ordered-set in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from model-index->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (4.1.0)\n",
            "Requirement already satisfied: opencensus-context>=0.1.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.1.3)\n",
            "Requirement already satisfied: google-api-core<3.0.0,>=1.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (2.18.0)\n",
            "Requirement already satisfied: pycryptodome in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (3.20.0)\n",
            "Requirement already satisfied: openxlab in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (0.0.38)\n",
            "Requirement already satisfied: tenacity>=6.2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from plotly->catboost<1.2,>=1.1->autogluon.tabular[all]==1.1.0->autogluon) (8.2.3)\n",
            "Requirement already satisfied: markdown-it-py>=2.2.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from rich->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (3.0.0)\n",
            "Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from rich->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (2.17.2)\n",
            "Requirement already satisfied: mpmath>=0.19 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from sympy->optimum<1.19,>=1.17->optimum[onnxruntime]<1.19,>=1.17; extra == \"all\"->autogluon.timeseries[all]==1.1.0->autogluon) (1.3.0)\n",
            "Requirement already satisfied: googleapis-common-protos<2.0.dev0,>=1.56.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (1.63.0)\n",
            "Requirement already satisfied: proto-plus<2.0.0dev,>=1.22.3 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (1.23.0)\n",
            "Requirement already satisfied: google-auth<3.0.dev0,>=2.14.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (2.29.0)\n",
            "Requirement already satisfied: mdurl~=0.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from markdown-it-py>=2.2.0->rich->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (0.1.2)\n",
            "Requirement already satisfied: blis<0.8.0,>=0.7.8 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from thinc<8.3.0,>=8.2.2->spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (0.7.11)\n",
            "Requirement already satisfied: confection<1.0.0,>=0.0.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from thinc<8.3.0,>=8.2.2->spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (0.1.4)\n",
            "Requirement already satisfied: cloudpathlib<0.17.0,>=0.7.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from weasel<0.4.0,>=0.1.0->spacy<4->fastai<2.8,>=2.3.1->autogluon.tabular[all]==1.1.0->autogluon) (0.16.0)\n",
            "Requirement already satisfied: soupsieve>1.2 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from beautifulsoup4->gdown>=4.0.0->nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.1.0->autogluon) (2.5)\n",
            "Requirement already satisfied: oss2~=2.17.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from openxlab->opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (2.17.0)\n",
            "Requirement already satisfied: PySocks!=1.5.7,>=1.5.6 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from requests[socks]->gdown>=4.0.0->nlpaug<1.2.0,>=1.1.10->autogluon.multimodal==1.1.0->autogluon) (1.7.1)\n",
            "Requirement already satisfied: cachetools<6.0,>=2.0.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (5.3.3)\n",
            "Requirement already satisfied: pyasn1-modules>=0.2.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.4.0)\n",
            "Requirement already satisfied: rsa<5,>=3.1.4 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (4.9)\n",
            "Requirement already satisfied: crcmod>=1.7 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from oss2~=2.17.0->openxlab->opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (1.7)\n",
            "Requirement already satisfied: aliyun-python-sdk-kms>=2.4.1 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from oss2~=2.17.0->openxlab->opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (2.16.2)\n",
            "Requirement already satisfied: aliyun-python-sdk-core>=2.13.12 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from oss2~=2.17.0->openxlab->opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (2.15.1)\n",
            "Requirement already satisfied: cryptography>=2.6.0 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from aliyun-python-sdk-core>=2.13.12->oss2~=2.17.0->openxlab->opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (42.0.5)\n",
            "Requirement already satisfied: pyasn1<0.7.0,>=0.4.6 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from pyasn1-modules>=0.2.1->google-auth<3.0.dev0,>=2.14.1->google-api-core<3.0.0,>=1.0.0->opencensus->ray[default,tune]<2.11,>=2.10.0; extra == \"all\"->autogluon.core[all]==1.1.0->autogluon) (0.6.0)\n",
            "Requirement already satisfied: cffi>=1.12 in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from cryptography>=2.6.0->aliyun-python-sdk-core>=2.13.12->oss2~=2.17.0->openxlab->opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (1.16.0)\n",
            "Requirement already satisfied: pycparser in /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages (from cffi>=1.12->cryptography>=2.6.0->aliyun-python-sdk-core>=2.13.12->oss2~=2.17.0->openxlab->opendatalab->openmim<0.4.0,>=0.3.7->autogluon.multimodal==1.1.0->autogluon) (2.22)\n"
          ]
        }
      ],
      "source": [
        "!pip install autogluon"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {
        "id": "eTmgc4sVAhOe"
      },
      "outputs": [],
      "source": [
        "import pandas as pd\n",
        "import torch\n",
        "from autogluon.tabular import TabularDataset, TabularPredictor"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "V17q4JsoAhOe"
      },
      "source": [
        "Check to see whether a CUDA-based GPU is available."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 7,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "zMNhbPkPAhOf",
        "outputId": "7b2a961e-442d-4341-cb6d-ff9be8c87f44"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "GPU is not available\n"
          ]
        }
      ],
      "source": [
        "# Check to see whether a GPU is available\n",
        "if torch.cuda.is_available():\n",
        "    gpu_available = True\n",
        "    print(\"GPU is available\")\n",
        "else:\n",
        "    gpu_available = False\n",
        "    print(\"GPU is not available\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "yisA7OsoAhOf"
      },
      "source": [
        "## Load and Prepare Data\n",
        "\n",
        "We'll start by loading data from a CSV file. For this example, assume your CSV has columns for PitchType, Balls, Strikes, and PreviousPitchType. You might need to adjust the column names based on your actual data.\n",
        "\n",
        "Data preparation is a crucial step in any machine learning pipeline. For this tutorial, our data consists of various features related to baseball pitches, such as PitchType, Balls, Strikes, and PreviousPitchType.\n",
        "\n",
        "Effective data preparation enhances model accuracy by ensuring that the input data is suitably formatted and cleaned. This might include handling missing values, encoding categorical variables, and normalizing or scaling numerical features."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 8,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "39DW-8AZAhOf",
        "outputId": "a8d5e505-2d34-4068-cd51-a79ed35bbceb"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "    Balls  Strikes  PitchType PreviousPitchType\n",
            "1       0        1   Changeup          Fastball\n",
            "2       1        1     Slider          Changeup\n",
            "3       0        0   Fastball            Slider\n",
            "4       0        1   Changeup          Fastball\n",
            "5       0        2   Fastball          Changeup\n",
            "6       0        0   Fastball          Fastball\n",
            "7       0        0   Fastball          Fastball\n",
            "8       0        1     Slider          Fastball\n",
            "9       0        2  Curveball            Slider\n",
            "10      1        2  Curveball         Curveball\n"
          ]
        }
      ],
      "source": [
        "data_path = 'data/baseball_pitch_data.csv'\n",
        "\n",
        "# Load the dataset\n",
        "df = pd.read_csv(data_path)\n",
        "\n",
        "# Create a new column 'PreviousPitchType' with the 'PitchType' from the previous row\n",
        "df['PreviousPitchType'] = df['PitchType'].shift(1)\n",
        "\n",
        "# Drop the 'Outcome' column for this analysis\n",
        "df = df.drop('Outcome', axis=1)\n",
        "\n",
        "# Save the updated DataFrame back to CSV if needed\n",
        "# df.to_csv('/path/to/your/updated_baseball_pitch_data.csv', index=False)\n",
        "\n",
        "# Display the updated DataFrame to verify\n",
        "# print(df.head(10))\n",
        "\n",
        "# Truncate the DataFrame to N rows\n",
        "num_truncation_rows = -1 # Number of rows to truncate to (-1 for all rows)\n",
        "df_truncated = df[1:num_truncation_rows]\n",
        "\n",
        "# Load data\n",
        "data = TabularDataset(df_truncated)\n",
        "\n",
        "# Preview data\n",
        "print(data.head(10))\n",
        "\n",
        "# Optionally, drop rows with missing values\n",
        "data = data.dropna(subset=['PitchType', 'Balls', 'Strikes', 'PreviousPitchType'])\n",
        "\n",
        "# Split data into training and testing datasets\n",
        "train_data = data.sample(frac=0.8, random_state=42)  # 80% for training\n",
        "test_data = data.drop(train_data.index)  # Remaining 20% for testing\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Rte8CpqEAhOf"
      },
      "source": [
        "## Define the Prediction Task\n",
        "\n",
        "With AutoGluon, you specify what column you're predicting. In this case, it's PitchType. AutoGluon will automatically handle feature processing. In supervised learning, specifying the target variable correctly is crucial because the model learns to predict this variable based on other input features."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 9,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "n9lDkFldAhOf",
        "outputId": "223a8fbd-9d8c-40ff-d246-3c08e9ae68a9"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Summary statistics of training data:\n",
            "               Balls        Strikes\n",
            "count  302558.000000  302558.000000\n",
            "mean        0.811121       0.874097\n",
            "std         0.942289       0.806010\n",
            "min         0.000000       0.000000\n",
            "25%         0.000000       0.000000\n",
            "50%         1.000000       1.000000\n",
            "75%         1.000000       2.000000\n",
            "max         3.000000       2.000000\n"
          ]
        }
      ],
      "source": [
        "label = 'PitchType'\n",
        "print(\"Summary statistics of training data:\")\n",
        "print(train_data.describe())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "xem6kGT1AhOf"
      },
      "source": [
        "## Train the Model\n",
        "\n",
        "Now, train a model using AutoGluon. This can automatically handle categorical features, missing data, and more, but it’s still pivotal to understand how the training process works and what options you have available. AutoGluon automates many decisions and tasks such as feature selection, model selection, and hyperparameter tuning. It uses ensemble techniques to ensure robust predictions.\n",
        "\n",
        "More information on [AutoGluon presets](https://auto.gluon.ai/stable/tutorials/tabular/tabular-essentials.html#presets)."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 10,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 637
        },
        "id": "GPAnB_7qAhOf",
        "outputId": "10ce6ca7-38f6-4219-be57-84e0f87c94e9"
      },
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "Warning: path already exists! This predictor may overwrite an existing predictor! path=\"autogluon_pitchtype_models\"\n",
            "Presets specified: ['good_quality']\n",
            "Setting dynamic_stacking from 'auto' to True. Reason: Enable dynamic_stacking when use_bag_holdout is disabled. (use_bag_holdout=False)\n",
            "Stack configuration (auto_stack=True): num_stack_levels=1, num_bag_folds=8, num_bag_sets=1\n",
            "Note: `save_bag_folds=False`! This will greatly reduce peak disk usage during fit (by ~8x), but runs the risk of an out-of-memory error during model refit if memory is small relative to the data size.\n",
            "\tYou can avoid this risk by setting `save_bag_folds=True`.\n",
            "Dynamic stacking is enabled (dynamic_stacking=True). AutoGluon will try to determine whether the input data is affected by stacked overfitting and enable or disable stacking as a consequence.\n",
            "Detecting stacked overfitting by sub-fitting AutoGluon on the input data. That is, copies of AutoGluon will be sub-fit on subset(s) of the data. Then, the holdout validation data is used to detect stacked overfitting.\n",
            "Sub-fit(s) time limit is: 3600 seconds.\n",
            "Starting holdout-based sub-fit for dynamic stacking. Context path is: autogluon_pitchtype_models/ds_sub_fit/sub_fit_ho.\n",
            "Running the sub-fit in a ray process to avoid memory leakage.\n",
            "Spend 992 seconds for the sub-fit(s) during dynamic stacking.\n",
            "Time left for full fit of AutoGluon: 2608 seconds.\n",
            "Starting full fit now with num_stack_levels 0.\n",
            "Beginning AutoGluon training ... Time limit = 2608s\n",
            "AutoGluon will save models to \"autogluon_pitchtype_models\"\n",
            "=================== System Info ===================\n",
            "AutoGluon Version:  1.1.0\n",
            "Python Version:     3.9.0\n",
            "Operating System:   Darwin\n",
            "Platform Machine:   x86_64\n",
            "Platform Version:   Darwin Kernel Version 23.2.0: Wed Nov 15 21:54:05 PST 2023; root:xnu-10002.61.3~2/RELEASE_ARM64_T6031\n",
            "CPU Count:          14\n",
            "Memory Avail:       4.63 GB / 36.00 GB (12.9%)\n",
            "Disk Space Avail:   702.53 GB / 926.35 GB (75.8%)\n",
            "===================================================\n",
            "Train Data Rows:    302558\n",
            "Train Data Columns: 3\n",
            "Label Column:       PitchType\n",
            "Problem Type:       multiclass\n",
            "Preprocessing data ...\n",
            "Train Data Class Count: 4\n",
            "Using Feature Generators to preprocess the data ...\n",
            "Fitting AutoMLPipelineFeatureGenerator...\n",
            "\tAvailable Memory:                    4756.28 MB\n",
            "\tTrain Data (Original)  Memory Usage: 23.26 MB (0.5% of available memory)\n",
            "\tInferring data type of each feature based on column values. Set feature_metadata_in to manually specify special dtypes of the features.\n",
            "\tStage 1 Generators:\n",
            "\t\tFitting AsTypeFeatureGenerator...\n",
            "\tStage 2 Generators:\n",
            "\t\tFitting FillNaFeatureGenerator...\n",
            "\tStage 3 Generators:\n",
            "\t\tFitting IdentityFeatureGenerator...\n",
            "\t\tFitting CategoryFeatureGenerator...\n",
            "\t\t\tFitting CategoryMemoryMinimizeFeatureGenerator...\n",
            "\tStage 4 Generators:\n",
            "\t\tFitting DropUniqueFeatureGenerator...\n",
            "\tStage 5 Generators:\n",
            "\t\tFitting DropDuplicatesFeatureGenerator...\n",
            "\tTypes of features in original data (raw dtype, special dtypes):\n",
            "\t\t('int', [])    : 2 | ['Balls', 'Strikes']\n",
            "\t\t('object', []) : 1 | ['PreviousPitchType']\n",
            "\tTypes of features in processed data (raw dtype, special dtypes):\n",
            "\t\t('category', []) : 1 | ['PreviousPitchType']\n",
            "\t\t('int', [])      : 2 | ['Balls', 'Strikes']\n",
            "\t0.3s = Fit runtime\n",
            "\t3 features in original data used to generate 3 features in processed data.\n",
            "\tTrain Data (Processed) Memory Usage: 4.91 MB (0.1% of available memory)\n",
            "Data preprocessing and feature engineering runtime = 0.41s ...\n",
            "AutoGluon will gauge predictive performance using evaluation metric: 'accuracy'\n",
            "\tTo change this, specify the eval_metric parameter of Predictor()\n",
            "User-specified model hyperparameters to be fit:\n",
            "{\n",
            "\t'NN_TORCH': {},\n",
            "\t'GBM': [{'extra_trees': True, 'ag_args': {'name_suffix': 'XT'}}, {}, 'GBMLarge'],\n",
            "\t'CAT': {},\n",
            "\t'XGB': {},\n",
            "\t'FASTAI': {},\n",
            "\t'RF': [{'criterion': 'gini', 'max_depth': 15, 'ag_args': {'name_suffix': 'Gini', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'entropy', 'max_depth': 15, 'ag_args': {'name_suffix': 'Entr', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'squared_error', 'max_depth': 15, 'ag_args': {'name_suffix': 'MSE', 'problem_types': ['regression', 'quantile']}}],\n",
            "\t'XT': [{'criterion': 'gini', 'max_depth': 15, 'ag_args': {'name_suffix': 'Gini', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'entropy', 'max_depth': 15, 'ag_args': {'name_suffix': 'Entr', 'problem_types': ['binary', 'multiclass']}}, {'criterion': 'squared_error', 'max_depth': 15, 'ag_args': {'name_suffix': 'MSE', 'problem_types': ['regression', 'quantile']}}],\n",
            "}\n",
            "Fitting 11 L1 models ...\n",
            "Fitting model: NeuralNetFastAI_BAG_L1 ... Training model for up to 2607.59s of the 2607.59s of remaining time.\n",
            "\tFitting 8 child models (S1F1 - S1F8) | Fitting with ParallelLocalFoldFittingStrategy (8 workers, per: cpus=1, gpus=0, memory=1.74%)\n",
            "\t0.507\t = Validation score   (accuracy)\n",
            "\t99.13s\t = Training   runtime\n",
            "\t1.19s\t = Validation runtime\n",
            "Fitting model: LightGBMXT_BAG_L1 ... Training model for up to 2507.11s of the 2507.11s of remaining time.\n",
            "\tFitting 8 child models (S1F1 - S1F8) | Fitting with ParallelLocalFoldFittingStrategy (8 workers, per: cpus=1, gpus=0, memory=1.08%)\n",
            "\tWarning: Exception caused LightGBMXT_BAG_L1 to fail during training (ImportError)... Skipping this model.\n",
            "\t\t\u001b[36mray::_ray_fit()\u001b[39m (pid=7555, ip=127.0.0.1)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/__init__.py\", line 8, in <module>\n",
            "    from .basic import Booster, Dataset, Sequence, register_logger\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/basic.py\", line 247, in <module>\n",
            "    _LIB = _load_lib()\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/basic.py\", line 232, in _load_lib\n",
            "    lib = ctypes.cdll.LoadLibrary(lib_path[0])\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/ctypes/__init__.py\", line 460, in LoadLibrary\n",
            "    return self._dlltype(name)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/ctypes/__init__.py\", line 382, in __init__\n",
            "    self._handle = _dlopen(self._name, mode)\n",
            "OSError: dlopen(/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so, 0x0006): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib\n",
            "  Referenced from: <C3EB28DD-60B6-3334-AFA2-72BBBF9DBAEF> /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so\n",
            "  Reason: tried: '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/lib/libomp.dylib' (no such file), '/usr/lib/libomp.dylib' (no such file, not in dyld cache)\n",
            "\n",
            "During handling of the above exception, another exception occurred:\n",
            "\n",
            "\u001b[36mray::_ray_fit()\u001b[39m (pid=7555, ip=127.0.0.1)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/core/models/ensemble/fold_fitting_strategy.py\", line 404, in _ray_fit\n",
            "    fold_model.fit(X=X_fold, y=y_fold, X_val=X_val_fold, y_val=y_val_fold, time_limit=time_limit_fold, **resources, **kwargs_fold)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/core/models/abstract/abstract_model.py\", line 855, in fit\n",
            "    out = self._fit(**kwargs)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/tabular/models/lgb/lgb_model.py\", line 98, in _fit\n",
            "    try_import_lightgbm()  # raise helpful error message if LightGBM isn't installed\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/common/utils/try_import.py\", line 86, in try_import_lightgbm\n",
            "    raise ImportError(\"`import lightgbm` failed. If you are using Mac OSX, \" \"Please try 'brew install libomp'. Detailed info: {}\".format(str(e)))\n",
            "ImportError: `import lightgbm` failed. If you are using Mac OSX, Please try 'brew install libomp'. Detailed info: dlopen(/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so, 0x0006): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib\n",
            "  Referenced from: <C3EB28DD-60B6-3334-AFA2-72BBBF9DBAEF> /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so\n",
            "  Reason: tried: '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/lib/libomp.dylib' (no such file), '/usr/lib/libomp.dylib' (no such file, not in dyld cache)\n",
            "Fitting model: LightGBM_BAG_L1 ... Training model for up to 2505.97s of the 2505.96s of remaining time.\n",
            "\tFitting 8 child models (S1F1 - S1F8) | Fitting with ParallelLocalFoldFittingStrategy (8 workers, per: cpus=1, gpus=0, memory=1.07%)\n",
            "\tWarning: Exception caused LightGBM_BAG_L1 to fail during training (ImportError)... Skipping this model.\n",
            "\t\t\u001b[36mray::_ray_fit()\u001b[39m (pid=7569, ip=127.0.0.1)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/__init__.py\", line 8, in <module>\n",
            "    from .basic import Booster, Dataset, Sequence, register_logger\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/basic.py\", line 247, in <module>\n",
            "    _LIB = _load_lib()\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/basic.py\", line 232, in _load_lib\n",
            "    lib = ctypes.cdll.LoadLibrary(lib_path[0])\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/ctypes/__init__.py\", line 460, in LoadLibrary\n",
            "    return self._dlltype(name)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/ctypes/__init__.py\", line 382, in __init__\n",
            "    self._handle = _dlopen(self._name, mode)\n",
            "OSError: dlopen(/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so, 0x0006): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib\n",
            "  Referenced from: <C3EB28DD-60B6-3334-AFA2-72BBBF9DBAEF> /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so\n",
            "  Reason: tried: '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/lib/libomp.dylib' (no such file), '/usr/lib/libomp.dylib' (no such file, not in dyld cache)\n",
            "\n",
            "During handling of the above exception, another exception occurred:\n",
            "\n",
            "\u001b[36mray::_ray_fit()\u001b[39m (pid=7569, ip=127.0.0.1)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/core/models/ensemble/fold_fitting_strategy.py\", line 404, in _ray_fit\n",
            "    fold_model.fit(X=X_fold, y=y_fold, X_val=X_val_fold, y_val=y_val_fold, time_limit=time_limit_fold, **resources, **kwargs_fold)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/core/models/abstract/abstract_model.py\", line 855, in fit\n",
            "    out = self._fit(**kwargs)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/tabular/models/lgb/lgb_model.py\", line 98, in _fit\n",
            "    try_import_lightgbm()  # raise helpful error message if LightGBM isn't installed\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/common/utils/try_import.py\", line 86, in try_import_lightgbm\n",
            "    raise ImportError(\"`import lightgbm` failed. If you are using Mac OSX, \" \"Please try 'brew install libomp'. Detailed info: {}\".format(str(e)))\n",
            "ImportError: `import lightgbm` failed. If you are using Mac OSX, Please try 'brew install libomp'. Detailed info: dlopen(/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so, 0x0006): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib\n",
            "  Referenced from: <C3EB28DD-60B6-3334-AFA2-72BBBF9DBAEF> /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so\n",
            "  Reason: tried: '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/lib/libomp.dylib' (no such file), '/usr/lib/libomp.dylib' (no such file, not in dyld cache)\n",
            "2024-04-19 13:57:30,809\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:30,810\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:30,811\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:30,811\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:30,812\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:30,813\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "Fitting model: RandomForestGini_BAG_L1 ... Training model for up to 2504.89s of the 2504.89s of remaining time.\n",
            "2024-04-19 13:57:30,813\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:36,498\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:36,499\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:36,499\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:36,500\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:36,501\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:36,501\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:57:36,502\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "\t0.5069\t = Validation score   (accuracy)\n",
            "\t1.71s\t = Training   runtime\n",
            "\t4.2s\t = Validation runtime\n",
            "Fitting model: RandomForestEntr_BAG_L1 ... Training model for up to 2498.88s of the 2498.88s of remaining time.\n",
            "\t0.5069\t = Validation score   (accuracy)\n",
            "\t1.58s\t = Training   runtime\n",
            "\t4.19s\t = Validation runtime\n",
            "Fitting model: CatBoost_BAG_L1 ... Training model for up to 2493.04s of the 2493.04s of remaining time.\n",
            "\tFitting 8 child models (S1F1 - S1F8) | Fitting with ParallelLocalFoldFittingStrategy (8 workers, per: cpus=1, gpus=0, memory=1.09%)\n",
            "\t0.5069\t = Validation score   (accuracy)\n",
            "\t7.54s\t = Training   runtime\n",
            "\t0.14s\t = Validation runtime\n",
            "Fitting model: ExtraTreesGini_BAG_L1 ... Training model for up to 2484.55s of the 2484.54s of remaining time.\n",
            "\t0.5069\t = Validation score   (accuracy)\n",
            "\t1.43s\t = Training   runtime\n",
            "\t4.2s\t = Validation runtime\n",
            "Fitting model: ExtraTreesEntr_BAG_L1 ... Training model for up to 2478.85s of the 2478.85s of remaining time.\n",
            "\t0.5069\t = Validation score   (accuracy)\n",
            "\t1.45s\t = Training   runtime\n",
            "\t4.23s\t = Validation runtime\n",
            "Fitting model: XGBoost_BAG_L1 ... Training model for up to 2473.1s of the 2473.1s of remaining time.\n",
            "\tFitting 8 child models (S1F1 - S1F8) | Fitting with ParallelLocalFoldFittingStrategy (8 workers, per: cpus=1, gpus=0, memory=1.37%)\n",
            "\t0.5069\t = Validation score   (accuracy)\n",
            "\t3.47s\t = Training   runtime\n",
            "\t0.16s\t = Validation runtime\n",
            "Fitting model: NeuralNetTorch_BAG_L1 ... Training model for up to 2468.67s of the 2468.67s of remaining time.\n",
            "\tFitting 8 child models (S1F1 - S1F8) | Fitting with ParallelLocalFoldFittingStrategy (8 workers, per: cpus=1, gpus=0, memory=0.97%)\n",
            "\t0.5069\t = Validation score   (accuracy)\n",
            "\t79.61s\t = Training   runtime\n",
            "\t0.99s\t = Validation runtime\n",
            "Fitting model: LightGBMLarge_BAG_L1 ... Training model for up to 2387.96s of the 2387.96s of remaining time.\n",
            "\tFitting 8 child models (S1F1 - S1F8) | Fitting with ParallelLocalFoldFittingStrategy (8 workers, per: cpus=1, gpus=0, memory=1.19%)\n",
            "\tWarning: Exception caused LightGBMLarge_BAG_L1 to fail during training (ImportError)... Skipping this model.\n",
            "\t\t\u001b[36mray::_ray_fit()\u001b[39m (pid=7606, ip=127.0.0.1)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/__init__.py\", line 8, in <module>\n",
            "    from .basic import Booster, Dataset, Sequence, register_logger\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/basic.py\", line 247, in <module>\n",
            "    _LIB = _load_lib()\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/basic.py\", line 232, in _load_lib\n",
            "    lib = ctypes.cdll.LoadLibrary(lib_path[0])\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/ctypes/__init__.py\", line 460, in LoadLibrary\n",
            "    return self._dlltype(name)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/ctypes/__init__.py\", line 382, in __init__\n",
            "    self._handle = _dlopen(self._name, mode)\n",
            "OSError: dlopen(/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so, 0x0006): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib\n",
            "  Referenced from: <C3EB28DD-60B6-3334-AFA2-72BBBF9DBAEF> /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so\n",
            "  Reason: tried: '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/lib/libomp.dylib' (no such file), '/usr/lib/libomp.dylib' (no such file, not in dyld cache)\n",
            "\n",
            "During handling of the above exception, another exception occurred:\n",
            "\n",
            "\u001b[36mray::_ray_fit()\u001b[39m (pid=7606, ip=127.0.0.1)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/core/models/ensemble/fold_fitting_strategy.py\", line 404, in _ray_fit\n",
            "    fold_model.fit(X=X_fold, y=y_fold, X_val=X_val_fold, y_val=y_val_fold, time_limit=time_limit_fold, **resources, **kwargs_fold)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/core/models/abstract/abstract_model.py\", line 855, in fit\n",
            "    out = self._fit(**kwargs)\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/tabular/models/lgb/lgb_model.py\", line 98, in _fit\n",
            "    try_import_lightgbm()  # raise helpful error message if LightGBM isn't installed\n",
            "  File \"/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/autogluon/common/utils/try_import.py\", line 86, in try_import_lightgbm\n",
            "    raise ImportError(\"`import lightgbm` failed. If you are using Mac OSX, \" \"Please try 'brew install libomp'. Detailed info: {}\".format(str(e)))\n",
            "ImportError: `import lightgbm` failed. If you are using Mac OSX, Please try 'brew install libomp'. Detailed info: dlopen(/Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so, 0x0006): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib\n",
            "  Referenced from: <C3EB28DD-60B6-3334-AFA2-72BBBF9DBAEF> /Users/johnhodge/opt/anaconda3/envs/py3_env/lib/python3.9/site-packages/lightgbm/lib/lib_lightgbm.so\n",
            "  Reason: tried: '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/usr/local/lib/libomp.dylib' (no such file), '/usr/lib/libomp.dylib' (no such file, not in dyld cache)\n",
            "Fitting model: WeightedEnsemble_L2 ... Training model for up to 360.0s of the 2386.68s of remaining time.\n",
            "\tEnsemble Weights: {'NeuralNetFastAI_BAG_L1': 1.0}\n",
            "\t0.507\t = Validation score   (accuracy)\n",
            "\t2.57s\t = Training   runtime\n",
            "\t0.01s\t = Validation runtime\n",
            "AutoGluon training complete, total runtime = 223.93s ... Best model: \"WeightedEnsemble_L2\"\n",
            "Automatically performing refit_full as a post-fit operation (due to `.fit(..., refit_full=True)`\n",
            "Refitting models via `predictor.refit_full` using all of the data (combined train and validation)...\n",
            "\tModels trained in this way will have the suffix \"_FULL\" and have NaN validation score.\n",
            "\tThis process is not bound by time_limit, but should take less time than the original `predictor.fit` call.\n",
            "\tTo learn more, refer to the `.refit_full` method docstring which explains how \"_FULL\" models differ from normal models.\n",
            "Fitting 1 L1 models ...\n",
            "Fitting model: NeuralNetFastAI_BAG_L1_FULL ...\n",
            "2024-04-19 13:59:34,605\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:59:34,606\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:59:34,607\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:59:34,608\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:59:34,608\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:59:34,609\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "2024-04-19 13:59:34,610\tERROR worker.py:406 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): The worker died unexpectedly while executing this task. Check python-core-worker-*.log files for more information.\n",
            "\tStopping at the best epoch learned earlier - 3.\n",
            "\t12.14s\t = Training   runtime\n",
            "Fitting model: RandomForestGini_BAG_L1_FULL | Skipping fit via cloning parent ...\n",
            "\t1.71s\t = Training   runtime\n",
            "\t4.2s\t = Validation runtime\n",
            "Fitting model: RandomForestEntr_BAG_L1_FULL | Skipping fit via cloning parent ...\n",
            "\t1.58s\t = Training   runtime\n",
            "\t4.19s\t = Validation runtime\n",
            "Fitting 1 L1 models ...\n",
            "Fitting model: CatBoost_BAG_L1_FULL ...\n",
            "\t0.27s\t = Training   runtime\n",
            "Fitting model: ExtraTreesGini_BAG_L1_FULL | Skipping fit via cloning parent ...\n",
            "\t1.43s\t = Training   runtime\n",
            "\t4.2s\t = Validation runtime\n",
            "Fitting model: ExtraTreesEntr_BAG_L1_FULL | Skipping fit via cloning parent ...\n",
            "\t1.45s\t = Training   runtime\n",
            "\t4.23s\t = Validation runtime\n",
            "Fitting 1 L1 models ...\n",
            "Fitting model: XGBoost_BAG_L1_FULL ...\n",
            "\t0.58s\t = Training   runtime\n",
            "Fitting 1 L1 models ...\n",
            "Fitting model: NeuralNetTorch_BAG_L1_FULL ...\n",
            "\t63.04s\t = Training   runtime\n",
            "Fitting model: WeightedEnsemble_L2_FULL | Skipping fit via cloning parent ...\n",
            "\tEnsemble Weights: {'NeuralNetFastAI_BAG_L1': 1.0}\n",
            "\t2.57s\t = Training   runtime\n",
            "Updated best model to \"NeuralNetFastAI_BAG_L1_FULL\" (Previously \"WeightedEnsemble_L2\"). AutoGluon will default to using \"NeuralNetFastAI_BAG_L1_FULL\" for predict() and predict_proba().\n",
            "Refit complete, total runtime = 76.35s ... Best model: \"NeuralNetFastAI_BAG_L1_FULL\"\n",
            "TabularPredictor saved. To load, use: predictor = TabularPredictor.load(\"autogluon_pitchtype_models\")\n"
          ]
        }
      ],
      "source": [
        "MODELS_DIR = 'autogluon_pitchtype_models'  # Specifies folder to store trained models\n",
        "MODEL_PRESET = 'good_quality'  # Preset for training models\n",
        "\n",
        "if gpu_available:\n",
        "    predictor = TabularPredictor(label=label, path=MODELS_DIR).fit(train_data, presets=MODEL_PRESET,\n",
        "                                                                  num_gpus=1)\n",
        "else:\n",
        "    predictor = TabularPredictor(label=label, path=MODELS_DIR).fit(train_data, presets=MODEL_PRESET)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4oqEgzyWAhOg"
      },
      "source": [
        "## Evaluate the Model\n",
        "\n",
        "After training, evaluating your model is crucial to understand its performance and to ensure it generalizes well on unseen data. Model evaluation typically involves calculating performance metrics such as accuracy, precision, recall, and F1-score on a test set that was not used during the training process. Once the model is trained, you can evaluate its performance on the test data:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 11,
      "metadata": {
        "id": "nUjOtHqUAhOg"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "{'accuracy': 0.5046007403490217, 'balanced_accuracy': 0.2585244559827297, 'mcc': 0.046267345277066455}\n"
          ]
        }
      ],
      "source": [
        "performance = predictor.evaluate(test_data)\n",
        "print(performance)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0BRHZ3amAhOg"
      },
      "source": [
        "## View leaderboard"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 12,
      "metadata": {
        "id": "U_EeTPU6AhOg"
      },
      "outputs": [
        {
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>model</th>\n",
              "      <th>score_test</th>\n",
              "      <th>score_val</th>\n",
              "      <th>eval_metric</th>\n",
              "      <th>pred_time_test</th>\n",
              "      <th>pred_time_val</th>\n",
              "      <th>fit_time</th>\n",
              "      <th>pred_time_test_marginal</th>\n",
              "      <th>pred_time_val_marginal</th>\n",
              "      <th>fit_time_marginal</th>\n",
              "      <th>stack_level</th>\n",
              "      <th>can_infer</th>\n",
              "      <th>fit_order</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>CatBoost_BAG_L1_FULL</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.028682</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.267513</td>\n",
              "      <td>0.028682</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.267513</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>13</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>ExtraTreesEntr_BAG_L1</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>0.506918</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.090633</td>\n",
              "      <td>4.234753</td>\n",
              "      <td>1.447731</td>\n",
              "      <td>0.090633</td>\n",
              "      <td>4.234753</td>\n",
              "      <td>1.447731</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>6</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>RandomForestEntr_BAG_L1_FULL</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.092513</td>\n",
              "      <td>4.192037</td>\n",
              "      <td>1.582029</td>\n",
              "      <td>0.092513</td>\n",
              "      <td>4.192037</td>\n",
              "      <td>1.582029</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>12</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>ExtraTreesGini_BAG_L1_FULL</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.093715</td>\n",
              "      <td>4.200601</td>\n",
              "      <td>1.426428</td>\n",
              "      <td>0.093715</td>\n",
              "      <td>4.200601</td>\n",
              "      <td>1.426428</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>14</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>ExtraTreesGini_BAG_L1</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>0.506918</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.094340</td>\n",
              "      <td>4.200601</td>\n",
              "      <td>1.426428</td>\n",
              "      <td>0.094340</td>\n",
              "      <td>4.200601</td>\n",
              "      <td>1.426428</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>5</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <td>RandomForestGini_BAG_L1_FULL</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.094638</td>\n",
              "      <td>4.204879</td>\n",
              "      <td>1.713279</td>\n",
              "      <td>0.094638</td>\n",
              "      <td>4.204879</td>\n",
              "      <td>1.713279</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>11</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>6</th>\n",
              "      <td>RandomForestEntr_BAG_L1</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>0.506918</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.096177</td>\n",
              "      <td>4.192037</td>\n",
              "      <td>1.582029</td>\n",
              "      <td>0.096177</td>\n",
              "      <td>4.192037</td>\n",
              "      <td>1.582029</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>3</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7</th>\n",
              "      <td>ExtraTreesEntr_BAG_L1_FULL</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.097938</td>\n",
              "      <td>4.234753</td>\n",
              "      <td>1.447731</td>\n",
              "      <td>0.097938</td>\n",
              "      <td>4.234753</td>\n",
              "      <td>1.447731</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>15</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>8</th>\n",
              "      <td>XGBoost_BAG_L1_FULL</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.108012</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.575301</td>\n",
              "      <td>0.108012</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.575301</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>16</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>9</th>\n",
              "      <td>RandomForestGini_BAG_L1</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>0.506918</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.133376</td>\n",
              "      <td>4.204879</td>\n",
              "      <td>1.713279</td>\n",
              "      <td>0.133376</td>\n",
              "      <td>4.204879</td>\n",
              "      <td>1.713279</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>2</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>10</th>\n",
              "      <td>NeuralNetTorch_BAG_L1_FULL</td>\n",
              "      <td>0.506253</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.256820</td>\n",
              "      <td>NaN</td>\n",
              "      <td>63.037802</td>\n",
              "      <td>0.256820</td>\n",
              "      <td>NaN</td>\n",
              "      <td>63.037802</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>17</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>11</th>\n",
              "      <td>NeuralNetFastAI_BAG_L1_FULL</td>\n",
              "      <td>0.504601</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.265801</td>\n",
              "      <td>NaN</td>\n",
              "      <td>12.136145</td>\n",
              "      <td>0.265801</td>\n",
              "      <td>NaN</td>\n",
              "      <td>12.136145</td>\n",
              "      <td>1</td>\n",
              "      <td>True</td>\n",
              "      <td>10</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12</th>\n",
              "      <td>WeightedEnsemble_L2_FULL</td>\n",
              "      <td>0.504601</td>\n",
              "      <td>NaN</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>0.267193</td>\n",
              "      <td>NaN</td>\n",
              "      <td>14.703875</td>\n",
              "      <td>0.001392</td>\n",
              "      <td>NaN</td>\n",
              "      <td>2.567730</td>\n",
              "      <td>2</td>\n",
              "      <td>True</td>\n",
              "      <td>18</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13</th>\n",
              "      <td>NeuralNetFastAI_BAG_L1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.507027</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>NaN</td>\n",
              "      <td>1.191260</td>\n",
              "      <td>99.128999</td>\n",
              "      <td>NaN</td>\n",
              "      <td>1.191260</td>\n",
              "      <td>99.128999</td>\n",
              "      <td>1</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>14</th>\n",
              "      <td>WeightedEnsemble_L2</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.507027</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>NaN</td>\n",
              "      <td>1.205140</td>\n",
              "      <td>101.696729</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.013880</td>\n",
              "      <td>2.567730</td>\n",
              "      <td>2</td>\n",
              "      <td>False</td>\n",
              "      <td>9</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>15</th>\n",
              "      <td>CatBoost_BAG_L1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.506918</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.142789</td>\n",
              "      <td>7.543812</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.142789</td>\n",
              "      <td>7.543812</td>\n",
              "      <td>1</td>\n",
              "      <td>False</td>\n",
              "      <td>4</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>16</th>\n",
              "      <td>XGBoost_BAG_L1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.506918</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.156646</td>\n",
              "      <td>3.468957</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.156646</td>\n",
              "      <td>3.468957</td>\n",
              "      <td>1</td>\n",
              "      <td>False</td>\n",
              "      <td>7</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>17</th>\n",
              "      <td>NeuralNetTorch_BAG_L1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.506918</td>\n",
              "      <td>accuracy</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.991394</td>\n",
              "      <td>79.609893</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.991394</td>\n",
              "      <td>79.609893</td>\n",
              "      <td>1</td>\n",
              "      <td>False</td>\n",
              "      <td>8</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                           model  score_test  score_val eval_metric  \\\n",
              "0           CatBoost_BAG_L1_FULL    0.506253        NaN    accuracy   \n",
              "1          ExtraTreesEntr_BAG_L1    0.506253   0.506918    accuracy   \n",
              "2   RandomForestEntr_BAG_L1_FULL    0.506253        NaN    accuracy   \n",
              "3     ExtraTreesGini_BAG_L1_FULL    0.506253        NaN    accuracy   \n",
              "4          ExtraTreesGini_BAG_L1    0.506253   0.506918    accuracy   \n",
              "5   RandomForestGini_BAG_L1_FULL    0.506253        NaN    accuracy   \n",
              "6        RandomForestEntr_BAG_L1    0.506253   0.506918    accuracy   \n",
              "7     ExtraTreesEntr_BAG_L1_FULL    0.506253        NaN    accuracy   \n",
              "8            XGBoost_BAG_L1_FULL    0.506253        NaN    accuracy   \n",
              "9        RandomForestGini_BAG_L1    0.506253   0.506918    accuracy   \n",
              "10    NeuralNetTorch_BAG_L1_FULL    0.506253        NaN    accuracy   \n",
              "11   NeuralNetFastAI_BAG_L1_FULL    0.504601        NaN    accuracy   \n",
              "12      WeightedEnsemble_L2_FULL    0.504601        NaN    accuracy   \n",
              "13        NeuralNetFastAI_BAG_L1         NaN   0.507027    accuracy   \n",
              "14           WeightedEnsemble_L2         NaN   0.507027    accuracy   \n",
              "15               CatBoost_BAG_L1         NaN   0.506918    accuracy   \n",
              "16                XGBoost_BAG_L1         NaN   0.506918    accuracy   \n",
              "17         NeuralNetTorch_BAG_L1         NaN   0.506918    accuracy   \n",
              "\n",
              "    pred_time_test  pred_time_val    fit_time  pred_time_test_marginal  \\\n",
              "0         0.028682            NaN    0.267513                 0.028682   \n",
              "1         0.090633       4.234753    1.447731                 0.090633   \n",
              "2         0.092513       4.192037    1.582029                 0.092513   \n",
              "3         0.093715       4.200601    1.426428                 0.093715   \n",
              "4         0.094340       4.200601    1.426428                 0.094340   \n",
              "5         0.094638       4.204879    1.713279                 0.094638   \n",
              "6         0.096177       4.192037    1.582029                 0.096177   \n",
              "7         0.097938       4.234753    1.447731                 0.097938   \n",
              "8         0.108012            NaN    0.575301                 0.108012   \n",
              "9         0.133376       4.204879    1.713279                 0.133376   \n",
              "10        0.256820            NaN   63.037802                 0.256820   \n",
              "11        0.265801            NaN   12.136145                 0.265801   \n",
              "12        0.267193            NaN   14.703875                 0.001392   \n",
              "13             NaN       1.191260   99.128999                      NaN   \n",
              "14             NaN       1.205140  101.696729                      NaN   \n",
              "15             NaN       0.142789    7.543812                      NaN   \n",
              "16             NaN       0.156646    3.468957                      NaN   \n",
              "17             NaN       0.991394   79.609893                      NaN   \n",
              "\n",
              "    pred_time_val_marginal  fit_time_marginal  stack_level  can_infer  \\\n",
              "0                      NaN           0.267513            1       True   \n",
              "1                 4.234753           1.447731            1       True   \n",
              "2                 4.192037           1.582029            1       True   \n",
              "3                 4.200601           1.426428            1       True   \n",
              "4                 4.200601           1.426428            1       True   \n",
              "5                 4.204879           1.713279            1       True   \n",
              "6                 4.192037           1.582029            1       True   \n",
              "7                 4.234753           1.447731            1       True   \n",
              "8                      NaN           0.575301            1       True   \n",
              "9                 4.204879           1.713279            1       True   \n",
              "10                     NaN          63.037802            1       True   \n",
              "11                     NaN          12.136145            1       True   \n",
              "12                     NaN           2.567730            2       True   \n",
              "13                1.191260          99.128999            1      False   \n",
              "14                0.013880           2.567730            2      False   \n",
              "15                0.142789           7.543812            1      False   \n",
              "16                0.156646           3.468957            1      False   \n",
              "17                0.991394          79.609893            1      False   \n",
              "\n",
              "    fit_order  \n",
              "0          13  \n",
              "1           6  \n",
              "2          12  \n",
              "3          14  \n",
              "4           5  \n",
              "5          11  \n",
              "6           3  \n",
              "7          15  \n",
              "8          16  \n",
              "9           2  \n",
              "10         17  \n",
              "11         10  \n",
              "12         18  \n",
              "13          1  \n",
              "14          9  \n",
              "15          4  \n",
              "16          7  \n",
              "17          8  "
            ]
          },
          "execution_count": 12,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "predictor.leaderboard(test_data)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "o_1TIEmfAhOg"
      },
      "source": [
        "## Make Predictions\n",
        "\n",
        "Once satisfied with your model's performance, the final step is using it to make predictions on new data. This step is where your model is put to the test, providing insights and decisions based on the data it analyzes. Now you can use the model to predict the pitch type:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 13,
      "metadata": {
        "id": "hpocASI4AhOg"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "6     Fastball\n",
            "14    Fastball\n",
            "16    Fastball\n",
            "19    Fastball\n",
            "20    Fastball\n",
            "Name: PitchType, dtype: object\n",
            "    Changeup  Curveball  Fastball    Slider\n",
            "6   0.093924   0.136875  0.494357  0.274844\n",
            "14  0.102742   0.144563  0.438784  0.313910\n",
            "16  0.102742   0.144563  0.438784  0.313910\n",
            "19  0.091051   0.089735  0.556712  0.262501\n",
            "20  0.093067   0.135629  0.493959  0.277346\n"
          ]
        }
      ],
      "source": [
        "predictions = predictor.predict(test_data)\n",
        "print(predictions.head())\n",
        "\n",
        "# To view the probability of each class\n",
        "probabilities = predictor.predict_proba(test_data)\n",
        "print(probabilities.head())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "MEmDQ8w0AhOg"
      },
      "source": [
        "## Insights and Feature Importance\n",
        "\n",
        "AutoGluon provides functionality to understand which features are most important for the predictions:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 14,
      "metadata": {
        "id": "N-dlj0gSAhOg"
      },
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "Computing feature importance via permutation shuffling for 3 features using 5000 rows with 5 shuffle sets...\n",
            "\t0.63s\t= Expected runtime (0.13s per shuffle set)\n",
            "\t0.46s\t= Actual runtime (Completed 5 of 5 shuffle sets)\n"
          ]
        },
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "                   importance    stddev   p_value  n  p99_high   p99_low\n",
            "Strikes               0.01784  0.006085  0.001400  5  0.030369  0.005311\n",
            "Balls                 0.01712  0.006123  0.001669  5  0.029727  0.004513\n",
            "PreviousPitchType     0.00156  0.001740  0.057753  5  0.005143 -0.002023\n"
          ]
        }
      ],
      "source": [
        "feature_importance = predictor.feature_importance(data=train_data)\n",
        "print(feature_importance)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "bYIqhDdLAhOg"
      },
      "source": [
        "## Conclusion\n",
        "\n",
        "In this tutorial, we explored the capabilities of AutoGluon in the context of sports analytics by predicting baseball pitch types. We walked through the entire workflow, from data preparation and model training to evaluation and making predictions. By now, you should have a solid understanding of how AutoGluon can be used to handle complex predictive modeling tasks with ease. We encourage you to apply the knowledge and techniques learned here to your datasets and challenges, exploring further the potential of AutoML to transform your analytical processes. Remember, the key to mastering AutoGluon is continuous experimentation and adaptation to your specific needs. Experiment with AutoGluon's hyperparameters and model configurations to improve performance."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "C_PK9mXUDL9o"
      },
      "outputs": [],
      "source": []
    }
  ],
  "metadata": {
    "colab": {
      "provenance": []
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.9.0"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}