add notebook yaml highlighting

Author: Yelinz

notebooks/unit3/unit3.ipynb

@@ -3,8 +3,8 @@
     {
       "cell_type": "markdown",
       "metadata": {
-        "id": "view-in-github",
-        "colab_type": "text"
+        "colab_type": "text",
+        "id": "view-in-github"
       },
       "source": [
         "<a href=\"https://colab.research.google.com/github/huggingface/deep-rl-class/blob/main/notebooks/unit3.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
@@ -41,6 +41,9 @@
     },
     {
       "cell_type": "markdown",
+      "metadata": {
+        "id": "ykJiGevCMVc5"
+      },
       "source": [
         "### 🎮 Environments: \n",
         "\n",
@@ -51,10 +54,7 @@
         "### 📚 RL-Library: \n",
         "\n",
         "- [RL-Baselines3-Zoo](https://github.com/DLR-RM/rl-baselines3-zoo)"
-      ],
-      "metadata": {
-        "id": "ykJiGevCMVc5"
-      }
+      ]
     },
     {
       "cell_type": "markdown",
@@ -72,13 +72,13 @@
     },
     {
       "cell_type": "markdown",
+      "metadata": {
+        "id": "TsnP0rjxMn1e"
+      },
       "source": [
         "## This notebook is from Deep Reinforcement Learning Course\n",
         "<img src=\"https://huggingface.co/datasets/huggingface-deep-rl-course/course-images/resolve/main/en/notebooks/deep-rl-course-illustration.jpg\" alt=\"Deep RL Course illustration\"/>"
-      ],
-      "metadata": {
-        "id": "TsnP0rjxMn1e"
-      }
+      ]
     },
     {
       "cell_type": "markdown",
@@ -114,12 +114,12 @@
     },
     {
       "cell_type": "markdown",
-      "source": [
-        "We're constantly trying to improve our tutorials, so **if you find some issues in this notebook**, please [open an issue on the Github Repo](https://github.com/huggingface/deep-rl-class/issues)."
-      ],
       "metadata": {
         "id": "7kszpGFaRVhq"
-      }
+      },
+      "source": [
+        "We're constantly trying to improve our tutorials, so **if you find some issues in this notebook**, please [open an issue on the Github Repo](https://github.com/huggingface/deep-rl-class/issues)."
+      ]
     },
     {
       "cell_type": "markdown",
@@ -142,6 +142,9 @@
     },
     {
       "cell_type": "markdown",
+      "metadata": {
+        "id": "Nc8BnyVEc3Ys"
+      },
       "source": [
         "## An advice 💡\n",
         "It's better to run this colab in a copy on your Google Drive, so that **if it timeouts** you still have the saved notebook on your Google Drive and do not need to fill everything from scratch.\n",
@@ -151,87 +154,84 @@
         "Also, we're going to **train it for 90 minutes with 1M timesteps**. By typing `!nvidia-smi` will tell you what GPU you're using.\n",
         "\n",
         "And if you want to train more such 10 million steps, this will take about 9 hours, potentially resulting in Colab timing out. In that case, I recommend running this on your local computer (or somewhere else). Just click on: `File>Download`. "
-      ],
-      "metadata": {
-        "id": "Nc8BnyVEc3Ys"
-      }
+      ]
     },
     {
       "cell_type": "markdown",
+      "metadata": {
+        "id": "PU4FVzaoM6fC"
+      },
       "source": [
         "## Set the GPU 💪\n",
         "- To **accelerate the agent's training, we'll use a GPU**. To do that, go to `Runtime > Change Runtime type`\n",
         "\n",
         "<img src=\"https://huggingface.co/datasets/huggingface-deep-rl-course/course-images/resolve/main/en/notebooks/gpu-step1.jpg\" alt=\"GPU Step 1\">"
-      ],
-      "metadata": {
-        "id": "PU4FVzaoM6fC"
-      }
+      ]
     },
     {
       "cell_type": "markdown",
+      "metadata": {
+        "id": "KV0NyFdQM9ZG"
+      },
       "source": [
         "- `Hardware Accelerator > GPU`\n",
         "\n",
         "<img src=\"https://huggingface.co/datasets/huggingface-deep-rl-course/course-images/resolve/main/en/notebooks/gpu-step2.jpg\" alt=\"GPU Step 2\">"
-      ],
-      "metadata": {
-        "id": "KV0NyFdQM9ZG"
-      }
+      ]
     },
     {
       "cell_type": "markdown",
+      "metadata": {
+        "id": "wS_cVefO-aYg"
+      },
       "source": [
         "# Install RL-Baselines3 Zoo and its dependencies 📚\n",
         "\n",
         "If you see `ERROR: pip's dependency resolver does not currently take into account all the packages that are installed.` **this is normal and it's not a critical error** there's a conflict of version. But the packages we need are installed."
-      ],
-      "metadata": {
-        "id": "wS_cVefO-aYg"
-      }
+      ]
     },
     {
       "cell_type": "code",
-      "source": [
-        "# For now we install this update of RL-Baselines3 Zoo\n",
-        "!pip install git+https://github.com/DLR-RM/rl-baselines3-zoo@update/hf"
-      ],
+      "execution_count": null,
       "metadata": {
         "id": "hLTwHqIWdnPb"
       },
-      "execution_count": null,
-      "outputs": []
+      "outputs": [],
+      "source": [
+        "# For now we install this update of RL-Baselines3 Zoo\n",
+        "!pip install git+https://github.com/DLR-RM/rl-baselines3-zoo@update/hf"
+      ]
     },
     {
       "cell_type": "markdown",
-      "source": [
-        "IF AND ONLY IF THE VERSION ABOVE DOES NOT EXIST ANYMORE. UNCOMMENT AND INSTALL THE ONE BELOW"
-      ],
       "metadata": {
         "id": "p0xe2sJHdtHy"
-      }
+      },
+      "source": [
+        "IF AND ONLY IF THE VERSION ABOVE DOES NOT EXIST ANYMORE. UNCOMMENT AND INSTALL THE ONE BELOW"
+      ]
     },
     {
       "cell_type": "code",
-      "source": [
-        "#!pip install rl_zoo3==2.0.0a9"
-      ],
+      "execution_count": null,
       "metadata": {
         "id": "N0d6wy-F-f39"
       },
-      "execution_count": null,
-      "outputs": []
+      "outputs": [],
+      "source": [
+        "#!pip install rl_zoo3==2.0.0a9"
+      ]
     },
     {
       "cell_type": "code",
-      "source": [
-        "!apt-get install swig cmake ffmpeg"
-      ],
+      "execution_count": null,
       "metadata": {
         "id": "8_MllY6Om1eI"
       },
-      "execution_count": null,
-      "outputs": []
+      "outputs": [],
+      "source": [
+        "!apt-get install swig cmake ffmpeg"
+      ]
     },
     {
       "cell_type": "markdown",
@@ -244,28 +244,28 @@
     },
     {
       "cell_type": "code",
-      "source": [
-        "!pip install gymnasium[atari]\n",
-        "!pip install gymnasium[accept-rom-license]"
-      ],
+      "execution_count": null,
       "metadata": {
         "id": "NsRP-lX1_2fC"
       },
-      "execution_count": null,
-      "outputs": []
+      "outputs": [],
+      "source": [
+        "!pip install gymnasium[atari]\n",
+        "!pip install gymnasium[accept-rom-license]"
+      ]
     },
     {
       "cell_type": "markdown",
+      "metadata": {
+        "id": "bTpYcVZVMzUI"
+      },
       "source": [
         "## Create a virtual display 🔽\n",
         "\n",
         "During the notebook, we'll need to generate a replay video. To do so, with colab, **we need to have a virtual screen to be able to render the environment** (and thus record the frames). \n",
         "\n",
         "Hence the following cell will install the librairies and create and run a virtual screen 🖥"
-      ],
-      "metadata": {
-        "id": "bTpYcVZVMzUI"
-      }
+      ]
     },
     {
       "cell_type": "code",
@@ -283,18 +283,18 @@
     },
     {
       "cell_type": "code",
+      "execution_count": null,
+      "metadata": {
+        "id": "BE5JWP5rQIKf"
+      },
+      "outputs": [],
       "source": [
         "# Virtual display\n",
         "from pyvirtualdisplay import Display\n",
         "\n",
         "virtual_display = Display(visible=0, size=(1400, 900))\n",
         "virtual_display.start()"
-      ],
-      "metadata": {
-        "id": "BE5JWP5rQIKf"
-      },
-      "execution_count": null,
-      "outputs": []
+      ]
     },
     {
       "cell_type": "markdown",
@@ -310,7 +310,7 @@
         "\n",
         "This is a template example:\n",
         "\n",
-        "```\n",
+        "```yaml\n",
         "SpaceInvadersNoFrameskip-v4:\n",
         "  env_wrapper:\n",
         "    - stable_baselines3.common.atari_wrappers.AtariWrapper\n",
@@ -755,12 +755,12 @@
     },
     {
       "cell_type": "markdown",
-      "source": [
-        "See you on Bonus unit 2! 🔥 "
-      ],
       "metadata": {
         "id": "Kc3udPT-RcXc"
-      }
+      },
+      "source": [
+        "See you on Bonus unit 2! 🔥 "
+      ]
     },
     {
       "cell_type": "markdown",
@@ -773,11 +773,13 @@
     }
   ],
   "metadata": {
+    "accelerator": "GPU",
     "colab": {
+      "include_colab_link": true,
       "private_outputs": true,
-      "provenance": [],
-      "include_colab_link": true
+      "provenance": []
     },
+    "gpuClass": "standard",
     "kernelspec": {
       "display_name": "Python 3 (ipykernel)",
       "language": "python",
@@ -823,9 +825,7 @@
         "_Feature"
       ],
       "window_display": false
-    },
-    "accelerator": "GPU",
-    "gpuClass": "standard"
+    }
   },
   "nbformat": 4,
   "nbformat_minor": 0