Browse Source

add dropout scaling note

rasbt 1 year ago
parent
commit
1183fd7837
1 changed files with 2 additions and 1 deletions
  1. 2 1
      ch03/01_main-chapter-code/ch03.ipynb

+ 2 - 1
ch03/01_main-chapter-code/ch03.ipynb

@@ -1485,7 +1485,8 @@
    "id": "5a575458-a6da-4e54-8688-83e155f2de06",
    "id": "5a575458-a6da-4e54-8688-83e155f2de06",
    "metadata": {},
    "metadata": {},
    "source": [
    "source": [
-    "- If we apply a dropout rate of 0.5 (50%), the non-dropped values will be scaled accordingly by a factor of 1/0.5 = 2."
+    "- If we apply a dropout rate of 0.5 (50%), the non-dropped values will be scaled accordingly by a factor of 1/0.5 = 2\n",
+    "- The scaling is calculated by the formula 1 / (1 - `dropout_rate`)"
    ]
    ]
   },
   },
   {
   {