Skip to content

Commit

Permalink
feat: make it easier to download the datasets
Browse files Browse the repository at this point in the history
  • Loading branch information
dimakis committed Nov 14, 2023
1 parent 7124cd7 commit 6ca37ba
Showing 1 changed file with 9 additions and 2 deletions.
11 changes: 9 additions & 2 deletions demo-notebooks/guided-demos/2_basic_jobs.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -116,7 +116,13 @@
"id": "83d77b74",
"metadata": {},
"source": [
"First, let's begin by submitting to Ray, training a basic NN on the MNIST dataset:"
"First, let's begin by submitting to Ray, training a basic NN on the MNIST dataset:\n",
"\n",
"NOTE: To test this demo in an air-gapped/ disconnected environment alter the training script to use a local dataset.\n",
"First we must download the MNIST dataset. We've included a helper script to do this for you. \n",
"\n",
"You can run the python script (`python download_mnist_datasets.py`) directly and then place the dataset in the same directory as this notebook. \n",
"The path to the dataset would be: `..guided-demos/MNIST/raw/` "
]
},
{
Expand All @@ -129,6 +135,7 @@
"jobdef = DDPJobDefinition(\n",
" name=\"mnisttest\",\n",
" script=\"mnist.py\",\n",
" # script=\"mnist_disconnected.py\", # training script for disconnected environment\n",
" scheduler_args={\"requirements\": \"requirements.txt\"}\n",
")\n",
"job = jobdef.submit(cluster)"
Expand Down Expand Up @@ -302,7 +309,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.8.13"
"version": "3.9.18"
},
"vscode": {
"interpreter": {
Expand Down

0 comments on commit 6ca37ba

Please sign in to comment.