Skip to content

Commit 9195809

Browse files
committed
Added simplified Spark installation instructions from the repo: https://github.com/donnemartin/dev-setup.
1 parent 3aee2e1 commit 9195809

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

spark/spark.ipynb

+3-1
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,9 @@
4141
"cell_type": "markdown",
4242
"metadata": {},
4343
"source": [
44-
"Follow the instructions provided [here](http://ramhiser.com/2015/02/01/configuring-ipython-notebook-support-for-pyspark/) to configure IPython Notebook Support for PySpark with Python 2.\n",
44+
"The [dev-setup](https://github.com/donnemartin/dev-setup) repo contains scripts to install Spark and to automate the its integration with IPython Notebook through the [pydata.sh script](https://github.com/donnemartin/dev-setup/blob/master/aws.sh).\n",
45+
"\n",
46+
"You can also follow the instructions provided [here](http://ramhiser.com/2015/02/01/configuring-ipython-notebook-support-for-pyspark/) to configure IPython Notebook Support for PySpark with Python 2.\n",
4547
"\n",
4648
"To run Python 3 with Spark 1.4+, check out the following posts on [Stack Overflow](http://stackoverflow.com/questions/30279783/apache-spark-how-to-use-pyspark-with-python-3) or [Reddit](http://www.reddit.com/r/datascience/comments/3ar1bd/continually_updated_data_science_python_notebooks/)."
4749
]

0 commit comments

Comments
 (0)