The Jupyter Notebook is a web application that allows you to create and share documents that contain live code, equations, visualizations and explanatory text. In PNDA, it supports exploration and presentation of data from HDFS and HBase.
Along with PNDA cluster provisioning, Jupyter is deployed with four kernel supports: Python2 kernel, Python3 kernel, PySpark (Python2) kernel and Spark (Scala) kernel. An example Jupyter notebook is also provided with details instructions on how to rapid prototype using Jupyter PySpark kernel. In particular the example noteobook gives an example usage of platform libraries to load HDFS data and perform interactive data analytics. A sample Jupyter notebook is also provided for executing scala code using Spark kernel that allow to connect with remote Spark cluster and execute code.
By default, Jupyter is installed on Jupyter
node. In order to access Jupyter portal go to: http://[cluster-name]-cdh-jupyter:8000
You should see a jupyter login page as below.
Use pnda/pnda to login, you will be redirected to a notebook list view. By default the list is empty.
Clone example-jupyter-notebooks repository. Click the upload button and select the example notebook (example-jupyter-notebooks/notebooks/Example Platform-library PySpark Notebook.ipynb
) from your local repository.
Click the link Example Platform-library PySpark Notebook.ipynb
.