Install Jupyter notebook with Livy for Spark on Cloudera Hadoop

Environment Cloudera CDH 5.12.x running Livy and Spark (see other blog on this website to install Livy) Anaconda parcel installed using Cloudera Manager (see other blog on this website to install Anaconda parcel on CDH) We will first install Anaconda and Sparkmagic on Windows 10 to install Jupyter Notebook using Anaconda. We strongly recommend installing Python and … Continue reading Install Jupyter notebook with Livy for Spark on Cloudera Hadoop

Advertisements

Install Hue Spark Notebook with Livy on Cloudera

This blog will show simple steps to install and configure Hue Spark notebook to run interactive pySpark  scripts using Livy. Environment used: CDH 5.12.x , Cloudera Manager, Hue 4.0, Livy 0.3.0, Spark 1.6.0 on RHEL linux. Sentry was installed in unsecure mode. NOTE: Make sure the user who logs into Hue has access to Hive … Continue reading Install Hue Spark Notebook with Livy on Cloudera