%ex2.5

Push JupyterLab notebook to lbd:
\begin{verbatim}rsync -vaPp --delete ~/gitstuff/adbs/ex2/spark/ \
e726236f@lbd.zserv.tuwien.ac.at:hive/;
\end{verbatim}

Continue to the Jupyter Lab at: https://lbd.zserv.tuwien.ac.at:8000\\

Although Jupyter Lab offers a nice interface, it doesn't seem to actually work and hangs with the message:
\begin{verbatim}Intitializing Scala interpreter ...\end{verbatim}

Therefore we decided to run spark in the shell on lbd:
\begin{verbatim}ssh -t e726236f@lbd.zserv.tuwien.ac.at \
"source /etc/profile; spark2-shell --master yarn --deploy-mode client --"\end{verbatim}

The tasks are solved and documented in the \textbf{Exercise5\_SparkInScala.ipynb} file.