Test project for SparkSQL and ScalaPB.
-
To build:
$ sbt assembly
Note a line like the follows that provides the path to the JAR we created:
[info] Packaging /home/.../sparksql-scalapb-test/target/scala-2.12/sparksql-scalapb-test-assembly-1.0.0.jar ...
-
Submit the job to your cluster:
/path/to/spark/bin/spark-submit \ --jars . \ --class myexample.RunDemo \ target/scala-2.12/sparksql-scalapb-test-assembly-1.0.0.jar