Tuesday, January 28, 2014

Spark Scala-2.10 support

https://github.com/mesos/spark/tree/scala-2.10

> git clone -b scala-2.10 https://github.com/davidchang168/spark.git
For Apache Hadoop 2.x, 0.23.x, Cloudera CDH MRv2, and other Hadoop versions with YARN, also setSPARK_YARN=true:
# Apache Hadoop 2.0.5-alpha
$ SPARK_HADOOP_VERSION=2.0.5-alpha SPARK_YARN=true sbt/sbt assembly

# Cloudera CDH 4.2.0 with MapReduce v2
$ SPARK_HADOOP_VERSION=2.0.0-cdh4.2.0 SPARK_YARN=true sbt/sbt assembly

No comments: