Skip to content

Performance

Animesh Trivedi edited this page May 10, 2017 · 1 revision

How to register to spark kryo your shuffle classes

val conf = new SparkConf().setMaster(...).setAppName(...)
conf.registerKryoClasses(Array(classOf[MyClass1], classOf[MyClass2]))
val sc = new SparkContext(conf)
Clone this wiki locally