Skip to content

alexnikitchuk/spark-ts-examples

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spark-ts-examples

Description

Examples showing how to use the spark-ts time series library for Apache Spark.

Minimum Requirements

  • Java 1.8
  • Maven 3.0
  • Apache Spark 1.6.0

Using this Repo

Building

We use Maven for building Java / Scala. To compile and build the example jar, navigate to the jvm directory and run:

mvn package

Running

To submit one of the Java or Scala examples to a local Spark cluster, run the following command from the jvm directory:

spark-submit --class com.cloudera.tsexamples.Stocks target/spark-ts-examples-0.0.1-SNAPSHOT-jar-with-dependencies.jar

You can substitute any of the Scala or Java example classes as the value for the --class parameter.

To submit a Python example, run the following command from the python directory:

spark-submit --driver-class-path PATH/TO/sparkts-0.3.0-jar-with-dependencies.jar Stocks.py

The --driver-class-path parameter value must point to the Spark-TS JAR file, which can be downloaded from the spark-timeseries Github repo.

Releases

No releases published

Packages

No packages published

Languages

  • Java 40.9%
  • Scala 33.8%
  • Python 25.3%