Skip to content

Latest commit

 

History

History
47 lines (41 loc) · 1.39 KB

release-0.2.md

File metadata and controls

47 lines (41 loc) · 1.39 KB

.NET for Apache Spark 0.2 Release Notes

Release Notes

Below are some of the highlights from this release.

  • Added XML documentation file to Nuget package and the comments on public APIs are now visible.
  • Bug fixes:
    • DataFrameWriter.Option() APIs were not setting keys correctly. (#59)
    • DataFrameWriter.PartitionBy() is fixed. (#56)
  • Relaxed the Spark version check. (#74)
  • Executables in PATH do not require full path when they are provided in spark-submit. (#81)

Supported Spark Versions

The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:

Spark Version microsoft-spark JAR
2.3.0 microsoft-spark-2.3.x-0.2.0.jar
2.3.1
2.3.2
2.3.3
2.4.0 microsoft-spark-2.4.x-0.2.0.jar
2.4.1