Skip to content

Latest commit

 

History

History
51 lines (45 loc) · 1.55 KB

release-0.8.md

File metadata and controls

51 lines (45 loc) · 1.55 KB

.NET for Apache Spark 0.8 Release Notes

New Features and Improvements

  • Support for Row type Ser/De and exposing the CreateDataFrame API (#338)
  • Support .NET Core 3.1 (#291 and #386)
  • Support for new Delta v0.5.0 APIs (#374)
  • Precompute the normalized type names of DataTypes and use string.Create on NS2.1 for faster normalization (#364)
  • Support for Spark 2.4.5 (#392)

Breaking Changes

  • None

Supported Spark Versions

The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:

Spark Version microsoft-spark JAR
2.3.* microsoft-spark-2.3.x-0.8.0.jar
2.4.0 microsoft-spark-2.4.x-0.8.0.jar
2.4.1
2.4.3
2.4.4
2.4.5
2.4.2 Not supported