From 0d6498f0c2ade5b6cc89bfc1b3cc88db2b081251 Mon Sep 17 00:00:00 2001 From: elvaliuliuliu <47404285+elvaliuliuliu@users.noreply.github.com> Date: Tue, 18 Feb 2020 22:29:44 -0800 Subject: [PATCH] Prep 0.9.0 release (#403) --- README.md | 2 +- benchmark/scala/pom.xml | 2 +- docs/release-notes/0.9/release-0.9.md | 51 +++++++++++++++++++++++++++ eng/Versions.props | 2 +- src/scala/pom.xml | 2 +- 5 files changed, 55 insertions(+), 4 deletions(-) create mode 100644 docs/release-notes/0.9/release-0.9.md diff --git a/README.md b/README.md index 8e5d10561..bb1c03b01 100644 --- a/README.md +++ b/README.md @@ -39,7 +39,7 @@ 2.3.* - v0.8.0 + v0.9.0 2.4.0 diff --git a/benchmark/scala/pom.xml b/benchmark/scala/pom.xml index c21b78ee5..8d26879a9 100644 --- a/benchmark/scala/pom.xml +++ b/benchmark/scala/pom.xml @@ -3,7 +3,7 @@ 4.0.0 com.microsoft.spark microsoft-spark-benchmark - 0.8.0 + 0.9.0 2019 UTF-8 diff --git a/docs/release-notes/0.9/release-0.9.md b/docs/release-notes/0.9/release-0.9.md new file mode 100644 index 000000000..ae0cf16af --- /dev/null +++ b/docs/release-notes/0.9/release-0.9.md @@ -0,0 +1,51 @@ +# .NET for Apache Spark 0.9 Release Notes + +### New Features and Improvements + +* Expose `DataStreamWriter.Foreach` API ([#387](https://github.com/dotnet/spark/pull/387)) +* Support UDF that returns `Row` object ([#376](https://github.com/dotnet/spark/pull/376), [#406](https://github.com/dotnet/spark/pull/406), [#411](https://github.com/dotnet/spark/pull/411)) +* Support for Bucketizer ([#378](https://github.com/dotnet/spark/pull/378)) +* Support `DateType` ([#420](https://github.com/dotnet/spark/pull/420)) + +### Breaking Changes + +* The prior versions (<0.9) of `Microsoft.Spark.Worker` **are not compatible** with this release due to the internal changes related to UDFs. + +### Supported Spark Versions + +The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with: + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Spark Versionmicrosoft-spark JAR
2.3.*microsoft-spark-2.3.x-0.9.0.jar
2.4.0microsoft-spark-2.4.x-0.9.0.jar
2.4.1
2.4.3
2.4.4
2.4.5
2.4.2Not supported
diff --git a/eng/Versions.props b/eng/Versions.props index 408638d6a..9459b5a72 100644 --- a/eng/Versions.props +++ b/eng/Versions.props @@ -1,7 +1,7 @@ - 0.8.0 + 0.9.0 prerelease $(RestoreSources); diff --git a/src/scala/pom.xml b/src/scala/pom.xml index 9795a4e3e..2a8785da1 100644 --- a/src/scala/pom.xml +++ b/src/scala/pom.xml @@ -7,7 +7,7 @@ ${microsoft-spark.version} UTF-8 - 0.8.0 + 0.9.0