Skip to content

Releases: seahrh/spark-util

0.4.1

24 Apr 01:48
Compare
Choose a tag to compare

Changelog

  • Implement SMOTE algorithm with Spark ML
  • travis-ci: release artifact to sonatype central

0.3.1

02 Apr 23:39
f7aff49
Compare
Choose a tag to compare

Changelog

  • fix implicit param SparkSession
  • update deps: spark 2.4.0

0.3.0

26 Mar 08:41
8f1b874
Compare
Choose a tag to compare

Changelog

  • save hive table partitions with ParquetTablePartition or OrcTablePartition

0.2.0

24 Mar 08:24
ffdb270
Compare
Choose a tag to compare

Changelog

  • add travis build
  • create Log4jLogging trait, mute logging in tests
  • update deps

0.1.0

20 Feb 03:22
8947f23
Compare
Choose a tag to compare

Changelog

  • Workaround for Dataset union bug
  • Write to a single table partition
  • CountAccumulator count-by-key