Code

resolve #427- Spark 3 support#433

Code

Merged

imarios merged 18 commits intotypelevel:mastertypelevel/frameless:masterfrom chris-twiner:temp/Spark3chris-twiner/frameless:temp/Spark3Copy head branch name to clipboardAug 31, 2020

+126-83

Commits

Commits on Jul 3, 2020

• fix typelevel#422, base for typelevel#427

  chris-twiner

  committed
  23d93f9

  Copy full SHA for 23d93f9

Commits on Jul 5, 2020

• better handling, schema on the serializer needs repacking for nulls

  chris-twiner

  committed
  fe4798c

  Copy full SHA for fe4798c

• parity udf code, complex types still not working

  chris-twiner

  committed
  0d27d43

  Copy full SHA for 0d27d43

• tests using minus scales fixed

  chris-twiner

  committed
  dd4eb67

  Copy full SHA for dd4eb67

• tests using minus scales fixed

  chris-twiner

  committed
  af34ebf

  Copy full SHA for af34ebf

Commits on Jul 6, 2020

• get rid of debug entry, doesn't work either way

  chris-twiner

  committed
  fdccfb8

  Copy full SHA for fdccfb8

• value is the new _1 and set by ExpressionEncoder, it's not possible to replace schema directly so some nullable checks just won't work

  chris-twiner

  committed
  23868dc

  Copy full SHA for 23868dc

• nested types can't use ordinals directly in 3, bizarrely

  chris-twiner

  committed
  f1e6b72

  Copy full SHA for f1e6b72

• the paths are wrong for options, the nested types 'solution' doesn't work though

  chris-twiner

  committed
  a1d006b

  Copy full SHA for a1d006b

Commits on Jul 7, 2020

• got the basics, wrong starting place for record encoders, will fix up to minimal changes

  chris-twiner

  committed
  729c56d

  Copy full SHA for 729c56d

• encoders ported, 347 tests passed, 7 failed

  chris-twiner

  committed
  a1a7d5b

  Copy full SHA for a1a7d5b

• sum and sumdistinct have the wrong types for the zero literal

  chris-twiner

  committed
  7896e8a

  Copy full SHA for 7896e8a

• add spark 2.4 join behaviour and enable ignoring of nullable

  chris-twiner

  committed
  f39f550

  Copy full SHA for f39f550

• version bump and readme change

  chris-twiner

  committed
  c5a7078

  Copy full SHA for c5a7078

• remove 2.11 travis build bits

  chris-twiner

  committed
  918ca8c

  Copy full SHA for 918ca8c

Commits on Jul 8, 2020

• typelevel#427 - Remove dead code

  chris-twiner

  committed
  9e0de29

  Copy full SHA for 9e0de29

Commits on Jul 27, 2020

• typelevel#427 - Based on feedback on the pull, reverting test changes - no longer necessary

  chris-twiner

  committed
  69ae591

  Copy full SHA for 69ae591

Commits on Jul 28, 2020

• Merge branch 'master' into temp/Spark3

  chris-twiner

  authored
  4713716

  Copy full SHA for 4713716