Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-24252][SQL] Add catalog registration and table catalog APIs. #21306

Closed
wants to merge 4 commits into from
Closed

[SPARK-24252][SQL] Add catalog registration and table catalog APIs. #21306

wants to merge 4 commits into from

Commits on Aug 14, 2018

  1. SPARK-24252: Add v2 data source mix-in for catalog support.

    @rdblue
    rdblue committed Aug 14, 2018
    Configuration menu
    Copy the full SHA
    21acda2 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2018

  1. SPARK-24252: Add PartitionTransform to replace Expression. 

    Expression is internal and should not be used in public APIs. To avoid
using Expression in the TableCatalog API, this commit adds a small set
of transformations that are used to communicate partitioning to catalog
implementations.

This also adds an apply transformation that passes the name of a
transform instead of a Transform class. This can be used to pass
transforms that are unknown to Spark to the underlying catalog
implementation.
    @rdblue
    rdblue committed Aug 18, 2018
    Configuration menu
    Copy the full SHA
    4697406 View commit details
    Browse the repository at this point in the history

  2. SPARK-24252: Add TableCatalog impl backed by SessionCatalog.

    @rdblue
    rdblue committed Aug 18, 2018
    Configuration menu
    Copy the full SHA
    dca4bf8 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2018

  1. SPARK-24252: Fix build problems.

    @rdblue
    rdblue committed Aug 20, 2018
    Configuration menu
    Copy the full SHA
    6b45a11 View commit details
    Browse the repository at this point in the history