-
Notifications
You must be signed in to change notification settings - Fork 28.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-24251][SQL] Add AppendData logical plan. #21305
Closed
Closed
Commits on Aug 7, 2018
-
SPARK-24251: Add AppendData logical plan.
This adds a new logical plan, AppendData, that was proposed in SPARK-23521. This also adds an analyzer rule to validate data written with AppendData against the target table. DataFrameWriter is also updated so that v2 writes use the new AppendData logical plan.
Configuration menu - View commit details
-
Copy full SHA for d0d2de8 - Browse repository at this point
Copy the full SHA d0d2de8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 98bf4df - Browse repository at this point
Copy the full SHA 98bf4dfView commit details -
Configuration menu - View commit details
-
Copy full SHA for ae38187 - Browse repository at this point
Copy the full SHA ae38187View commit details -
SPARK-24251: Update for review comments.
* Require NamedRelation in AppendData * Check each column's compatibility recursively
Configuration menu - View commit details
-
Copy full SHA for 504be8a - Browse repository at this point
Copy the full SHA 504be8aView commit details -
Configuration menu - View commit details
-
Copy full SHA for d62e1b6 - Browse repository at this point
Copy the full SHA d62e1b6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4127833 - Browse repository at this point
Copy the full SHA 4127833View commit details -
Configuration menu - View commit details
-
Copy full SHA for d22ebf1 - Browse repository at this point
Copy the full SHA d22ebf1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 36c0237 - Browse repository at this point
Copy the full SHA 36c0237View commit details -
SPARK-24251: Do not allow any missing fields.
Previously missing fields were allowed if the read type's corresponding field was optional.
Configuration menu - View commit details
-
Copy full SHA for e81790d - Browse repository at this point
Copy the full SHA e81790dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 42d86e1 - Browse repository at this point
Copy the full SHA 42d86e1View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.