Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Standardise event-schema.json #2

Merged
merged 2 commits into from
Apr 21, 2022
Merged

Standardise event-schema.json #2

merged 2 commits into from
Apr 21, 2022

Conversation

duncanjbrown
Copy link
Contributor

@duncanjbrown duncanjbrown commented Apr 21, 2022

This is now one-size-fits-all for BAT services. It has some extra Apply-only bits (ie namespace) — we can tidy that up if we ever want to.

As schemas in BQ might lack fields we now send, this PR adds ignore_unknown to the inserts, which makes the client silently drop fields instead of throwing exceptions. If and when schemas are standardised in BQ (we can in fact generate BQ schemas from the JSON) we can tighten this up again.

This means that if a schema in BQ lacks a field in our schema, it won’t
cause an exception and the (presumably blank) field will just be dropped
@duncanjbrown duncanjbrown merged commit 53efa7b into main Apr 21, 2022
@duncanjbrown duncanjbrown deleted the update-schema branch April 21, 2022 15:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants