Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: Generate SQL with fewer CTEs #877

Merged
merged 8 commits into from
Aug 6, 2024
Merged

perf: Generate SQL with fewer CTEs #877

merged 8 commits into from
Aug 6, 2024

Conversation

TrevorBergeron
Copy link
Contributor

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@product-auto-label product-auto-label bot added size: m Pull request size is medium. api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. labels Aug 1, 2024
@TrevorBergeron TrevorBergeron requested a review from tswast August 1, 2024 22:34
@TrevorBergeron TrevorBergeron marked this pull request as ready for review August 1, 2024 22:34
@TrevorBergeron TrevorBergeron requested review from a team as code owners August 1, 2024 22:34
bigframes/core/compile/compiled.py Show resolved Hide resolved
bigframes/core/compile/compiled.py Show resolved Hide resolved
bigframes/core/compile/compiled.py Show resolved Hide resolved
@@ -1034,6 +1057,9 @@ def _to_ibis_expr(
return table

def filter(self, predicate: ex.Expression) -> OrderedIR:
if any(map(is_window, map(self._get_ibis_column, predicate.unbound_variables))):
# ibis doesn't support qualify syntax
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Might be worth an issue, too. I think there is some support in ibis for having, for example (though it's not really possible with the pandas API) if I remember correctly from my work on F1. https://ibis-project.org/tutorials/ibis-for-sql-users#having-clause

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

created bug and referenced in comment

@TrevorBergeron TrevorBergeron merged commit eb60804 into main Aug 6, 2024
22 of 23 checks passed
@TrevorBergeron TrevorBergeron deleted the defer_reproject branch August 6, 2024 22:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. size: m Pull request size is medium.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants