Semijoin optimization/Magic sets - don't stream data that downstream [join] doesn't want #1381
MingweiSamuel
started this conversation in
Ideas
Replies: 1 comment
-
|
Thought: should be done in optimization in a higher layer, HF+ |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Right now we sorta assume that all surface syntax operators are eagerly evaluated - e.g. a
mapwill always see every input that is sent its way. However in some cases, e.g. when we have a join where one side is empty, we really dont need anything from the other side. How can we save the cost of evaluating that side?Beta Was this translation helpful? Give feedback.
All reactions