-
Notifications
You must be signed in to change notification settings - Fork 550
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Handling fixed column relationships by specific_combinations
and SpecificCombinationTransformer
.
#236
Conversation
…and allow for a choice to run one of them during execution. By default, if no columns are specified, use the FixedCombinationTransformer.
…ce for `reverse_convert()` by random choice column mapping data.
Do we really need to distinguish between |
@Wh1isper Yes we need. Currently, the consideration is that when the shape of the data does not meet expectations, it can be determined from the logs what caused the lack of transformation; on the other hand, there may be other combinations in the future, and different scenarios may have different logic. |
Codecov ReportAttention: Patch coverage is
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #236 +/- ##
==========================================
+ Coverage 82.17% 82.75% +0.57%
==========================================
Files 84 88 +4
Lines 4146 4470 +324
==========================================
+ Hits 3407 3699 +292
- Misses 739 771 +32 ☔ View full report in Codecov by Sentry. |
@jalr4ever Ok and I suggest replace Like this: @property
def is_exist_fixed_combinations(self) -> bool:
return bool(self.is_exist_fixed_combinations) Then we can reduce the code in |
Co-authored-by: Zhongsheng Ji <9573586@qq.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Description
I haved added a new
SpecificCombinationTransformer
, and modifedFixedCombinationTransformer
. And a test case forSpecificCombinationTransformer
.Motivation and Context
SpecificCombinationTransformer
would transforming when user specified some column-mapping combination, andFixedCombinationTransformer
would not running at the same time.I make
FixedCombinationTransformer
as default column-mapping combination detector and transformer.As forSpecificCombinationTransformer
, it would transforming when user specified some column-mapping combinations, make sure the sample data column-mapping adhere to the specified combinations. At the same time,FixedCombinationTransformer
would not run transforming whenSpecificCombinationTransformer
activated.How has this been tested?
See test case.
Types of changes
Checklist: