Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

1.8.0 #40

Merged
merged 445 commits into from
Sep 21, 2024
Merged

1.8.0 #40

merged 445 commits into from
Sep 21, 2024

Conversation

dqops
Copy link
Owner

@dqops dqops commented Sep 21, 2024

1.8.0

  • Small layout fixes in the UI, mostly related to the colors of issue severity colors
  • Documentation for the data quality process and rule mining
  • Duplicate record detection check
  • Some column-level checks fixed to skip NULL values, instead of treating them as invalid (not passing checks)
  • Store data lineage definition (links to source tables)
  • Default observability check patterns renamed to data quality policies
  • Default quality policy named "default" deleted, and replaced with multiple smaller policies to allow more control

Patryk Jatczak and others added 30 commits September 2, 2024 10:11
simplified the file name of downloaded error samples
57725ca
Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…
a340011 
…ti.io/_git/dqoado into feature/13015_To_simplify_the_name_of_CSV_download_file_of_the_error_samples
duplicate record percent sensors return percentage instead of 0 to 1 …
c56334d 
…value
merge
a70377e
setting the advanced properties in the column update spec method
c47db4e
@piotrczarnas
Merged PR 2984: simplified the file name of downloaded error samples
ace7348 
Related work items: #13015
@piotrczarnas
Merged PR 2985: fixed duplicate record percent sensors to return perc…
a6828d3 
…entage instead of 0 to 1 value

Related work items: #13049
@piotrczarnas
Merged PR 2986: Advanced properties for connection, table and column
efd9086 
Related work items: #12981
advanced properties is bold, import tables button position fixed, rem…
21d28c5 
…oved colons, download error samples button is disabled when no data
@piotrczarnas
Merged PR 2987: advanced properties is bold, import tables button pos…
7fa71cd 
…ition fixed, removed col...

- advanced properties is bold
- import tables button position fixed
- removed colons
- download error samples button is disabled when no data

Related work items: #13047
Removed colons from some labels in UI
f9502ba
Small changes in Rule mining filters tooltips
faec35c
Changes in rule mining documentation after small changes in Rule mini…
7986295 
…ng filters tooltips
Changes in rule mining documentation after small changes in Rule mini…
32d1ff3 
…ng filters tooltips
updated sensor template format check test
daa0626
Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…
f53e3df 
…ti.io/_git/dqoado into develop
sample data got row with null values with should not affect sensors w…
b3c40ec 
…hen are not bugged
updated sensors integration tests: added id column to datatype datase…
a7a3a9a 
…t, added null row to datasets used by pattens sensors
allow to receive nulls from error samples grouping values
7d1bfcd
reverted whitespace assert values, updated null test assertions to th…
5dda3a4 
…e new test data for previously not runnable error samples tests
@piotrczarnas
Documentation and python client regenerated
b3e700b
@piotrczarnas
Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…
d814fa1 
…ti.io/_git/dqoado into develop
@piotrczarnas
Report also the tenant group id in logs.
17a8504
@piotrczarnas
Rest api to list table data lineage on a table.
e01d640
fixed latitude and longitude sensors
73097c0
fixed datatype sensors error sampling - showing nulls in samples for …
4bcdbcb 
…bigquery and duckdb
fixed whitespace integration tests
f61c0bc
fixed sql server uuid sensor by inversion, excluded nulls from counting
36908d6
sqlserver and oracle whitespace sensors fixed
a471ef7
nulls excluded from pattern sensors
f39c0d8
Aleksy Lisowski and others added 29 commits September 18, 2024 10:50
@piotrczarnas
Merged PR 3029: 13185 improvements configuration section
139ef9b 
improvements configuration section
@psychologianauki
displaying delete data popup correctly
d620e86
@piotrczarnas
Merged PR 3030: 13120 displaying delete data popup correctly
c2513c2 
displaying delete data popup correctly
@psychologianauki
icons definition section
f21c2b4
@psychologianauki
Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…
56b09ad 
…ti.io/_git/dqoado into bug/13189_icons_user_list_patterns
@piotrczarnas
Merged PR 3031: 13189 icons definition section
6579b27 
icons definition section
@psychologianauki
displaying table quality status dimensions
e125668
Minor update in the Configuring data quality checks and rules section…
bc6535a 
… of the documentation
@psychologianauki
separated qualityDimensions to other component
821e2d0
@piotrczarnas
Table lineage cache that tracks upstream and downstream data lineage.
7f4fd8d
@piotrczarnas
Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…
d7e803c 
…ti.io/_git/dqoado into develop
@psychologianauki
Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…
23c14a8 
…ti.io/_git/dqoado into feature/13169_data_lineage_quality_status
@psychologianauki
source table quality status
d1581a9
@piotrczarnas
Merged PR 3032: table quality status dimensions data lineage
b9dec0c 
- displaying table quality status dimensions
- separated qualityDimensions to other component
- Merge branch 'develop' of https://dev.azure.com/imagetemplates/documati.io/_git/dqoado into feature/13169_data_lineage_quality_status
- source table quality status
@psychologianauki
unified size of buttons & button disabled color & added margin bottom…
d4b0116 
… to definition tree & resolved bug incident sextion
@psychologianauki
unified font size policy screen
248332d
@piotrczarnas
Merged PR 3033: 13201 unified size of buttons & button disabled color…
c359e76 
… & added margin bottom to defi...

unified size of buttons & button disabled color & added margin bottom to definition tree & resolved bug incident sextion
@piotrczarnas
Merged PR 3034: 13203 unified font size policy screen
4b7c46a 
unified font size policy screen
@psychologianauki
displaying target when switching tabs
9e80eb1
@psychologianauki
storing second level tab localstorage on definition patterns
ef0aa08
@piotrczarnas
Merged PR 3035: - displaying target when switching tabs - storing sec…
1c3e447 
…ond level tab localstorage on definition patterns

- displaying target when switching tabs
- storing second level tab localstorage on definition patterns
@piotrczarnas
Configure timestamp and ID columns when the statistics are collected …
12762bf 
…for the first time.
@piotrczarnas
T-student distribution used.
804d241
@psychologianauki
styled data lineage table
d44ccf3
@psychologianauki
decresed size of row data lineage
a3ee98a
@piotrczarnas
Merged PR 3036: 13211 styled data lineage table
77a00c0 
styled data lineage table
@piotrczarnas
Merge branch 'develop' of https://dev.azure.com/imagetemplates/documa…
13b9d91 
…ti.io/_git/dqoado into develop
@piotrczarnas
Proposal of a partition row count anomaly rule.
c9c1514
@piotrczarnas
Small layout improvements on the table lineage screen.
cb56339
@dqops dqops merged commit c29a9b3 into main Sep 21, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@dqops @piotrczarnas @psychologianauki