Releases · all-of-us/curation

What's Changed

[DC-3601] Refactor uses of bq_utils.py get_hpo_bucket_info function by @lledezma in #1815
[DC-3602] Refactor uses of bq_utils.py get_hpo_site_state_info function by @lledezma in #1818
[DC-3513] Update the raw_fitbit_qc.py - sleep_level - level check by @lledezma in #1821
[DC-3649] Update CT notebook 10 to use updated site_maskings location by @ratuagga in #1828
[DC-3647] Update repopulate person post deid CR to account for custom concept by @ratuagga in #1832
[DC-3648] Ignore death table from QC check and use AOU Death by @ratuagga in #1831
[DC-3645] Update Union QC notebook with fixes for column name and moving notes check by @ratuagga in #1830
[DC-3646] Update git tag function to sort by version correctly by @ratuagga in #1829
[DC-3633] Add a check to the raw and clean rdr qc notebooks for the presence of row duplicates by @brendagutman in #1826
[DC-3653] Integration Test fix for Parent ticket by @ratuagga in #1836
[DC-3629] Add the wear_study percentage with fitbit data check by @brendagutman in #1833
[DC-3635] Remove portion of query checking primary consent by @dev-michael-schmidt in #1834
[DC-3631] Update cope_survey to reduce false positive results due to concept domains by @dev-michael-schmidt in #1827
[DC-3658] Update Participant Validation QC check for excluded sites by @ratuagga in #1840
[DC-3659] Update check controlled tier part 2 to include standard classifications by @ratuagga in #1839
[DC-3650] Include PII Validation in Snapshot script by @ratuagga in #1837
[DC-3651] Fix Combined Backup script for git_version by @ratuagga in #1835
[DC-3333] Python 3.11 upgrade by @hiro-mishima in #1798
[DC-3660] Update Combined QC notebook to include CE by @ratuagga in #1838
[DC-3673] Remove notebook check regarding cause_source_concept_id for aou_death by @dev-michael-schmidt in #1845
[DC-3661] Update fitbit_qc parameters and descriptions by @brendagutman in #1843
[DC-3668] Ignore race/ethnicity sub categories in ct notebook by @brendagutman in #1846
[DC-3632] Remove irrelevant bq_utils import statements by @dev-michael-schmidt in #1841
[DC-3642] Remove depreciated function bq_utils.create_snapshot_dataset() from project by @dev-michael-schmidt in #1848
[DC-3641] Remove function query_sheet_linked_bq_table and associated test by @dev-michael-schmidt in #1847
[DC-3731] [DC-3740] [DC3741] Updates to the combined cross tier and controlled tier notebooks by @brendagutman in #1852
[DC-3767] Fix for Circle CI linux deprecating images other than current by @nishanthpp93 in #1856
[DC-3749] Create additional privacy concept suppression CR with list provided by privacy for CT and RT by @nishanthpp93 in #1855
[DC-3769] Use rewrite instead of copy by @hiro-mishima in #1857
[DC-3729] Generate derived tables by @ratuagga in #1854
[DC-3779] Add aou_death to EhrSubmissionDataCutoff by @hiro-mishima in #1859
[DC-3772] Add publicly reported concepts to suppression by @nishanthpp93 in #1858
[DC-3233] AbstractBqLookupTableConceptSuppression is leaving a dirty integration test environment by @ratuagga in #1853
[DC-3785] Update person_ext schema to include self_reported_population by @nishanthpp93 in #1861
[DC-3786] [DC-3788] Add self reported population columns by @nishanthpp93 in #1862
[DC-000] dl-504 Add the new NPH suppression cleaning rule by @brendagutman in #1866
[DC-3787] Add a check for person_ext field self reported populations by @brendagutman in #1863
[DC-3789] Add or edit queries for self reported population in the clean and output notebooks by @brendagutman in #1864
[DC-3780] Accept EHR files as Parquet by @nishanthpp93 in #1860
[DC-3793] Update self_reported_population to self_reported_category by @nishanthpp93 in #1868
[DC-3812] v3-v7 CDR IDA by @nishanthpp93 in #1869
[DC-3853] Update table in Zip cleaning rule by @nishanthpp93 in #1870
[DC-3852] Allow null yob in person by @nishanthpp93 in #1871
[DC-3855] Unsuppress COVID question from V3-V7 IDA in CT by @nishanthpp93 in #1873
[DC-3856] Allow State info for AIAN participants by @nishanthpp93 in #1872