Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make analysis workflow work #1847

Merged
merged 4 commits into from
Sep 17, 2024
Merged

make analysis workflow work #1847

merged 4 commits into from
Sep 17, 2024

Conversation

samussiah
Copy link
Contributor

@samussiah samussiah commented Sep 17, 2024

Overview

Updates the analyze workflow to run on the output of the map workflow. The intent is to allow each of the numbered workflows to run on the output of the previous workflow without any additional variables. One design principle that I'm following is each input to the mapped, analysis, and reporting layers should correspond to a data frame rather than a list of data frames, to align with a database and/or flat file data model.

Test Notes/Sample Code

load_all()

lSourceData <- list(
    Source_STUDY = clindata::ctms_study,
    Source_SITE = clindata::ctms_site,
    Source_SUBJ = clindata::rawplus_dm,
    Source_AE = clindata::rawplus_ae,
    Source_PD = clindata::ctms_protdev,
    Source_LB = clindata::rawplus_lb,
    Source_STUDCOMP = clindata::rawplus_studcomp,
    Source_SDRGCOMP = clindata::rawplus_sdrgcomp,
    Source_QUERY = clindata::edc_queries,
    Source_DATAENT = clindata::edc_data_pages,
    Source_DATACHG = clindata::edc_data_points,
    Source_ENROLL = clindata::rawplus_enroll
)

lIngestWorkflow <- MakeWorkflowList('ingest')[[1]]
lRawData <- Ingest(lSourceData, lIngestWorkflow$spec)

lMapWorkflow <- MakeWorkflowList('map')[[1]]
lMappedData <- RunWorkflow(lMapWorkflow, lRawData)

lAnalyzeWorkflow <- MakeWorkflowList('analyze')[[1]]
lAnalysisData <- RunWorkflow(lAnalyzeWorkflow, lMappedData)

lReportingWorkflow <- MakeWorkflowList('reporting')[[1]]
lReportingData <- RunWorkflow(lReportingWorkflow, lAnalysisData)

lKRIReportBySiteWorkflow <- MakeWorkflowList(strPath = 'workflow/modules')[[2]]
lKRIReportBYSite <- RunWorkflow(lKRIReportBySiteWorkflow, lReportingData)

lKRIReportByCountryWorkflow <- MakeWorkflowList(strPath = 'workflow/modules')[[1]]
lKRIReportBYCountry <- RunWorkflow(lKRIReportByCountryWorkflow, lReportingData)

Connected Issues

  • Closes #XXX

Copy link
Contributor

@jwildfire jwildfire left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense. merging to ingest.

@jwildfire jwildfire merged commit f4c03d6 into ingest Sep 17, 2024
@lauramaxwell lauramaxwell deleted the workflow-tweaks branch November 15, 2024 16:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants