Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Base Process Patterns #1

Merged
merged 4 commits into from
Dec 21, 2022
Merged

Base Process Patterns #1

merged 4 commits into from
Dec 21, 2022

Conversation

rleeson
Copy link
Contributor

@rleeson rleeson commented Dec 21, 2022

Description

As a developer, I need to import and manage site content changes from external sources in a repeatable, reliable manner, with a clear process to manage new, changed, and missing content, and potentially split across multiple batches for large, resource intensive content.

Approach and Changes

  • Implement a set of base classes which add on to the previous with additional capabilities for the following Recurring import scenarios: Update, Destructive Update which prunes entities missing from the Import, and Batched Destructive Update which spans a large import of smaller batches
  • New IBatchProcess and IDryRun interfaces to optionally add-on support Batched and Test/Dry Run Processes
  • Add Stream and Process statistics models to help track, audit, and/or report the results of different processes
  • Segment some Data and Process models into sub-namespaces for organization

- Adds Update, Destructive Update, and Batched Processes
- Move Stream and Process models into separate namespaces
@rleeson rleeson changed the title Feature/batchprocessing Base Process Patterns Dec 21, 2022
@rleeson rleeson merged commit 3aa8d52 into main Dec 21, 2022
@rleeson rleeson deleted the feature/batchprocessing branch December 21, 2022 18:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

1 participant