Releases: emory-libraries/dlp-curate
v0.4.23
v0.4.22
- Dynamically generate a list of singular fields used by the import mapper (#694)
Change rights_holders
mapping to be multi-valued
The field was incorrectly set as single valued in the mapper, but is
multi-valued in the model, see
https://github.com/emory-libraries/dlp-curate/blob/v0.4.20/app/models/curate_generic_work.rb#L227-L229
Dynamically generate a list of single-valued fields for the mapper
Rather than implementing a static list of single-value fields,
update the code to read the model configuration directly.
This prevents the mapper from inadvertently drifting out of
sync with the model if changes occur in the model.
- Updates preservation_event log creation (#686)
v0.4.21
v0.4.20
v0.4.19
v0.4.18
v0.4.17
v0.4.16
v0.4.15
- Add preprocessor for Langmuir collection CSV files (#667)
The preprocessor accepts existing Langmuir CSVs with one file per row and returns a new csv with each work and fileset in their own row.
All of the rows for a single work are grouped together
Each group begins with a row containing the work-level metadata
All files associated with a fileset are listed in the same row
Filesets are listed in sequence order and given appropriate labels
Blank lines in the source CSV are ignored
The preprocessor adds a deduplication_key field - Change Langmuir fileset labelling from 'Side #' to 'Image #' (#671)
- Adds preservation events (#659)
- Add update logic to ModularImporter (#670)
This continues the use of the decorator pattern to add the logic for the update options to the importer.
The import_langmuir_from_csv spec has been updated to test for each of the new conditions. - Add pull list mappings to the YellowbackPreprocessor (#662)
Adds the fields that map directly from the pull list to the final import manifest.
Some fields in the pull list like "CSV Call Number" are provided for reference only and will be mapped later from authoritative data in Alma records instead.
v0.4.14
-
Initial changes for preprocessed CSV (#654)
Adds logic for importing based on the new spreadsheet format inmodular_importer
. The changes mean that having logic in thehyrax_record_importer
isn't needed anymore.
This also changes theAttachFilesToWorkJob
to useordered_members
.
New specs have been added to cover the new functionality and specs that are no longer relevant have been deleted. -
Add the initial yellowback preprocessor framing (#653)
We've decided to keep the logic for collection specific processing separate from the importer. This lets us minimize collection-specific code in the CSV Importer.
The YellowbackPreprocessor will encapsulate all of the metadata and file processing rules specific to the Yellowback collection and output a csv manifest file suitable for ingest using the standard CSV Importer. -
Add deduplication key attribute (#660)
This is a system-style attribute that is only meant to be used by the importer to deduplicate rows. This will make it easier to know which records need to be updated or not when re-running imports. The existing dedup field will not be present in all collections, but this one will. -
Update langmuir_post_processing fixture (#661)
Addsdeduplication_key
header and values
Renamespreservation_master_file
header
Renamesintermediate_file
header
Renamesfileset_label
header -
Basic logging and details recording (#663)
This adds two modules which are used to add logging and recording of the csv import details based on the current status of the import. -
Add usage notes for additional system fields (#664)
-
Add multi-side langmuir (#666)
This alters the langmuir csv fixture to include multi-sided works and adds the images.
Specs have been adjusted so that they match the new count and test that sides are in the correct order.