RAD-151: L2 and L3 catalog and segmentation map schemas

[nden]

Resolves RAD-151

Closes #377

This PR includes and expands Brett's code in #374.
It adds schemas for Level 2 and Level 3 segmentation maps and source catalog.
This may change as metadata gets finalized by RTB.

Checklist

• Schema changes discussed at RAD Review Board meeting
• Added entry in CHANGES.rst under the corresponding subsection
• Updated relevant roman_datamodels utilities and tests
• Passed romancal regression testing on Jenkins / PLWishMaster. Link: https://plwishmaster.stsci.edu:8081/job/RT/job/romancal/XXX/

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.38%. Comparing base (0fb1239) to head (a5384b6).
Report is 13 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #393   +/-   ##
=======================================
  Coverage   95.38%   95.38%           
=======================================
  Files           4        4           
  Lines         195      195           
=======================================
  Hits          186      186           
  Misses          9        9           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[nden]

I need to think of the best way to include the two time attributed to the level 2 catalogs and then I'll add them (one option is to add the entire exposure schema, though an overkill at the moment, it may end up being simpler after the L1/L2 metadata review). But meanwhile, since all other comments were addressed, I'll open it for a review, particularly to the SDP team, if anything needs to be added to the archive_catalog field in those schemas.

[jbrookens]

@nden regarding the archive destinations, please follow this design:

For all keywords in basic, program, and mosaic_basic, add 2 new tables “SourceCatalog” and “SegmentationMap” to the destination (with the same field name as the others).
For all keywords in photometry, add a new table “SourceCatalog” to the destination.

And if L2 files will also generate source catalogs and segmentation maps:

For all keywords in visit, add 2 new tables “SourceCatalog” and “SegmentationMap” to the destination.
For all keywords in exposure, add a new table “SourceCatalog” to the destination.

[nden]

@jbrookens Sounds good. Thanks for the fast decision!

[kdupriestsci]

I noticed you didn't make any updates to exposure-1.0.0.yaml Does that mean it should be removed from this file?

[kdupriestsci]

I noticed you didn't make any updates to visit-1.0.0.yaml Does that mean it should be removed from this file?

[nden]

@kdupriestsci @jbrookens Sorry, my previous commit was incomplete. I now got confirmation we will need L2 catalogs and I'll make all changes shortly.

[nden]

@PaulHuwe @kdupriestsci @jbrookens This is ready now for a final review.

[jbrookens]

I believe exposure should just be SourceCatalog, not SegmentationMap. My suggestion for L2 was:

And if L2 files will also generate source catalogs and segmentation maps:

For all keywords in visit, add 2 new tables “SourceCatalog” and “SegmentationMap” to the destination.
For all keywords in exposure, add a new table “SourceCatalog” to the destination.

[nden]

Aargh, my bad. Fixed now. Thanks.

[PaulHuwe]

LGTM