feat(data-classes): add KafkaEvent and KafkaEventRecord

[lyoung-confluent]

Issue number: #1484

Summary

This change adds a data class for Kafka event sources either from self-managed Apache Kafka or Amazon MSK.

Changes

A new data class KafkaEvent is introduced which includes a records property/generator. The returned KafkaEventRecord class has a variety of useful properties for decoding the record key, value and headers.

User experience

from aws_lambda_powertools.utilities.data_classes import event_source, KafkaEvent

@event_source(data_class=KafkaEvent)
def handler(event: KafkaEvent, context: LambdaContext):
	for record in event.records:
		print(record.decoded_key, record.json_value)

Checklist

If your change doesn't seem to apply, please leave them unchecked.

• Meet tenets criteria
• I have performed a self-review of this change
• Changes have been tested
• Changes are documented
• PR title follows conventional commit semantics

Is this a breaking change?

Not a breaking change

RFC issue number: ?

Checklist:

• Migration process documented
• Implement warnings (if it can live side by side)

Acknowledgment

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

---

View rendered docs/utilities/data_classes.md

[boring-cyborg]

Thanks a lot for your first contribution! Please check out our contributing guidelines and don't hesitate to ask whatever you need.

[leandrodamascena]

Hi @lyoung-confluent! Indeed this is an awesome PR! Thanks a lot for taking the time to help improve the project! 🥇

I'm going to start doing a review on this PR today and let you know if we need to make some small changes.

[leandrodamascena]

Hello @lyoung-confluent! I suggested some changes in this PR.

[codecov-commenter]

Codecov Report

Merging #1485 (bd9c8a6) into develop (2cf38cc) will decrease coverage by 0.40%.
The diff coverage is 92.85%.

@@             Coverage Diff             @@
##           develop    #1485      +/-   ##
===========================================
- Coverage    99.89%   99.48%   -0.41%     
===========================================
  Files          124      126       +2     
  Lines         5588     5672      +84     
  Branches       634      661      +27     
===========================================
+ Hits          5582     5643      +61     
- Misses           2       14      +12     
- Partials         4       15      +11     

Impacted Files	Coverage Δ
...a_powertools/utilities/data_classes/kafka_event.py	92.75% <92.75%> (ø)
...mbda_powertools/utilities/data_classes/__init__.py	100.00% <100.00%> (ø)
...bda_powertools/utilities/data_classes/alb_event.py	90.47% <0.00%> (-9.53%)	⬇️
aws_lambda_powertools/__init__.py	100.00% <0.00%> (ø)
aws_lambda_powertools/utilities/batch/__init__.py	100.00% <0.00%> (ø)
aws_lambda_powertools/event_handler/api_gateway.py	100.00% <0.00%> (ø)
...ws_lambda_powertools/utilities/batch/exceptions.py	100.00% <0.00%> (ø)
...lambda_powertools/utilities/data_classes/common.py	100.00% <0.00%> (ø)
.../utilities/data_classes/api_gateway_proxy_event.py	100.00% <0.00%> (ø)
aws_lambda_powertools/utilities/batch/sqs.py
... and 2 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[leandrodamascena]

Hey @lyoung-confluent. I split the tests into 2 to make it clearer what is being tested and added 1 more field to test the bootstrapserver as a raw string. I think it's good for me to merge. Do you have any more considerations?

🚀 ✈️

[lyoung-confluent]

Looks good to me, thanks for the quick feedback/review @leandrodamascena!

[boring-cyborg]

Awesome work, congrats on your first merged pull request and thank you for helping improve everyone's experience!