Release of version v1.5.0
We are thrilled to announce the fifth major release of the first version of Cortex Data Framework, a comprehensive and robust platform designed to redefine how developers approach real-time data streaming, processing, and state management. With this release, Cortex empowers you to build scalable, high-performance, and maintainable data pipelines tailored to diverse use cases.
🎉 What's Changed
- Add CDC Sink Operator for ElasticSearch [Cortex.Streams];
- Add OneOf keyword [Cortex.Types];
- Add AnyOf keyword [Cortex.Types];
- Add AllOf keyword [Cortex.Types];
📚 Documentation & Examples
Get started quickly with the comprehensive Cortex Documentation. Examples include:
- Setting up pipelines.
- Using windowing for temporal analysis.
- Building custom operators.
🛠 Developer Highlights
1. Simple Stream Builder API:
- Example:
var stream = StreamBuilder<int, int>
.CreateNewStream("MyStream")
.Stream()
.Map(x => x * 2)
.Filter(x => x > 10)
.Sink(Console.WriteLine)
.Build();
stream.Start();
2. Dynamic State Stores:
- Use
InMemoryStateStore
orRocksDbStateStore
with a single line of code. - Built-in thread-safety for multi-tenant applications.
3. Customizable Metrics:
Add telemetry to monitor every operator and capture real-time performance metrics.
🚧 Known Issues
- Initial setups may experience minor configuration hurdles with telemetry providers. Please refer to the documentation for troubleshooting.
- Memory usage for large datasets may increase when using in-memory state stores.
💌 Thanks for Being a Part of the Journey
We are excited to see the amazing projects you will build with Cortex Data Framework! Your feedback is invaluable—reach out to us via GitHub Issues or email for support and suggestions.
Stay Connected
Follow our progress and contribute:
GitHub: Cortex Repository
Discussions: Community Forum
Join our community in Discord:
Here’s to building better, faster, and more scalable data-driven applications. 🚀