End-to-end batch and streaming data pipeline on AWS to process user ratings and activity data. Leverages Amazon RDS, Glue, S3, Kinesis, and PostgreSQL with pgvector for real-time recommendation generation and model training.
aws aws-lambda terraform aws-s3 postgresql data-engineering aws-rds aws-kinesis-firehose aws-kinesis-stream aws-glue pg-vector
-
Updated
Oct 6, 2024 - HCL