Skip to content
View BogdanGeorgeDinu's full-sized avatar

Block or report BogdanGeorgeDinu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
BogdanGeorgeDinu/README.md

George Bogdan Dinu

Data and Cloud Engineer. AWS Solutions Architect Associate. Madrid, Spain — open to relocation within the EU.

I build data pipelines meant to survive production: everything as code, least-privilege IAM, data quality enforced at the source, and cost accounted for at design time instead of discovered on the invoice.


Building in public

caudalit-pipeline — an end-to-end AWS data pipeline, published one phase at a time, with the code and the reasoning behind each decision.

It answers a specific question: how much does Spanish peninsular electricity demand rise per degree of temperature, and at what hours is that energy most expensive?

Lambda → S3 raw → Glue + PySpark → partitioned Parquet → Glue Data Catalog → Athena, orchestrated with Step Functions, all defined in Terraform with remote state and locking.

Four decisions worth reading if you are evaluating how I work:

  • The upstream REE API returns intermittent 400s on well-formed requests. Ingestion was designed around retries with exponential backoff from the start, not patched afterwards.
  • Raw responses land in S3 untouched, so reprocessing never depends again on an API already known to be unreliable.
  • Parquet partitioned by date, because Athena bills per terabyte scanned.
  • A budget with alerts exists before the first resource is created.

Every phase carries its architecture decisions in docs/.


Also here

Proyecto_3_capas — three-tier web architecture on AWS in Terraform: VPC with public and private subnets, Application Load Balancer, Auto Scaling across two availability zones, RDS, and security groups scoped per layer.


Stack

Cloud AWS — S3, Lambda, Glue, Athena, Step Functions, EC2, RDS, VPC, IAM, CloudWatch
Infrastructure as code Terraform, GitHub Actions
Data Python, PySpark, SQL, Parquet
Security IAM least privilege, KMS, SSM Parameter Store, ISO 27001 and NIS2 aligned

Background

A year at Mapfre building and operating data infrastructure in an enterprise insurance environment, where traceability and compliance are not optional extras.

Languages: Spanish, Romanian and English.


caudalit.com · LinkedIn · hola@caudalit.com

Popular repositories Loading

  1. Proyecto_3_capas Proyecto_3_capas Public

    Three-tier web architecture on AWS with Terraform: private subnets, Multi-AZ Auto Scaling, RDS with the master password managed in Secrets Manager, and Session Manager instead of SSH.

    HCL 1

  2. caudalit-pipeline caudalit-pipeline Public

    Pipeline de datos end-to-end en AWS: demanda eléctrica × temperatura, hora a hora. Terraform, Glue, PySpark, Athena y Step Functions.

    Python

  3. BogdanGeorgeDinu BogdanGeorgeDinu Public