Lead Big Data Architect – Query Optimization

CoreData Systems

Contract · Flexible hours

About the role

CoreData Systems is expanding its data platform to support massive, real‑time analytics. As a Big Data Architect you will design and implement end‑to‑end pipelines that ingest, process, and store petabyte‑scale datasets.

Key responsibilities

• Architect scalable data lake and warehouse solutions on AWS.
• Design data models and schema evolution strategies for structured and semi‑structured data.
• Lead implementation of ETL/ELT workflows using Python and containerized services.
• Establish best practices for data governance, security, and performance tuning.
• Collaborate with data scientists and engineers to ensure data availability for analytics.
• Mentor junior team members and review code for quality and compliance.

Must-have skills

• Deep expertise in big data architecture and cloud data services.
• Proficient in Python for data processing and automation.
• Strong experience with PostgreSQL and relational data modeling.
• Hands‑on knowledge of AWS services (S3, Redshift, Glue, EMR).
• Containerization using Docker and orchestration concepts.

Nice to have

• Familiarity with streaming platforms such as Kafka.
• Experience with infrastructure as code tools (Terraform, CloudFormation).