Lead Big Data Architect for ETL Workflow Build

DataPro Services

Contract · Flexible hours

About the role

DataPro Services is seeking an experienced Big Data Architect to design and implement a scalable data platform for a high‑volume analytics project. You will lead the end‑to‑end architecture, ensuring data reliability, performance, and security across the pipeline.

Key responsibilities

• Define the overall big‑data architecture, including data ingestion, storage, processing, and visualization layers.
• Design and optimize data models in PostgreSQL and data lakes on AWS.
• Implement real‑time streaming solutions using Apache Kafka or similar technologies.
• Develop CI/CD pipelines with Docker and Terraform for reproducible deployments.
• Collaborate with data scientists and engineers to translate business requirements into technical solutions.
• Establish data governance, security policies, and monitoring frameworks.

Must-have skills

• Deep expertise in big‑data technologies (Spark, Hadoop, Kafka).
• Strong experience with AWS services (S3, Redshift, EMR).
• Proficiency in Python for data processing and automation.
• Advanced SQL skills with PostgreSQL.
• Containerization using Docker and orchestration knowledge.

Nice to have

• Familiarity with Terraform or CloudFormation.
• Experience with machine‑learning pipelines.