Lead Big Data Architect Needed for Data Pipeline Build

AlphaEdge Tech

Contract · Flexible hours

About the role

AlphaEdge Tech is building a next‑generation analytics platform to ingest, process, and serve massive data streams. We need a Big Data Architect to design end‑to‑end data pipelines, define storage strategies, and ensure scalable performance across cloud environments.

Key responsibilities

• Design and implement robust data lake and warehouse architectures on AWS.
• Develop real‑time ingestion pipelines using Apache Spark and Kafka.
• Create data models and schemas that support analytical workloads.
• Define data governance, security, and compliance standards.
• Optimize query performance and cost efficiency.
• Mentor junior engineers and enforce best coding practices.

Must-have skills

• Deep expertise in Python for data processing.
• Strong experience with PostgreSQL and large‑scale relational workloads.
• Proficiency in AWS services (S3, Redshift, EMR, Glue).
• Hands‑on Docker containerization for development and deployment.
• Extensive background in designing distributed big data systems.

Nice to have

• Familiarity with Terraform or CloudFormation for infrastructure as code.
• Experience with machine‑learning pipelines and model serving.