Senior DevOps Engineer for High-Volume Container Platform Build

TechFlow Inc

Freelance · Remote · Flexible hours

About the role

We are creating a robust data pipeline to empower operations teams with real‑time analytics. The DevOps Engineer will design, implement, and automate the end‑to‑end flow from ingestion to visualization, ensuring reliability and scalability.

Key responsibilities

• Architect and provision AWS resources for data ingestion, processing, and storage
• Containerize ETL jobs using Docker and orchestrate them with Kubernetes
• Build CI/CD pipelines that test, build, and deploy pipeline components automatically
• Implement monitoring, logging, and alerting for pipeline health
• Collaborate with data analysts to refine data models and performance metrics

Must-have skills

• Strong experience with AWS services (S3, Lambda, Glue, Redshift)
• Proficiency in Docker and Kubernetes for scalable workloads
• Hands‑on CI/CD implementation using tools like Jenkins, GitLab CI, or GitHub Actions
• Solid scripting skills (Python, Bash) for automation

Nice to have

• Familiarity with Apache Airflow or similar workflow managers
• Knowledge of data streaming platforms such as Kafka
• Experience with infrastructure as code (Terraform, CloudFormation)