Senior CI/CD Pipeline Engineer for Multi-Region Infrastructure Automation

Northbay Systems

Freelance · Remote · Flexible hours

About the role

Northbay Systems is launching a data pipeline and analytics enablement project for its operations teams. We need a CI/CD Pipeline Engineer to design, implement, and automate end‑to‑end delivery of data processing workflows.

Key responsibilities

• Architect and build CI/CD pipelines for data ingestion, transformation, and reporting services.
• Integrate version control, automated testing, and container orchestration into the workflow.
• Collaborate with data engineers and analysts to ensure pipelines meet reliability and performance targets.
• Implement monitoring, logging, and rollback mechanisms for production stability.
• Document pipeline design, standards, and hand‑off procedures.

Must-have skills

• Proven experience building CI/CD pipelines for data‑centric applications.
• Strong knowledge of Docker, Kubernetes, and AWS services (ECR, EKS, S3, Lambda).
• Hands‑on expertise with Git, Terraform or CloudFormation, and automated testing frameworks.
• Ability to troubleshoot pipeline failures and optimize performance.

Nice to have

• Familiarity with Apache Airflow, Prefect, or similar orchestration tools.
• Experience with data lake or warehouse technologies (Redshift, Snowflake).
• Background in scripting languages such as Python or Bash.