Senior Platform Engineer for CI/CD Pipeline Setup

Silverline Labs

Contract · Remote · Flexible hours

About the role

Silverline Labs is building a next‑generation analytics backbone for its operations teams. As a Platform Engineer you will own the design and delivery of a scalable data pipeline that feeds real‑time metrics into our internal dashboard suite, codenamed "FluxStream". The work focuses on enabling rapid insight generation while maintaining high reliability and security.

Key responsibilities

• Architect and implement a Kafka‑based ingestion layer on AWS using Terraform for IaC.
• Develop CI/CD pipelines in GitHub Actions to automate testing, containerization, and deployment of Spark jobs.
• Containerize data transformation services with Docker and orchestrate them on an EKS cluster, ensuring zero‑downtime rollouts.
• Integrate monitoring via Prometheus and Grafana, setting alerts for latency and failure thresholds.
• Collaborate with data scientists to provision secure S3 data lakes and enforce fine‑grained IAM policies.
• Deliver a hand‑off document and runbook for operations teams by the end of the 12‑week sprint.

Must-have skills

• 5+ years experience in platform engineering or DevOps.
• Strong proficiency with AWS services (EKS, S3, IAM, CloudWatch).
• Hands‑on expertise in Docker, Kubernetes, and Terraform.
• Solid background in building CI/CD pipelines for data workloads.
• Experience with streaming technologies such as Kafka or Kinesis.

Nice to have

• Familiarity with Apache Spark or Flink.
• Knowledge of data governance frameworks.