Senior Data Engineer Needed for ETL Workflow Build

Silverline Labs

Contract · Remote · Flexible hours

About the role

Silverline Labs is building a unified data backbone to streamline revenue operations. As a Senior Data Engineer you will lead the integration of the new "BillingSync" module, linking our billing platform, CRM, and internal micro‑services APIs. The project aims to deliver a real‑time data lake that powers analytics and automated invoicing.

Key responsibilities

• Design and implement ETL pipelines in Python using Airflow to extract billing transactions, CRM leads, and API logs.
• Create a scalable PostgreSQL data warehouse on AWS Redshift, modeling schemas for cross‑system reporting.
• Develop CDC (Change Data Capture) mechanisms with Debezium to sync MySQL source tables in near real‑time.
• Write automated data validation tests in Great Expectations and set up monitoring dashboards in CloudWatch.
• Collaborate with backend engineers to expose RESTful data services for internal dashboards.
• Deliver a proof‑of‑concept integration within the first six weeks and document all data flows.

Must-have skills

• Advanced Python for data pipelines and scripting.
• Strong experience with PostgreSQL and MySQL database design.
• Proficiency in AWS services (S3, Redshift, Lambda, CloudWatch).
• Hands‑on with Airflow, DBT, or similar orchestration tools.
• Understanding of API integration patterns and data modeling.

Nice to have

• Familiarity with Kafka or Kinesis for streaming data.
• Experience building data catalogs with AWS Glue.