Senior Generative AI Specialist – Prompt Reliability Program

TechFlow Inc

Contract · Remote · Flexible hours

About the role

TechFlow Inc is expanding its multi‑tenant AI platform to serve enterprise clients with customized content generation. As a Generative AI Specialist you will lead the design and delivery of a new tenant‑aware module called "NovaWriter" that integrates large language models into the existing B2B suite. The project focuses on scalable feature rollout, data isolation, and performance monitoring across dozens of corporate tenants.

Key responsibilities

• Architect and implement the NovaWriter microservice using FastAPI and Docker, ensuring tenant isolation at the API layer.
• Fine‑tune GPT‑4 based models on client‑specific corpora, leveraging Hugging Face Transformers and Azure ML.
• Develop automated CI/CD pipelines in GitHub Actions for model versioning, testing, and deployment.
• Create monitoring dashboards in Grafana to track latency, token usage, and cost per tenant.
• Collaborate with product managers to define milestone deliverables for each tenant rollout phase.
• Document API contracts and usage guides for internal engineering teams.

Must-have skills

• Deep experience with large language models (GPT‑4, LLaMA) and prompt engineering.
• Proficiency in Python, FastAPI, and containerization (Docker, Kubernetes).
• Strong knowledge of RESTful API design and multi‑tenant architecture.
• Hands‑on experience with MLOps tools such as MLflow, Azure ML, or SageMaker.
• Ability to write clear technical documentation and API specs.

Nice to have

• Familiarity with vector databases (Pinecone, Weaviate) for semantic search.
• Experience integrating security standards like OAuth2 and JWT for tenant authentication.