Prompt Engineer – Pipeline Automation

BlueSky Ventures

Contract · Flexible hours

About the role

We are seeking a Prompt Engineer to help shape our next-generation AI product. You will work closely with data scientists and product managers to design, test, and refine prompts that drive high‑quality outputs from large language models.

Key responsibilities

• Craft and iterate prompts for generative AI applications.
• Analyze model responses and adjust prompts for accuracy and relevance.
• Collaborate with engineering to integrate prompts into APIs.
• Document prompt patterns, best practices, and versioning.
• Conduct A/B testing to measure prompt performance.
• Stay updated on LLM advancements and incorporate new techniques.

Must-have skills

• Strong experience with prompt engineering for LLMs.
• Proficiency in Python and JavaScript.
• Understanding of REST API integration.
• Ability to evaluate and fine‑tune model outputs.
• Excellent analytical and problem‑solving skills.

Nice to have

• Familiarity with NLP evaluation metrics.
• Experience with AI product lifecycle management.