Conversation Quality Specialist
Posted 16 days ago · 26 applicants
Saving, applying or scoring takes a few seconds to set up your free account.
The role in plain words
This role involves designing, editing, and optimizing prompts, scripts, and dialogue flows to ensure natural and engaging AI-driven conversations. You will evaluate real user-AI interactions, develop quality metrics, and collaborate with product, sales, and NLP teams to improve the platform's conversational experiences. Additionally, you will support demo creation and oversee multilingual rollouts.
- Native-level fluency in spoken English with exceptional writing and editing skills, including tone, grammar, and clarity
- Familiarity with prompt engineering and LLM behavior optimization
- Strong cross-functional communication skills with the ability to collaborate across product, engineering, sales, and marketing
- Experience designing and executing data-driven experiments to evaluate AI or conversation quality
- Bachelor’s degree in a relevant field (e.g., Linguistics, Philosophy, Human-Computer Interaction, or quantitative discipline)
- Experience in conversation design, content strategy, UX writing, or similar roles in the AI/chatbot/virtual assistant space
- Hands-on experience with SQL for data analysis and experimentation
- Experience localizing or adapting conversational AI across multiple languages and cultural contexts
Extracted from the job description · kept up to date automatically
Who this suits
This role suits individuals with native-level spoken English, strong writing skills, and familiarity with prompt engineering and LLM behavior optimization. It is less ideal for those without a relevant bachelor's degree or those who lack experience in designing data-driven experiments to evaluate AI quality.
Full job description
Original listing · kept for referenceLocation: Tel-Aviv
Team: Product
Type: Full-time
At Second Nature, we’re transforming the way companies train their teams using conversational AI. Our platform leverages advanced speech processing and generative AI to deliver immersive, role-play-based training that feels like the real thing. Leading global organizations trust us to elevate sales, customer service, and support training through dynamic, lifelike virtual conversations.
We’re seeking a Conversational Quality Specialist to help shape and continuously improve voice-based experiences across our platform. This role sits at the intersection of conversation design, AI interaction quality, and cross-functional collaboration. You'll work with product, sales, marketing, and NLP teams to ensure our AI conversations are effective, natural, and engaging.
What You’ll Do
Design Engaging Interactions
Create, edit, and optimize prompts, scripts, and dialogue flows that feel intuitive, realistic, and aligned with human communication patterns.
Enhance Demo Experiences
Collaborate with sales and marketing to craft compelling demo conversations that showcase the power of our AI.
Evaluate Conversation Quality
Review real user-AI conversations to assess performance, highlight successes, and uncover improvement opportunities for our core conversation engine.
Define Quality Metrics
Develop and implement conversation quality frameworks and metrics to evaluate effectiveness, user engagement, and learning outcomes.
Support Multi-Language Rollout
Oversee and advise on multilingual implementation to ensure high-quality experiences across regions.
Stay Ahead of the Curve
Keep up with best practices in conversation design, LLM-native UX, voice AI trends, animated avatars, user interaction models and any new technology that is expected in conversations.
What You Bring
• Native-level fluency in spoken English with exceptional writing and editing skills, including tone, grammar, and clarity.
• Familiarity with prompt engineering and LLM behavior optimization.
• Strong cross-functional communication skills with the ability to collaborate across product, engineering, sales, and marketing.
• Experience designing and executing data-driven experiments to evaluate AI or conversation quality.
• Bachelor’s degree in a relevant field (e.g., Linguistics, Philosophy, Human-Computer Interaction, or quantitative discipline).
Bonus Points
• Experience in conversation design, content strategy, UX writing, or similar roles in the AI/chatbot/virtual assistant space.
• Hands-on experience with SQL for data analysis and experimentation.
• Experience localizing or adapting conversational AI across multiple languages and cultural contexts.
• If you're passionate about shaping the future of conversational AI and want to make a tangible impact on how people learn and grow through virtual interactions, we'd love to hear from you.
Questions about this role
- This listing did not state a salary. We only show pay when the employer publishes it.
- Native-level fluency in spoken English with exceptional writing and editing skills, including tone, grammar, and clarity, Familiarity with prompt engineering and LLM behavior optimization, Strong cross-functional communication skills with the ability to collaborate across product, engineering, sales, and marketing, Experience designing and executing data-driven experiments to evaluate AI or conversation quality, Bachelor’s degree in a relevant field (e.g., Linguistics, Philosophy, Human-Computer Interaction, or quantitative discipline)