Business Data Analyst

Business Data Analyst (AI Workflow Optimization Specialist)

12-Month Contract Position

About the Role

We are looking for a detail-oriented and analytical Business Data Analyst to join our team on a 12-month contract. In this role, you will be responsible for optimizing AI-assisted fraud and risk review workflows by ensuring the quality, consistency, and accuracy of AI-generated decisions.

Working at the intersection of AI, data analysis, and business operations, you will analyze where AI outcomes differ from human decision-making, identify root causes, and continuously improve prompts, decision logic, and evaluation processes to enhance overall AI performance.

Key Responsibilities

• Evaluate the quality of AI-generated decisions and reasoning, identifying discrepancies and improvement opportunities.

• Analyze AI outputs against expected business outcomes and prioritize optimization efforts.

• Refine and improve structured AI prompts and decision guidelines to increase accuracy and consistency.

• Conduct controlled experiments to validate prompt and workflow improvements before implementation.

• Maintain and expand validated test cases to ensure ongoing quality as processes evolve.

• Monitor operational metrics, identify trends, and use data-driven insights to improve AI performance.

• Collaborate with human reviewers and stakeholders to translate feedback into measurable workflow enhancements.

• Ensure continuous improvement of AI-assisted fraud and risk review processes.

Requirements

• Strong analytical thinking and problem-solving skills.

• Excellent written communication skills with the ability to write clear, structured instructions.

• Experience analyzing AI-generated outputs and identifying inconsistencies or ambiguous reasoning.

• Comfortable working with AI-powered development tools such as Cursor, Claude Code, or similar AI-assisted IDEs.

• Highly organized with a systematic, hypothesis-driven approach to testing and optimization.

• Exceptional attention to detail, particularly in regulated or risk-sensitive environments.

Nice to Have

• Experience in fraud operations, compliance, risk management, or financial services.

• Familiarity with prompt engineering or AI workflow optimization.

• Understanding of A/B testing methodologies and experiment design.

• Basic ability to read Python scripts for validation and troubleshooting purposes.

What We're Looking For

This role is ideal for someone who enjoys combining analytical thinking with emerging AI technologies to improve business processes. You'll play a key role in ensuring AI systems deliver reliable, consistent, and high-quality results while working closely with business stakeholders and operations teams.

This is a 12-month contract position.