Data and Evaluation Specialist

About AI Rudder

AI Rudder is a conversational AI company on a mission to transform how businesses communicate with their customers — across voice and digital channels that feel genuinely human.

Founded in 2019 and headquartered in Singapore, we're building technologies that bridge languages, enhance understanding, and enable meaningful human–machine communication at scale.

Today, we serve 500+ enterprise clients globally processing 50 million calls daily and having delivered more than 8 billion calls to date.

Most recently, we have raised $50M in a Series B fundraising from leading global investors including Tiger Global, Peak XV Partners, and Cathay Innovation.

How We Work:

• AI-first: AI isn't a tool we reach for. It's the default we start from. Every team, every workflow: AI-first.
• Global Collaboration: We operate globally and work as one team. Distance is a logistics problem, not a cultural one. We build the habits that make distributed teams actually work
• Communication Principle: Simple, Trust, Transparent. We remove unnecessary complexity so people can focus on what matters most.

What We Offer

• Learning & Development: Continuous learning through real projects, knowledge sharing session, mentorship, and cross-functional collaboration.
• Performance Recognition: Regular performance reviews, feedback, and opportunities for career progression.
• Global Exposure: Collaborate with international teams, global rotations, and work with global enterprise customers.
• Meaningful Impact: Build AI solutions that create real value for businesses around the world.
• Ownership & Autonomy: Freedom to take initiative and drive outcomes.
• Team Engagement: Team Building, Local & Global Gatherings & Local Events Celebration

AI Rudder is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and applicants.

Office Location: SCBD, South Jakarta

Work arrangement: Work from Office

Responsibilities:

• Prepare, clean, annotate, and organize large-scale datasets for AI model development, especially NLP, ASR, and NLU projects.
• Conduct data analysis and testing to identify issues, improve model performance, and generate actionable insights.
• Validate and review data to ensure accuracy, consistency, and overall model quality.
• Evaluate AI outputs, including conversational AI and chatbot responses, for accuracy and alignment with Indonesian language and cultural nuances.
• Collaborate with internal teams to optimize datasets and improve workflow efficiency.
• Maintain and update annotation guidelines, documentation, and testing procedures.
• Occasionally assist in evaluating LLM or RAG-based chatbot outputs as part of broader AI projects.

Qualifications:

• Bachelor’s degree in Data Science, Computer Science, Information Systems, Statistics, Linguistics, or a related field.
• Minimum 3 years of experience in data annotation, data pre-processing, A/B testing, or data analysis.
• Strong attention to detail and commitment to producing highly accurate work.
• Experience handling large or unstructured datasets and performing manual data validation/review.
• Familiarity with AI technologies, especially NLP, ASR, or NLU, is preferred.
• Basic understanding of data analytics concepts and model optimization workflows.
• Proficient in Microsoft Excel and basic Python for data processing and analysis.
• Strong analytical thinking and problem-solving skills.
• Native Indonesian speaker with good written and verbal communication skills in Indonesian and English.
• Able to work independently and collaboratively in a fast-paced, project-driven environment.
• Comfortable managing dynamic workloads and meeting deadline-driven project requirements.