AI Quality and Automation Specialist
This is the employer's own posting, not a copy on a job board.
What we know
Is it still open?
Confirmed still open
Last checked 2d ago — checked against the employer's own applicant tracking system, which is the company answering directly.
We re-read the employer's own applicant tracking system and the posting was still there. That is the company answering directly.
How old is it?
Posted 2d ago
The date the source published, not the day we noticed it (2026-10-30). Last seen at its source 2h ago.
We have tracked this listing since 30 Oct 2026 (2 days). The employer's own board has carried it every time we have read it, most recently 2 hours ago.
Is it remote?
Marked remote on the employer's board
Their board carries a remote setting on this posting — a field they filled in, not wording we read. The location field names somewhere specific, which is usually where the team or the entity sits.
Who may apply?
Poland, Georgia, Bulgaria, Isle Of Man, Romania
The description states no restriction of its own. This is the source's own tag.
Skills named in the ad
Recognised terms only, from a fixed vocabulary — this is what CV matching compares against.
Carried by 1 source
-
Ashby employer's own board first seen 2d ago · last seen 2h ago
The listing
About Patrianna
Patrianna is a fast-scaling product development company headquartered in Gibraltar, with a dynamic, global team powering our growth. We operate at the intersection of technology and entertainment, building innovative solutions that shape the future of social gaming and deliver outstanding experiences to millions of players worldwide.
We're driven by speed, ambition, and bold ideas. At our core, we're product creators and problem-solvers who thrive in a high-performance environment. We're looking for exceptional talent—smart, adaptable, and motivated individuals eager to make an impact, scale business functions at pace, and continuously improve.
Whether you're a domain expert or an agile thinker who thrives in change, at Patrianna you'll have the freedom to innovate, take ownership, and help us lead the next wave of gaming innovation.
Join us—and be part of something extraordinary.
The Role
You'll make sure our AI agents and critical workflows actually work by building smart automated testing and evaluation, then using AI to test AI.
What you will be doing
You'll build and maintain API, integration and end-to-end regression tests that keep our critical workflows rock solid.
You'll evaluate AI agents on task completion, response quality, tool use and permissions, and measure how model, prompt and context changes affect results.
You'll build quality checks into our CI/CD pipelines and turn every production defect into a regression case, so the same bug never bites twice.
You'll put agents to work exploring workflows, generating tests and reproducing bugs, then rigorously check what they find.
You'll share the tools and methods that work with the wider AI team and our central QA department, raising the bar for everyone.
What we are looking for
Strong test automation and programming skills in TypeScript or Python
Solid hands-on experience with web apps, APIs, Git and CI/CD
A structured approach to judging AI output against clear, measurable criteria
A knack for reproducing, isolating and pinning down bugs fast, with a sharp eye for root cause
A direct communicator who documents decisions and shares what works
Bonus: agentic browser testing, LLM evaluation frameworks, Supabase, Vercel or GCP
Why you will love it
You'll be at the cutting edge. AI agent evaluation is new territory, and you'll help define how it's done here.
Real ownership. We act like one of three team members: accountable, trusted and close to the impact.
Progress over perfectionism. We set achievable deadlines, ship, learn and improve.
Genuinely open culture. Conversations happen in open Slack channels, outcomes live in Monday.com, and calls are on Google Meet with cameras on because we like feeling connected.
No fluff. If it can be said in 20 words, we won't use 1,000.
Great people. We want to work with the best, and we have a strict no ass-hole policy.
Equal Opportunities
We hire based on skills, drive, and ideas — nothing else. Your background, gender, age, race, ethnicity, disability, sexual orientation, religion, neurodiversity, or educational path will never be a barrier to joining us. We also welcome candidates from non-traditional career journeys and value diverse perspectives that challenge conventional thinking. Diversity fuels our innovation, collaboration, and growth, and we're committed to creating an environment where everyone can contribute their best work and thrive.