AI Data Quality Analyst (Human-in-the-Loop)

Other Jobs To Apply

No other job posts for this day.

<h1>AI Data Quality Analyst (Human-in-the-Loop)</h1> <p> </p> <h2>About the Role</h2> <p>We are looking for a <strong>hands-on AI Data Quality Analyst (Human-in-the-Loop)</strong> to support a strategic client in the <strong>commercial property insurance</strong> space. This role sits at the intersection of <strong>data quality, QA, and product thinking</strong>.</p> <p>You will be the <strong>“human in the loop”</strong> for an AI-powered document processing pipeline: reviewing what the AI extracts from complex insurance submissions (e.g., <strong>Statements of Values (SOVs), loss runs, spreadsheets, PDFs</strong>), correcting errors, and ensuring that downstream tools receive clean, reliable data. On top of the day-to-day “grind work” of validation and correction, you’ll <strong>zoom out to identify recurring issues, spot patterns, and translate them into clear requirements and bug reports for the engineering team</strong>.</p> <p>This is <strong>not a Product Manager role</strong> and not a “purely strategic” position. It is very <strong>hands-on, detail-oriented work</strong> that is critical to improving our AI systems and ultimately the client’s underwriting workflow.</p> <hr> <h2>What You’ll Do</h2> <ul> <li><strong>Review AI-extracted data</strong> from insurance submissions (SOVs, loss runs, supporting documents) for accuracy, completeness, and consistency.</li> <li><strong>Compare extracted fields against source documents</strong>, identify discrepancies, and <strong>correct data directly</strong> in the appropriate systems or templates.</li> <li>Act as a <strong>quality gate</strong> for the AI pipeline, ensuring output meets agreed <strong>business and underwriting expectations</strong> before it moves downstream.</li> <li><strong>Log issues, defects, and edge cases</strong> with clear reproduction steps, examples, and impact, using tools like Jira or similar.</li> <li><strong>Identify patterns and root causes</strong> behind extraction errors (e.g., recurring issues with specific formats, document types, or fields).</li> <li>Translate observed patterns into <strong>well-structured requirements, user stories, and bug reports</strong> that engineering and data teams can act on.</li> <li>Collaborate closely with <strong>architects, data engineers, and other analysts</strong> to refine extraction rules, templates, and workflows.</li> <li>Use <strong>LLMs and AI assistants as tools</strong> (e.g., for summarization, cross-checking, hypothesis generation), while exercising sound judgment about <strong>what to trust and what to verify</strong>.</li> <li>Help <strong>continuously improve documentation</strong>, checklists, and guidelines for reviewing submissions and extractions.</li> <li>Over time, contribute to <strong>defining metrics and dashboards</strong> for data quality and model performance (e.g., accuracy by field, error rates by document type).</li> <li>Work primarily in <strong>Eastern European time zones</strong> with sufficient overlap to collaborate with <strong>US-based stakeholders</strong>.</li> </ul> <hr> <h2>What We’re Looking For</h2> <h3>Required Experience & Skills</h3> <ul> <li><strong>3+ years</strong> of experience in a <strong>data-intensive</strong> role such as data analyst, business analyst, QA analyst, operations analyst, or similar.</li> <li>Strong <strong>attention to detail</strong> and proven experience doing <strong>systematic, repetitive data review</strong> without loss of quality.</li> <li><strong>Excellent analytical skills</strong>: ability to trace issues from symptoms (wrong numbers, missing fields) back to likely root causes (document patterns, parsing logic, business rules).</li> <li>Demonstrated ability to <strong>write clear, structured tickets/requirements</strong> for engineering teams (e.g., bug reports, user stories, acceptance criteria).</li> <li><strong>Advanced Excel skills</strong> (pivot tables, lookups, filters, data cleansing techniques).</li> <li>Comfortable working with <strong>complex business documents and datasets</strong> (financial, insurance, or similar structured data).</li> <li><strong>Strong written English</strong> for documenting findings, writing tickets, and communicating with distributed teams.</li> <li>Comfortable with <strong>“grind work”</strong>: reviewing many documents/records per day, while maintaining consistency and care.</li> <li>Experience with <strong>issue-tracking or project management tools</strong> (e.g., Jira, Azure DevOps, Trello, or similar).</li> <li>Ability to <strong>work independently</strong>, manage your own queue, and escalate appropriately when patterns or blockers emerge.</li> </ul> <h3>Nice to Have</h3> <ul> <li>Experience in <strong>commercial insurance</strong>, <strong>property insurance</strong>, or financial services operations.</li> <li>Familiarity with <strong>Statements of Values (SOVs)</strong>, <strong>loss runs</strong>, or similar risk/coverage documentation.</li> <li>Exposure to <strong>LLMs and AI systems</strong> (e.g., document intelligence, RAG, chat agents) — as a user, tester, or collaborator.</li> <li>Basic familiarity with <strong>SQL</strong> or other query tools for validating data.</li> <li>Prior experience in a <strong>Human-in-the-Loop (HIL)</strong> or <strong>data quality</strong> role supporting machine learning models.</li> <li>Experience defining or working with <strong>data quality metrics</strong> (accuracy, completeness, precision/recall, etc.).</li> </ul> <h3>Core Qualities</h3> <ul> <li><strong>Hands-on ownership:</strong> You’re happy to roll up your sleeves, dig into the data, and do what it takes to ensure quality.</li> <li><strong>Curiosity & pattern recognition:</strong> You naturally look for trends behind individual issues and want to understand “why” things fail.</li> <li><strong>Structured thinking:</strong> You can turn messy observations into <strong>clear, actionable tickets and requirements</strong>.</li> <li><strong>Communication & collaboration:</strong> You’re comfortable working with <strong>engineers, architects, and business stakeholders</strong> across time zones.</li> <li><strong>Adaptability:</strong> You’re eager to learn new tools, domains, and workflows in a rapidly evolving AI environment.</li> </ul> <p> </p> <hr> <h2>About Nimble Gravity</h2> <p>Nimble Gravity is a team of <strong>outdoor enthusiasts, adrenaline seekers, and experienced growth hackers</strong>. We love solving hard problems and believe the <strong>right data can transform and propel growth</strong> for any organization.</p> <p>We work at the cutting edge of <strong>data, analytics, and AI</strong>, helping clients build and scale solutions that deliver meaningful business impact.</p> <p>Nimble Gravity is an <strong>Equal Opportunity Employer</strong> and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics, or any other basis forbidden under applicable law. Nimble Gravity considers all qualified applicants.</p> <p><strong>H1B sponsorship is not available for this position.</strong></p>

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...