AI Output Tester

Tech Pipeline helps operations teams fix the broken middle of their business processes by identifying where data goes bad and where approval chains get stuck. As an AI Output Tester, you will support our mission by verifying that the technical solutions we build produce accurate and reliable results for our clients. We focus on the ground truth of how work moves, ensuring that systems are functional and ready for client teams to manage on their own.

About the role

This is a part-time, fully remote position focused on the accuracy and reliability of automated systems. Many of our clients use AI models to handle tasks like categorizing complex invoices, drafting responses to routine inquiries, or summarizing system logs. However, these systems often fail to follow specific routing rules or introduce errors that cause friction in the workflow. Your job is to sit between the raw output and the final business process to ensure everything is correct. You will look at the actual data, compare it to the source of truth, and identify exactly where the logic is failing. This role is built for someone who enjoys the tangible work of finding errors and ensuring that a system does exactly what it is supposed to do.

What you will be doing

• Testing AI-generated outputs against original source documents to confirm 100 percent accuracy.
• Identifying instances where the system fails to follow a established routing rule or ignores a specific constraint.
• Reading internal logs to compare what the system intended to do versus the final result it produced.
• Updating standard operating procedures when you find recurring errors or gaps in the current logic.
• Performing regular reconciliations between automated reports and manual data entries to catch drifting numbers.
• Documenting edge cases where the AI output creates unnecessary work or backlogs for the operations team.
• Providing clear, written feedback to our technical team about why specific outputs were rejected.
• Tracking output quality over time to see if adjustments to the system are actually reducing friction.

What we need from you

• A sharp eye for detail and the ability to spot small discrepancies in large sets of information.
• Strong written communication skills to explain technical errors in plain, direct language.
• Comfort working with spreadsheets and basic technical documentation to track your findings.
• A methodical approach to work that allows you to follow a checklist without skipping steps.
• The ability to work independently in a fully remote environment while staying productive.
• Curiosity about how business processes like order routing or financial reconciliation function in the real world.
• Reliability and a professional commitment to meeting deadlines for your assigned tasks.
• A practical mindset that values getting the job done over high-level theory.

Helpful background

• Previous experience in a role that required data entry, quality assurance, or administrative support.
• Familiarity with tools like Google Sheets or Airtable for organizing and categorizing information.
• Exposure to how organizations handle customer tickets, financial records, or inventory logs.

What the role offers

• A fully remote work arrangement that allows you to work from wherever you are most productive.
• Specific, concrete tasks that allow you to see the results of your work immediately.
• A chance to learn about the technical reality of business operations and automation from the ground up.
• Experience working with a team that values documentation and ground truth over abstract strategy.
• This position is paid and the rate is competitive for an entry-level part-time role.
• The opportunity to build a foundation in quality control and data verification within a technical setting.

Working at Tech Pipeline

We do not believe in long meetings or constant direct messages that interrupt your focus. Most of our communication happens through written updates and clear documentation. We value people who can open the system, read the logs, and find the source of the problem without needing a slide deck to explain it. Our goal is to fix a specific problem, make sure the solution sticks, and then hand it over to the client. Because we are a remote team, we rely on everyone to be clear about what they are doing and where they are stuck. We stay close to the technical facts and avoid the corporate noise that usually slows down operations work.