Remote Data Labeling Specialist (Raleigh)
Auto Import<strong>Overview<br><br></strong>Rex.zone is hiring a <strong>Remote Data Labeling Specialist</strong> aligned to Raleigh-based job seekers. Work is performed <strong>remotely within the US</strong>. You will produce and verify high-quality labeled datasets used to train and evaluate AI models in real products, supporting LLM training pipelines and evaluation loops.<br><br><strong>What You Will Work On<br><br></strong><ul><li>Label and review multi-modal data (text, images, audio, video) for AI training and evaluation</li><li>Complete NLP tasks such as classification and named entity recognition (NER)</li><li>Perform computer vision annotation including bounding boxes and segmentation</li><li>Support content safety labeling and policy-aligned decisions</li><li>Conduct LLM evaluation tasks such as RLHF preference ranking and prompt evaluation<br><br></li></ul><strong>Key Responsibilities<br><br></strong><ul><li>Deliver accurate labels aligned to annotation guidelines and complex rubrics</li><li>Execute QA evaluation workflows (spot checks, gold set validation, sampling audits, inter-annotator agreement)</li><li>Document edge cases, rationales, and disagreement resolution to improve training data quality</li><li>Maintain throughput targets while preserving precision and consistency across batches</li><li>Protect data privacy and follow content and safety policies<br><br></li></ul><strong>Required Qualifications<br><br></strong><ul><li>2+ years in data labeling, data annotation, QA evaluation, or AI data operations</li><li>Strong attention to detail and proven annotation guidelines compliance</li><li>Comfortable making consistent decisions across edge cases (mid-senior expectations)</li><li>Experience with RLHF-style ranking, LLM evaluation, or prompt evaluation preferred<br><br></li></ul><strong>Compensation<br><br></strong>$30–$50 per hour (base pay; varies by project and scope).<br><br><strong>How To Apply<br><br></strong>Apply via Rex.zone with a resume highlighting labeling domains, QA metrics, and any RLHF/LLM evaluation experience.