Create an account for powerful AI tools, award-winning courses, and access to our vibrant community.
Already have an account?
Join 250,000+ professionals and teams at Microsoft, Shopify, and even NASA. 🚀
Already have an account? Login
Find the best remote jobs. Answer a few questions and we'll deploy a powerful assistant to help you search, create alerts, and more.
1 What roles are you open to?
2 Experience level
3 Work style
Did you know? If memory is enabled, Writing.io can remember your job search preferences and help you to improve your resume, craft customized outreach and more.
Category
Apply domain expertise in biology to train AI systems by analyzing documents, creating questions, and providing feedback on model outputs.
Review and edit design slides in Canva to identify flaws and match design consistency, providing feedback that trains AI models to assess design quality.
Real-world data is the competitive edge in AI.
HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery.
We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide.
We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out.
If you want to do work that materially shapes how the next generation of AI products gets built, we’d love to talk.
Location: Remote
Type: Part-Time Contract (20 hours per week for 4 weeks | 80 hour minimum commitment)
Duration: 4 weeks with potential for ongoing work
Compensation: Up to $25/hour for US-based candidates
You’ll examine designs to understand color schemes, font choices, and other design elements. You will then review a slide within that design that seems out of place. Leveraging your graphic design expertise, along with what you learn in our training, you will edit the incorrect slide to match the rest of the overall design. This is all in an effort to train AI models that assess design effectiveness—contributing to cutting-edge technology that advances how AI understands and evaluates visual content quality.
You thrive on consistency and repetition- You find satisfaction in systematic work and can maintain quality standards while evaluating similar content repeatedly without losing focus or accuracy.
You have a calibrated design eye- You can quickly assess design quality against objective criteria and apply the same standards consistently across hundreds or thousands of examples.
You’re objective and principled- You separate personal taste from professional assessment, basing ratings on established design principles rather than subjective preference.
You maintain sustained focus- You can work through high volumes of repetitive tasks while staying sharp and attentive to subtle quality differences.
You’re a clear communicator- You flag confusing examples or rating criteria early, ask clarifying questions, and document edge cases clearly.
You’re curious about technology- You’re genuinely interested in how AI learns to evaluate design quality and see value in contributing to machine learning training data.
Designs and builds reinforcement learning tasks and evaluation frameworks to train and assess frontier AI models on domain-specific applications.
Reviews and rates AI-generated marketing copy, provides written feedback on quality and alignment, and writes gold-standard examples to improve AI model outputs.
Evaluate and rate AI-generated marketing copy, provide written feedback on quality and brand fit, and write exemplar content to train AI models on copywriting excellence.
Designs and builds domain-specific AI training tasks, evaluation frameworks, and reinforcement learning environments for frontier model post-training.
Designs and implements domain-specific reinforcement learning tasks and evaluation frameworks for frontier AI model post-training.
Tests, evaluates, and improves AI models by providing expert physics knowledge and feedback on model outputs.
Designs and builds reinforcement learning tasks and evaluation frameworks to train and assess frontier AI models.
Designs and builds reinforcement learning tasks and evaluation frameworks to support AI model post-training and development.