MyRemoteTeam Inc · 18 hours ago
Python AI / Code Raters (Expert Level)
United States
Contract
Remote
Senior Level
5+ years expMyRemoteTeam Inc is seeking highly skilled Python AI / Code Raters to evaluate and improve AI-generated code and technical outputs. The role involves assessing programming accuracy and software engineering best practices to refine next-generation AI systems.
Consulting
Hiring Manager
Sajid Ahmed
Responsibilities
Evaluate AI-generated outputs related to programming, ML/AI concepts, and technical reasoning
Identify bugs, inefficiencies, security issues, and deviations from best practices
Ensure outputs comply with defined technical and quality guidelines
Annotate code snippets, algorithms, and technical documentation
Follow project-specific annotation frameworks and instructions
Provide clear, structured, and actionable feedback to improve model performance
Identify edge cases, correctness issues, and quality gaps
Compare multiple AI-generated responses and rank them based on correctness, readability, efficiency, and coding standards
Validate, clean, and correct datasets used for AI training and evaluation
Work closely with data scientists and engineers to refine evaluation guidelines
Help resolve ambiguities and contribute to overall quality strategy
Qualification
Required
Strong foundation in software engineering, computer science, ML/AI, or a related technical field
5–10 years of professional experience in relevant roles
Python (mandatory)
At least one additional language: JavaScript, TypeScript, Node.js, C, C++, Shell
Bonus: Rust, Go, Ruby, Swift, PHP, Kotlin
API integration and web scraping
HTML, CSS, JavaScript
Web application development using frameworks such as Flask
Familiarity with frontend (React) and backend (Node.js) development
Machine learning fundamentals including model training and evaluation
Deep learning frameworks: TensorFlow, PyTorch, Keras, JAX
Natural Language Processing and transformer-based architectures
Reinforcement learning techniques (PPO, DQN, A2C, Q-learning)
Computer vision concepts including OCR, image processing, and deepfake detection
Game AI fundamentals
Data analysis and visualization using Pandas, NumPy, Matplotlib, Seaborn
Database systems: SQL, NoSQL, SQLite
Strong understanding of algorithms and optimization techniques
Version control using Git and GitHub
Clean code principles, debugging, and design patterns
High attention to detail and ability to follow complex instructions
Strong analytical and problem-solving skills
Excellent written communication for technical feedback
Proactive mindset and willingness to challenge assumptions to improve outcomes
Preferred
Experience evaluating AI or LLM-generated code
Professional or academic code review experience
Prior experience in data annotation or quality assurance roles
Familiarity with multiple programming paradigms (object-oriented, functional)
Company
MyRemoteTeam Inc
MyRemoteTeam.com is a quick & easy way for Businesses to Pay Remote Teams, Employees, Consultants & Freelancers.
11-50 employees
Funding
Current Stage
Early StageLeadership Team
Anu Singh
Founder
Dipesh Garg
Founder
Company data provided by crunchbase