Signature IT World Inc · 5 hours ago
Artificial Intelligence Engineer
Texas, United States
Contract
Hybrid
Mid LevelSignature IT World Inc is looking for a Model Evaluation Engineer with a strong understanding of LLMs and generative AI. The role involves evaluating AI models, building evaluation datasets, and ensuring safety alignment and bias detection in AI systems.
Information Technology & Services
Hiring Manager
Kamil Q.
Responsibilities
Strong understanding of LLMs, generative AI, and transformer-based architectures
Experience with Python, data analysis, and model evaluation frameworks
Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods
Experience building evaluation datasets and working with annotation platforms
Understanding of safety alignment, bias detection, and adversarial testing
Qualification
Required
Strong understanding of LLMs, generative AI, and transformer-based architectures
Experience with Python, data analysis, and model evaluation frameworks
Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods
Experience building evaluation datasets and working with annotation platforms
Understanding of safety alignment, bias detection, and adversarial testing
ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain
Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy
Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines
Company
Signature IT World Inc
Our Mission is to provide our customers with services and solutions to optimize their information systems throughout their company and provide the best possible service to our employees.
201-500 employees
H1B Sponsorship
Signature IT World Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (5)
2023 (5)
2022 (21)
2021 (14)
Funding
Current Stage
Growth StageCompany data provided by crunchbase