iShare Inc. · 1 month ago
AI Engineer – Agentic & RAG Systems
United States
Full-time
Remote
Mid Level
$130K/yr - $130K/yriShare Inc. is a boutique IT consulting firm specializing in strategic advisory, development, and staffing services. They are seeking an AI Engineer to design, build, and operate agentic AI systems, focusing on multi-agent orchestration and Retrieval-Augmented Generation, while collaborating with cross-functional teams to ensure high performance and safety in AI implementations.
AdviceBusiness IntelligenceInformation Technology
Responsibilities
Design and implement Retrieval-Augmented Generation pipelines to ground LLMs in enterprise or domain-specific data
Make strategic decisions on chunking strategy, embedding models, and retrieval mechanisms to balance context precision, recall, and latency
Work with vector databases (Qdrant, Weaviate, pgvector, Pinecone) and embedding frameworks (OpenAI, Hugging Face, Instructor, etc.)
Diagnose and iterate on challenges like chunk size trade-offs, retrieval quality, context window limits, and grounding accuracy—using structured evaluation and metrics
Establish comprehensive evaluation frameworks for LLM applications, combining quantitative (BLEU, ROUGE, response time) and qualitative methods (human evaluation, LLM-as-a-judge, relevance, coherence, user satisfaction)
Implement continuous monitoring and automated regression testing using tools like LangSmith, LangFuse, Arize, or custom evaluation harnesses
Identify and prevent quality degradation, hallucinations, or factual inconsistencies before production release
Collaborate with design and product to define success metrics and user feedback loops for ongoing improvement
Implement multi-layered guardrails across input validation, output filtering, prompt engineering, re-ranking, and abstention (“I don’t know”) strategies
Use frameworks such as Guardrails AI, NeMo Guardrails, or Llama Guard to ensure compliance, safety, and brand integrity
Build policy-driven safety systems for handling sensitive data, user content, and edge cases with clear escalation paths
Balance safety, user experience, and helpfulness, knowing when to block, rephrase, or gracefully decline responses
Design and operate multi-agent workflows using orchestration frameworks such as LangGraph, AutoGen, CrewAI, or Haystack
Coordinate routing logic, task delegation, and parallel vs. sequential agent execution to handle complex reasoning or multi-step tasks
Build observability and debugging tools for tracking agent interactions, performance, and cost optimization
Evaluate trade-offs around latency, reliability, and scalability in production-grade multi-agent environments
Qualification
Required
Strong proficiency in Python (FastAPI, Flask, asyncio) and GCP experience is good to have
Demonstrated hands-on RAG implementation experience with specific tools, models, and evaluation metrics
Practical knowledge of agentic frameworks (LangGraph, LangChain) and evaluation ecosystems (LangFuse, LangSmith)
Excellent communication skills, proven ability to collaborate cross-functionally, and a low-ego, ownership-driven work style
Preferred
Experience in traditional AI/ML workflows — e.g., model training, feature engineering, and deployment of ML models (scikit-learn, TensorFlow, PyTorch)
Familiarity with retrieval optimization, prompt tuning, and tool-use evaluation
Background in observability and performance profiling for large-scale AI systems
Understanding of security and privacy principles for AI systems (PII redaction, authentication/authorization, RBAC)
Exposure to enterprise chatbot systems, LLMOps pipelines, and continuous model evaluation in production
Company
iShare Inc.
iShare is a NJ-based boutique IT consulting firm that offers strategic advisory, development, and staffing services designed for specific verticals: Chemicals/Manufacturing (general & specialty chemical product manufacturers), Pharma & Healthcare (hospitals, clinics, labs), Software (data visualization, HR, risk management), and Professional Services (HR firms, architects, doctors) industries.
Founded in 2017
11-50 employees
Funding
Current Stage
Early StageLeadership Team
Ankur Kumar Saxena
CEO
Company data provided by crunchbase