Yochana · 17 hours ago
Gen AI Architect
New Jersey, United States
Full-time
Hybrid
Senior Level, Lead/Staff
$200K/yr - $230K/yr
8+ years expYochana is seeking an AI Architect to guide the strategy and delivery for modern AI solutions. The role involves leading architectural design and establishing best practices for complex AI initiatives while engaging with technology and business leaders.
Business Information SystemsInformation and Communications Technology (ICT)Information ServicesInformation TechnologySoftwareStaffing Agency
Hiring Manager
Manohar Suriboyina
Responsibilities
Define and govern reference architecture for multi-agent systems, covering hierarchical, peer-to-peer, and sequential (ReAct) orchestration models. Guide teams on pattern selection based on client use cases
Architect the standards for integrated memory systems, including short-term session state, long-term knowledge via vector databases and knowledge graphs, and episodic/audit memory. Ensure coherent retrieval strategies across layers
Define architectural patterns for end-to-end RAG pipelines, including chunking, embedding, vector search (e.g., Azure Cognitive Search, pgvector), and reranking. Ensure designs include standards for lineage, observability, and evaluation (e.g., RAGAS)
Create and maintain decision frameworks for platform selection (e.g., Copilot Studio for Teams integration, Vertex AI for GCP workloads). Advise clients on balancing vendor lock-in risks with integration benefits
Define the architectural standards for GenAIOps, including CI/CD, IaC, and observability. Establish standard metrics to track agent decision traces, latency, token consumption, hallucination, and cost
Architect enterprise-wide guardrails for safety (hallucination mitigation), security (prompt injection defense, PII masking), and fairness (bias detection). Apply governance frameworks (NIST AI RMF, ISO 42001) and design human-in-the-loop (HITL) workflows
Architect scalable integration patterns for agentic systems with enterprise platforms (Microsoft Entra ID, Teams, Dynamics/Salesforce, ERPs) and compute (Kubernetes). Ensure patterns address security, data residency, and compliance
Combine technical architecture with strategic guidance. Lead C-level workshops on Agentic AI adoption, advise on roadmaps, and shape technology strategy. Mentor other architects and contribute to industry thought leadership
Present at industry events and publish articles that advance the AI industry
Qualification
Required
8–10+ years in technical leadership, with a strong background in both software engineering and enterprise-scale cloud architecture
Architectural expertise with one primary cloud platform (Azure, GCP, or AWS) and hands-on familiarity with at least one other
Demonstrated experience architecting and guiding solutions using GenAI platforms (e.g., Azure OpenAI, Vertex AI, or AWS Bedrock)
Proven experience designing complex RAG pipelines
Experience with instruction tuning or fine-tuning strategies for LLMs
Exceptional communication skills with demonstrated experience advising senior stakeholders (Director/C-Level) on technical strategy, roadmaps, and governance
Preferred
Deep understanding of, and experience designing or prototyping, advanced multi-agent systems (e.g., task decomposition, collaborative agents)
Hands-on architectural expertise across all three major clouds (Azure, AWS, GCP)
Hands-on experience with GenAI Ops tooling. Familiarity with AI governance frameworks (NIST AI RMF, ISO 42001) and their practical application. And AI FinOps & Model Routing
Hands-on development experience with one or more orchestration frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel)
Published work (whitepapers, patents), conference speaking engagements, or active contributions to relevant open-source projects
Professional-level cloud certifications (e.g., Azure Solutions Architect Expert, AWS Solutions Architect Professional, GCP Professional Cloud Architect)
Company
Yochana
Yochana: Your Trusted Workforce Partner Across North America & Beyond For over 16 years, Yochana has been a leading talent acquisition firm, connecting businesses with top professionals across industries.
201-500 employees
H1B Sponsorship
Yochana has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (21)
2024 (11)
2023 (3)
Funding
Current Stage
Growth StageLeadership Team
Anusha Sharath
Global Talent Acquisition Lead / HR-BP
Recent News
Company data provided by crunchbase