NTT DATA North America ยท 2 hours ago
AI Native Product Architect
Dallas, TX
Full-time
Hybrid
Senior Level, Lead/Staff
8+ years expNTT DATA is a trusted global innovator of business and technology services, serving a significant portion of the Fortune Global 100. They are seeking an AI Native Product Architect to design and implement AI-native product architectures, ensuring high availability, performance, and security while collaborating with product managers and engineers.
ConsultingDigital MarketingInformation ServicesInformation TechnologyIT Management
Responsibilities
Define and own the technical architecture of AI-native products, ensuring high availability, performance, and security
Architect scalable data pipelines, model training, inference services, and orchestration frameworks
Design cloud-native, containerized architectures (Kubernetes, microservices, serverless functions) optimized for AI workloads
Create reference architectures and reusable design patterns for AI-first product development
Build PoCs, prototypes, and reference implementations to validate architecture decisions
Develop and optimize APIs, vector databases, and real-time inference pipelines for LLMs and ML models
Implement MLOps pipelines for continuous integration, delivery, monitoring, and retraining of models
Ensure observability with logging, monitoring, and tracing for data and AI services
Evaluate AI/ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face, LangChain, Ray, MLflow) for product suitability
Select and integrate data platforms, feature stores, vector DBs (Pinecone, Weaviate, FAISS, Milvus, etc.)
Work with cloud AI services (AWS Sagemaker, Azure AI, GCP Vertex AI) and open-source alternatives
Optimize cost, latency, and scalability for inference at production scale
Work closely with product managers, AI researchers, and engineers to translate requirements into architecture
Conduct technical deep-dives, architecture reviews, and performance benchmarking
Mentor engineers on AI-native design principles and best practices
Qualification
Required
Bachelor's or Master's degree in Computer Science, Data Science, or related field
8+ years in software architecture/engineering, with 4+ years in AI/ML-focused product development
Proven hands-on experience in designing and deploying AI-native systems in production
Strong proficiency in Python, Java, or Go, with hands-on coding ability
Deep knowledge of AI/ML frameworks (PyTorch, TensorFlow, Hugging Face, LangChain)
Experience with data engineering, ETL pipelines, and streaming platforms (Kafka, Spark, Flink)
Strong understanding of cloud-native systems (Kubernetes, Docker, microservices)
Practical knowledge of vector search, embeddings, retrieval-augmented generation (RAG)
Strong grasp of security, governance, and compliance in AI workloads
Preferred
Experience scaling LLM-powered applications with low-latency serving and caching strategies
Knowledge of distributed training/inference using GPUs/TPUs, model sharding, and parallelization
Familiarity with responsible AI practices: fairness, explainability, auditability
Exposure to API design and monetization strategies for AI-powered SaaS products
Company
NTT DATA North America
NTT DATA, Inc. is a trusted global innovator of business and technology services.
10001+ employees
H1B Sponsorship
NTT DATA North America has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (144)
2024 (182)
2023 (257)
2022 (871)
2021 (809)
2020 (1266)
Funding
Current Stage
Late StageLeadership Team
John Barr
Vice President - Insurance Strategy
Recent News
2025-12-05
Company data provided by crunchbase