Veracity Software Inc · 1 day ago
AWS Data Engineer – Qualtrics Integration
Torrance, CA
Full-time
Hybrid
Mid LevelVeracity Software Inc is seeking an AWS Data Engineer focused on Qualtrics Integration to design and maintain scalable data pipelines. The role involves integrating Qualtrics APIs with AWS services to ensure data accuracy and automation across workflows.
Information TechnologySaaSSoftwareTechnical SupportWeb Development
Responsibilities
Design and maintain ETL pipelines using AWS Glue (PySpark)
Develop AWS Lambda functions (Python / Node.js) for serverless data processing
Manage AWS S3 for Qualtrics input/output storage and optimized data access
Orchestrate workflows using AWS Step Functions and MWAA (Airflow)
Query structured datasets using AWS Athena
Monitor pipelines using CloudWatch logs and metrics
Transform and aggregate Qualtrics datasets (CSV, JSON, XML)
Merge multiple source files (e.g., dealer master + employee files) into unified hierarchies
Automate ingestion, transformation, validation, and report generation
Implement reusable, scalable ETL frameworks
Integrate with Qualtrics APIs to extract raw survey data and response files
Implement event-driven processing (S3 triggers → Lambda)
Connect AWS pipelines with CRM, ERP, BI tools, or downstream platforms
Perform data validation and quality checks prior to Qualtrics ingestion
Generate formatted output files aligned to business-defined templates
Support ad-hoc analysis using SQL and Athena
Develop robust Python scripts for Glue, Lambda, and automation tasks
Write optimized SQL queries for structured data access
Use Bash/Shell scripting for file movement and preparation
Configure IAM roles and permissions securely
Implement Infrastructure as Code (Terraform / CloudFormation)
Support CI/CD pipelines for data workflows
Qualification
Required
Strong experience in AWS Data Engineering & Serverless Architecture
Hands-on expertise with AWS Glue, Lambda, S3, Athena, Step Functions
Experience with MWAA (Airflow) for orchestration
Strong Python and SQL skills
Experience integrating Qualtrics API or structured survey data
Ability to troubleshoot pipeline failures and performance issues
Preferred
Experience with Terraform or CloudFormation
CI/CD for data pipelines
Experience supporting BI tools (Power BI, Tableau, etc.)
Knowledge of data governance and security best practices
Company
Veracity Software Inc
The definition of Veracity is accuracy and habitual truthfulness. This truly defines our brand in simplistic terms.
51-200 employees
H1B Sponsorship
Veracity Software Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (12)
2024 (13)
2023 (7)
2022 (16)
2021 (23)
2020 (29)
Funding
Current Stage
Growth StageLeadership Team
Chitra Jain
Co-Founder & CEO
Manohar Suryavanshi
Founder & President
Recent News
Help Net Security
2025-04-29
Company data provided by crunchbase