Saransh Inc ยท 2 months ago
Data Architect with Python and GCP cloud - Full Time Role
Issaquah, WA
Full-time
Onsite
Senior LevelSaransh Inc is seeking a Senior Data Architect to design, develop, and implement data pipelines and integration solutions using Python and Google Cloud Platform services. The role involves constructing and maintaining data acquisition pipelines for both structured and unstructured data, ensuring data quality and consistency through various workflows.
EmploymentInformation TechnologyStaffing Agency
No H1B
Responsibilities
Develop, construct, test and maintain data acquisition pipelines for large volumes of structured and unstructured data. This includes batch and real-time processing
Develop and maintain data pipelines and ETL processes using Python
Design, build, and optimize data models and data architecture for efficient data processing and storage
Implement data integration and data transformation workflows to ensure data quality and consistency
Qualification
Required
Working experience as a Data Engineer
Experienced in migrating large-scale applications from legacy systems to modern architectures
Good programming skills in Python and experience with Spark for data processing and analytics
Experience in Google Cloud Platform services such as GCS, Dataflow, Cloud Functions, Cloud Composer, Cloud Scheduler, Datastream (CDC), Pub/Sub, BigQuery, Dataproc, etc. with Apache Beam (Batch & Stream data processing)
Develop JSON messaging structure for integrating with various application
Leverage DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines
Experience with scripting languages like Shell, Perl etc
Design and build an ingestion pipeline using Rest API
Experience with data modeling, data integration, and ETL processes
Strong knowledge of SQL and database systems
Familiarity with managing cloud-native databases
Understanding of security integration in CI/CD pipelines
Understanding of data warehousing concepts and best practices
Proficiency in working with large-scale data sets and distributed computing frameworks
Preferred
Visa Independent candidates are highly preferred
Company
Saransh Inc
We provide recruitment, consulting and IT services for our clients, which focus on maximizing their revenue generation, enhancing business productivity and improving cost management.
Founded in 2008
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Sridhar Chimaladinne
FOUNDER & CEO
Company data provided by crunchbase