Cliff Services Inc ยท 2 days ago
Texas or Virginia ----Data Engineer/ Data Analyst
Cliff Services Inc is seeking a Data Engineer/Data Analyst with expertise in Python, PySpark, and AWS. The role involves designing, building, and maintaining scalable data pipelines in a cloud environment, collaborating with various teams to deliver effective data solutions.
Responsibilities
Design, develop, and maintain robust ETL/ELT pipelines using Python and PySpark for data ingestion, transformation, and processing
Work extensively with AWS cloud services such such as S3, Glue, EMR, Lambda, Redshift, Athena, and DynamoDB for data storage, processing, and warehousing
Build and optimize data ingestion and processing frameworks for large-scale data sets, ensuring data quality, consistency, and accuracy
Collaborate with data architects, data scientists, and business intelligence teams to understand data requirements and deliver effective data solutions
Implement data governance, lineage, and security best practices within data pipelines and infrastructure
Automate data workflows and improve data pipeline performance through optimization and tuning
Develop and maintain documentation for data solutions, including data dictionaries, lineage, and technical specifications
Participate in code reviews, contribute to continuous improvement initiatives, and troubleshoot complex data and pipeline issues
Qualification
Required
Strong programming proficiency in Python, including libraries like Pandas and extensive experience with PySpark for distributed data processing
Solid understanding and practical experience with Apache Spark/PySpark for large-scale data transformations
Demonstrated experience with AWS data services, including S3, Glue, EMR, Lambda, Redshift, and Athena
Proficiency in SQL and a strong understanding of data modeling, schema design, and data warehousing concepts
Experience with workflow orchestration tools such as Apache Airflow or AWS Step Functions
Familiarity with CI/CD pipelines and version control systems (e.g., Git)
Excellent problem-solving, analytical, and communication skills, with the ability to work effectively in a team environment
Preferred
Experience with streaming frameworks like Kafka or Kinesis
Knowledge of other data warehousing solutions like Snowflake
Company
Cliff Services Inc
Cliff Services Inc is a IT services and technology consulting company into providing cutting-edge technology solutions to businesses.
H1B Sponsorship
Cliff Services Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7)
2024 (8)
2023 (5)
Funding
Current Stage
Growth StageCompany data provided by crunchbase