Apply on Employer Site

Scrunch · 1 month ago

Senior Software Engineer, Data & AI Engineering (US)

United States

Full-time

Remote

Senior Level

Scrunch is a venture-backed startup focused on transforming marketing through AI technologies. The Senior Software Engineer will be responsible for building features related to data pipelines and analytics APIs, ensuring that customers have the tools to succeed in the AI era.

Artificial Intelligence (AI)Information TechnologyInternet

Responsibilities

Building features related to data pipelines, usage of LLMs, analytics APIs, etc

Creating notifications, alert emails, scheduled reports, connectors into third party systems

Qualification

Web APIsPostgreSQLData processing pipelinesAnalytical SQLLLMsStreaming analyticsPandasBig data toolsData quality validation

Required

Have extensive experience building & using web APIs, including handling authentication, authorization, caching, rate limiting, etc

Experience building API for external customers is a big plus

Experience with relational (transactional) databases, particularly PostgreSQL

Experience with analytics tools and technologies, such as: Analytical SQL, maybe with a modern analytical data platform like Snowflake, Google BigQuery, DuckDB, Spark SQL, etc

Experience with analytics packages like Pandas or Polars is a plus

Experience with streaming analytics is a plus

Experience writing batch and streaming/interactive data processing pipelines

This could mean any of: Big data tools like Flink, Beam (GCP Dataflow), Spark, etc

Job queues and task processing frameworks (Celery, Resque, or cloud-based options like Google Cloud Tasks)

Multi-step durable execution frameworks like Temporal or Inngest

In-house or home-rolled versions of any of the above you've used at previous companies

The ability to quickly understand source data and validate output data quality

Experience using LLMs and/or traditional ML techniques to build classifiers, data extractors, summarizers, etc