Apply on Employer Site

BrightAI · 3 hours ago

Data Platform Engineer

United States

Full-time

Remote

Senior Level

5+ years exp

BrightAI is a high-growth company transforming how businesses operate by integrating AI, IoT, and cloud-native services into scalable, real-time platforms. As a Platform Data Engineer, you will build and maintain the data infrastructure that powers the company's products and services while collaborating with cross-functional teams to manage large streams of data.

Artificial Intelligence (AI)Cloud ComputingInternet of ThingsMobile

Responsibilities

Design, build, and maintain scalable, reliable, and high-throughput data ingestion pipelines for structured and semi-structured data

Implement robust and secure data lake and SQL-based storage architectures optimized for performance and cost

Develop and maintain internal tools and frameworks for data ingestion using Python, Golang, and SQL

Collaborate cross-functionally with Cloud, Edge, Product, and AI teams to define data contracts, schemas, and retention policies

Use AWS cloud infrastructure (including Argo Workflows, S3, Lambda, Glue, Kinesis, Athena, and RDS) to support end-to-end data workflows

Employ Infrastructure-as-Code (IaC) practices using Terraform to manage data platform infrastructure

Monitor data pipelines for quality, latency, and failures using tools such as CloudWatch, SumoLogic, or DataDog

Continuously optimize storage, partitioning, and query performance across large-scale datasets

Participate in architecture reviews and ensure the platform adheres to security, compliance, and best practice standards

Qualification

PythonGolangAWS servicesSQLTerraformData lake architecturesETL/ELT pipelinesEvent-driven architecturesCollaboration skillsCommunication skillsDocumentation skills