Abnormal AI · 4 hours ago
Data Platform Engineer
Abnormal Security is focused on building and improving their data platform. The Data Platform Engineer will develop reusable ingestion frameworks and ensure the reliability and efficiency of data pipelines that support analytics and AI.
Artificial Intelligence (AI)Cyber SecurityEmailInformation TechnologyNetwork Security
Responsibilities
Develop reusable ingestion frameworks (Python/Airflow/AWS Glue) for APIs and unstructured sources beyond Fivetran, handling various data formats (JSON, Parquet, etc.)
Own the end-to-end Medallion (bronze/silver/gold) architecture for core domains, ensuring robust lineage and metadata across diverse data sources
Implement data observability (native tests, alerts, lineage hooks); lead incident management and root-cause analysis (RCA) for data
Help standardize reusable 'paved-road' patterns (e.g. CI templates, ingestion operators) to improve developer productivity
Prepare datasets for AI/LLM use cases (feature stores, embeddings/RAG prep)
Qualification
Required
3–5+ years of data engineering with strong Python and SQL; hands-on Spark/PySpark (ideally via AWS Glue)
Deep experience in AWS (S3, IAM, Lambda, CloudWatch) running secure, observable data workloads
Proficiency operating Snowflake (warehouse sizing, RBAC, resource monitors, clustering/partitioning)
Proven governance/security patterns: masking policies, row-level security, and auditability
Orchestration experience (Airflow/MWAA) and event/file/API ingestion beyond managed connectors
CI/CD for data with GitHub Actions; test/promotion workflows; secrets and PII handling
Solid grasp of Medallion architecture, dimensional modeling (star schema), and data quality frameworks
Ownership of incident management and RCA with measurable reduction in MTTR
Preferred
Familiarity with BI tools (Sigma, Looker, Tableau) for downstream troubleshooting and enablement
Experience with iPaaS/automation (e.g., Workato) and reverse ETL patterns
Data observability tools (e.g., Monte Carlo) and open standards like OpenLineage
IaC for data infrastructure (Terraform) and environment provisioning
Experience with Parquet/S3/Iceberg lakehouse patterns and event/data contracts
Fivetran administration and ELT operations
Experience contributing to paved-road standards (templates, operators, codegen)
Exposure to feature stores or embeddings/RAG pipelines supporting AI products
Benefits
Bonus
Restricted stock units (RSUs)
Benefits
Company
Abnormal AI
Abnormal AI is the leading AI-native human behavior security platform.
H1B Sponsorship
Abnormal AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
Funding
Current Stage
Late StageTotal Funding
$534MKey Investors
Wellington ManagementCrowdStrike Falcon FundInsight Partners
2024-08-06Series D· $250M
2023-03-29Series Unknown
2022-05-10Series C· $210M
Recent News
Company data provided by crunchbase