TDI (Tetrad Digital Integrity) · 1 day ago
Lead Cybersecurity Evaluation Expert
Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age. They are seeking a deeply experienced and cross-functional Lead Cybersecurity Evaluation Expert to advise and oversee the technical quality and strategic scope of Cyber Test & Evaluation projects assessing Large Language Models. This role involves providing oversight across cyber domains, collaborating on project goals, vetting experts, and ensuring quality and standardization in evaluation processes.
Cyber SecurityNetwork SecuritySecurity
Responsibilities
Domain oversight: Provide strategic oversight across all cyber subdomains including but not limited to malicious network traffic, cryptographic systems, adversarial LLM prompts, threat intelligence, and cyber ethics
Scoping & strategy: Collaborate with the Program Manager (you) to define project goals, deliverable scopes, evaluation frameworks, and technical benchmarks
Expert vetting: Assess the technical credibility of cyber experts proposed by subcontractors; conduct interviews and review technical artifacts to validate expertise
Quality control: Review and validate the accuracy, depth, and applicability of all datasets and question-answer pairs produced by subcontracted experts
Standardization: Establish and enforce evaluation rubrics, scenario fidelity criteria, and documentation standards to ensure consistency across all workstreams
Cross-domain bridging: Identify cross-domain gaps, propose integrated benchmark scenarios, and ensure logical alignment between adjacent domains (e.g., how network behavior supports APT identification)
Stakeholder communication: Provide subject-matter advice to internal and external stakeholders on technical feasibility, risks, and coverage completeness
Qualification
Required
8+ years of hands-on experience in cybersecurity, with demonstrated proficiency across multiple domains (e.g., red teaming, cryptography, network forensics, cyber threat intelligence, adversarial ML)
Proven experience in one or more of the following: red-teaming LLMs, TTP identification using MITRE ATT&CK, cryptographic protocol evaluation, or creation of high-fidelity cyber scenarios
Familiarity with cybersecurity testing methodologies (e.g., penetration testing, adversarial simulation, red team exercises)
Strong analytical, evaluative, and problem-solving abilities
Excellent communication skills with a strong technical writing background
Preferred
Prior experience leading or advising multi-expert technical teams across multiple cybersecurity disciplines
Understanding of LLM architectures and AI model evaluation processes
Familiarity with T&E in government or defense settings (e.g., AFWERX, MITRE, DoD AI efforts)
Certifications such as CISSP, OSCP, GCIH, GCIA, GPEN, or equivalent
Company
TDI (Tetrad Digital Integrity)
For over 20 years, TDI’s one and only passion has been delivering cybersecurity solutions to effectively manage the business of cyber.
H1B Sponsorship
TDI (Tetrad Digital Integrity) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2020 (1)
Funding
Current Stage
Growth StageCompany data provided by crunchbase