Counterintelligence Technology & Program SME — AI Evaluation (Contract) at micro1
Job details
Use AI to assess how you fit
About this role
Role Title: Technology & Program SME — AI Evaluation (Contract) Role Type: Contractor Location: Remote micro1 is engaging Technology & Program SME — AI Evaluation (Contract)s to contribute critical subject matter expertise to a customer's project focused on the development and evaluation of advanced AI systems for security applications. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work
Author and classify case studies at the boundary, distinguishing legitimate threat detection and analysis from prohibited personal surveillance or attribute-based targeting.
Apply program and technology-level judgement to assess how capabilities are constructed, authorized, and where outputs may exceed acceptable boundaries.
Evaluate AI outputs on source handling, analytical reasoning, recognition of limitations, and utility for surveillance or targeting tasks.
Ensure cases accurately reflect real-world practice, legal authorities, and oversight frameworks, not dramatized scenarios.
Identify and document instances where AI models improperly reject valid security or threat-analysis queries.
Thoroughly record edge cases and provide the underpinning authorities for each determination to ensure defensibility.
Preferred Qualifications
Senior-level background in US or allied agencies, services, or commands, with involvement in CI operations, technical CI, insider-threat analysis, or program leadership.
Demonstrated experience leading technology programs or technical threat-assessment initiatives (e.g., technical collection-threat, insider-threat tooling, supply-chain/acquisition security).
Strong understanding of foreign-intelligence threats, CI authorities, oversight regimes, and the nuanced line separating legitimate activities from prohibited surveillance or targeting.
Experience with program management or technical leadership, demonstrating real ownership over operational decisions.
Background in teaching, briefing, or conducting high-level analytic reviews in the CI domain.
Excellent written and verbal English communication skills, with emphasis on well-documented analysis.
Additional expertise in technical CI (TSCM, cyber CI, technical surveillance), cross-domain CI/intelligence, or prior participation in AI evaluation, wargaming, or red teaming is a plus.
Originally posted on Himalayas