Best Scientific Cybersecurity Paper Competition
Nominations open in January for the 2025 Competition.

About the Competition

In order to encourage the development of the scientific foundations of cybersecurity, the National Security Agency (NSA) established The Annual Best Scientific Cybersecurity Paper Competition. NSA invites nominations of papers that show an outstanding contribution to cybersecurity science. A set of Distinguished Experts will review the nominations according to the criteria below. Awardees will be invited to NSA to receive the award and present the winning paper to an audience of cybersecurity experts.

Winning Paper

12th Annual Best Scientific Cybersecurity Paper Competition Winners

The National Security Agency (NSA) has awarded the 12th Annual Best Scientific Cybersecurity Paper Competition to “Decoding Trust: Comprehensive Assessment of Trustworthiness in GPT Models.” The winning paper, authored by 19 researchers including Professors Dawn Song (UC Berkeley), Bo Li (UIUC), and Sanmi Koyejo (Stanford), proposes a groundbreaking evaluation framework for assessing the trustworthiness of large language models (LLMs) such as GPTs.

Dr. Adam Tagert, Technical Director of NSA’s Science of Security program, praised the work: “This framework is a noteworthy foundational advancement, providing essential metrics for evaluating and comparing future LLMs rigorously.”

Two papers received honorable mentions this year:

“Ethical Frameworks and Computer Security Trolley Problems: Foundations for Conversations” by Tadayoshi Kohno (University of Washington), Yasemin Acar (Paderborn University/George Washington University), and Wulf Loh (University of Tübingen).
“SoK: I Have the (Developer) Power! Sample Size Estimation for Statistical Tests in Developer-Centered Usable Security” by Anna-Marie Ortloff, Christian Tiefenau, and Matthew Smith (University of Bonn).
Nominations for the 13th Annual Competition, recognizing papers published in 2024, will open on January 15, 2025. Winners will be announced at the end of 2025.

Read more: https://www.nsa.gov/Press-Room/News-Highlights/Article/Article/3990748/nsa-awards-authors-of-assessment-of-trustworthiness-in-gpt-models/

 

View Competition Archives

Nominations & Eligibility

Papers published in peer-reviewed journals, magazines, or technical conferences are eligible for nomination. The date of the publication must be between January 1st 2024 and December 31st 2024. Nominations include, in 500 words or less, a nomination statement describing the scientific contribution of the paper and explaining why this paper merits the award. A strong nomination statement is desired and will be used as part of the criteria when evaluating paper submissions. Nominated papers must be available in English and pdf format. Nominations must be submitted via this site. The nominator may not be an author or co-author of the nominated paper. If a paper includes a reviewer as a co-author it may not be considered for an award. Papers may come from any field of cybersecurity research. (Please refer to What is Security Science?)

For a set of potential sources for paper nominations, please see: https://sos-vo.org/papercompetition/sources-2021. To suggest additional sources, please email BSCPC@cps-vo.org .

Nominate a Paper

Evaluations

A set of distinguished experts will review the submitted nominations and provided individual assessments to the NSA Research Directorate.

The following individuals will serve as distinguished experts for the 12th Annual Competition:

DR. EVAN AUSTIN, Naval Research Laboratory
DR. CARRIE GATES, Bank of America
DR. VIRGIL GILGOR, Carnegie Mellon University
DR. PAUL KOCHER, Independent Researcher
DR. SEAN PEISERT, Lawrence Berkeley National Laboratory
MR. PHIL VENABLES, Google
DR. ARUN VISHWANATH, Cybersecurity Advisor
DR. LAURIE WILLIAMS, North Carolina State University
MS. MARY ELLEN ZURKO, MIT Lincoln Laboratory

Distinguished Expert Emeritus
DR. WHITFIELD DIFFIE, Cybersecurity Advisor

For additional information on the review team.

The NSA Research Directorate recommended awardees to the NSA Director of Research, whose decision is final. Considerations in the evaluation of the nominated paper may include:

Scientific merit and significance of the work reported, the degree to which the paper exemplifies how to perform and report scientific research in cybersecurity.

Timeline

Submission Period Begins: January 15, 2025
Submission Period for Entries Ends: April 15, 2025 AOE
Evaluation Process for Entries Begins: April 20, 2025
Winners Notified: By October, 2025
Winners Announced: Fall 2025

SoS Literature Survey