Funding Type: Grants

Cambridge in America — Data Science Benchmark  

Image courtesy of Cambridge in America

Open Philanthropy recommended a gift of $517,693 over two years to Cambridge in America to support the development of a benchmark for evaluating the performance of Large Language Model (LLM) agents in data science tasks. The project will be led by Professors Lorenzo Pacchiardi, José Hernández-Orallo, and Lucy Cheke.

This gift was funded via a request for proposals for projects benchmarking LLM agents on consequential real-world tasks and falls within our focus area of potential risks from advanced artificial intelligence.

William & Mary — AidData

Open Philanthropy recommended a contract of $105,767 with William & Mary to support AidData, a research lab at the college that seeks to make development finance more transparent and effective.

This follows our December 2022 support and falls within our focus area of global aid policy.

New York University — LLM Cybersecurity Benchmark

Open Philanthropy recommended a grant of $2,077,350 to New York University to support a project to develop a benchmark for large language model (LLM) agent cyber operations capabilities, in partnership with New Foundry. The project will be led by Alex Leader, Dan Zhao, and He He. 

This grant was funded via a request for proposals for projects benchmarking LLM agents on consequential real-world tasks and falls within our focus area of potential risks from advanced artificial intelligence.

RAND Corporation — Emerging Technology Fellowships and Research (2024)

Open Philanthropy gave a gift of $2.5 million to RAND Corporation, to be spent at RAND President Jason Matheny’s discretion. Matheny has designated this funding to support two initiatives: a technology policy training program, and a research fund to help produce information that policymakers need to make wise decisions about emerging technology and security priorities.

We have been impressed with Matheny’s past work on technology and security — at IARPA, at the Center for Security and Technology, and in the White House — and we believe RAND is well-positioned to use such funding to great impact. This gift was recommended by Luke Muehlhauser, who leads our grantmaking on AI governance.

This follows our April 2023 support and falls within our work on potential risks from advanced artificial intelligence.