Grants

Use this database to see grants and impact investments we have recommended.

To learn how to apply for a grant, read this page.

To see our principles for including grants in this database, read this page.

Funding Type
Focus Area
Year
Amount
Download Spreadsheet
  • Grant
    Title
  • Organization
    Name
  • Focus
    Area
  • Amount
  • Date
October 2020
Grant Title

Smitha Milli — Participatory Approaches to Machine Learning Workshop

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$370
Date
October 2020
November 2018
Grant Title

Daniel Kang, Jacob Steinhardt, Yi Sun, and Alex Zhai — Study of the Robustness of Machine Learning Models

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$2,351
Date
November 2018
April 2021
Grant Title

International Conference on Learning Representations — Security and Safety in Machine Learning Systems Workshop

Organization Name

International Conference on Learning Representations

Focus Area
Potential Risks from Advanced AI
Amount
$3,000
Date
April 2021
May 2020
Grant Title

International Conference on Learning Representations — Machine Learning Paper Awards

Organization Name

International Conference on Learning Representations

Focus Area
Potential Risks from Advanced AI
Amount
$3,500
Date
May 2020
January 2020
Grant Title

Stanford University — AI Safety Seminar

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$6,500
Date
January 2020
March 2022
Grant Title

Egor Krasheninnikov — Research Collaboration with David Krueger

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$6,526
Date
March 2022
March 2022
Grant Title

Usman Anwar — Research Collaboration with David Krueger

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$6,526
Date
March 2022
April 2018
Grant Title

Stanford University — NIPS Workshop on Machine Learning Security

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$6,771
Date
April 2018
December 2022
Grant Title

Simon McGregor — AI Risk Workshop

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$7,000
Date
December 2022
August 2018
Grant Title

GoalsRL — Workshop on Goal Specifications for Reinforcement Learning

Organization Name

GoalsRL

Focus Area
Potential Risks from Advanced AI
Amount
$7,500
Date
August 2018
October 2022
Grant Title

Catherine Brewer — OxAI Safety Hub

Organization Name

OxAI Safety Hub

Focus Area
Potential Risks from Advanced AI
Amount
$11,622
Date
October 2022
October 2022
Grant Title

Thomas Liao — Foundation Model Tracker

Organization Name

Foundation Model Tracker

Focus Area
Potential Risks from Advanced AI
Amount
$15,000
Date
October 2022
June 2020
Grant Title

Andrew Lohn — Paper on Machine Learning Model Robustness

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$15,000
Date
June 2020
January 2020
Grant Title

Press Shop — Support for Human Compatible

Organization Name

Press Shop

Focus Area
Potential Risks from Advanced AI
Amount
$17,000
Date
January 2020
February 2023
Grant Title

Alignment Research Engineer Accelerator — AI Safety Technical Program

Organization Name

Alignment Research Engineer Accelerator

Focus Area
Potential Risks from Advanced AI
Amount
$18,800
Date
February 2023
September 2022
Grant Title

Centre for the Governance of AI — Research Assistant

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$19,200
Date
September 2022
May 2021
Grant Title

Jennifer Dodd — Machine Learning Self-Study

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$19,200
Date
May 2021
January 2023
Grant Title

Adam Jermyn — Independent AI Alignment Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$19,231
Date
January 2023
April 2022
Grant Title

Center for Long-Term Cybersecurity — AI Standards (2022)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$20,000
Date
April 2022
October 2020
Grant Title

Center for a New American Security — AI Governance Projects

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$24,350
Date
October 2020
November 2023
Grant Title

ETH Zurich Foundation (USA) — Machine Learning Research Support

Organization Name

ETH Zurich Fondation (USA)

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
November 2023
September 2020
Grant Title

Rice, Hadley, Gates and Manuel LLC — AI Accident Risk and Technology Competition

Organization Name

Rice, Hadley, Gates & Manuel LLC

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
September 2020
March 2017
Grant Title

Stanford University — Percy Liang Planning Grant

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
March 2017
July 2021
Grant Title

Center for Long-Term Cybersecurity — AI Standards (2021)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
July 2021
March 2017
Grant Title

Distill Prize for Clarity in Machine Learning — General Support

Organization Name

Distill Prize for Clarity in Machine Learning

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
March 2017
October 2023
Grant Title

University of California, Berkeley — AI Alignment Workshop

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$26,000
Date
October 2023
April 2022
Grant Title

OpenMined — Research on Privacy-Enhancing Technologies and AI Safety

Organization Name

OpenMined

Focus Area
Potential Risks from Advanced AI
Amount
$28,320
Date
April 2022
January 2020
Grant Title

RAND Corporation — Research on the State of AI Assurance Methods

Organization Name

The RAND Corporation

Focus Area
Potential Risks from Advanced AI
Amount
$30,751
Date
January 2020
December 2016
Grant Title

AI Impacts — General Support (2016)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$32,000
Date
December 2016
July 2023
Grant Title

Berkeley Existential Risk Initiative — Lab Retreat

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$35,000
Date
July 2023
February 2023
Grant Title

Brian Christian — Psychology Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$37,903
Date
February 2023
March 2023
Grant Title

San José State University — AI Research

Organization Name

California State University, San José

Focus Area
Potential Risks from Advanced AI
Amount
$39,000
Date
March 2023
June 2022
Grant Title

Berkeley Existential Risk Initiative — Language Model Alignment Research

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$40,000
Date
June 2022
April 2022
Grant Title

AI Safety Support — Research on Trends in Machine Learning

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$42,000
Date
April 2022
March 2024
Grant Title

Berkeley Existential Risk Initiative — Latent Adversarial Training Project 

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$45,000
Date
March 2024
November 2022
Grant Title

AI Safety Hub — Safety Labs

Organization Name

AI Safety Hub

Focus Area
Potential Risks from Advanced AI
Amount
$47,359
Date
November 2022
December 2022
Grant Title

FAR AI — Inverse Scaling Prize

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$49,500
Date
December 2022
April 2020
Grant Title

World Economic Forum — Global AI Council Workshop

Organization Name

World Economic Forum

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
April 2020
December 2022
Grant Title

FAR AI — Interpretability Research

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
December 2022
May 2023
Grant Title

Mila — Workshop on Human-Level AI

Organization Name

Mila

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
May 2023
November 2020
Grant Title

AI Impacts — General Support (2020)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
November 2020
September 2022
Grant Title

Centre for the Governance of AI — Compute Strategy Workshop

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$50,532
Date
September 2022
August 2023
Grant Title

Swiss AI Safety Summer Camp — AI Safety Bootcamp

Organization Name

Swiss AI Safety Summer Camp

Focus Area
Potential Risks from Advanced AI
Amount
$51,248
Date
August 2023
February 2022
Grant Title

Michael Page — Career Transition Grant

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$52,500
Date
February 2022
March 2020
Grant Title

Johns Hopkins University — Support for Jared Kaplan and Brice Ménard

Organization Name

Johns Hopkins University

Focus Area
Potential Risks from Advanced AI
Amount
$55,000
Date
March 2020
March 2021
Grant Title

Brian Christian — The Alignment Problem Book Promotion

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$60,859
Date
March 2021
September 2020
Grant Title

Center for International Security and Cooperation — AI Accident Risk and Technology Competition

Organization Name

Center for International Security and Cooperation

Focus Area
Potential Risks from Advanced AI
Amount
$67,000
Date
September 2020
September 2023
Grant Title

Berkeley Existential Risk Initiative — Scalable Oversight Dataset

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
September 2023
July 2021
Grant Title

Applied Research Laboratory for Intelligence and Security — Report on Security Clearances

Organization Name

Applied Research Laboratory for Intelligence and Security

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
July 2021
July 2021
Grant Title

Berkeley Existential Risk Initiative — MineRL BASALT Competition

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
July 2021
October 2023
Grant Title

Berkeley Existential Risk Initiative — University Collaboration Program

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
October 2023
January 2023
Grant Title

Neel Nanda — Interpretability Research

Organization Name

Neel Nanda

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
January 2023
September 2022
Grant Title

AI Alignment Awards — Shutdown Problem Contest

Organization Name

AI Alignment Awards

Focus Area
Potential Risks from Advanced AI
Amount
$75,000
Date
September 2022
August 2023
Grant Title

Legal Priorities Project — Law & AI Summer Research Fellowship

Organization Name

Legal Priorities Project

Focus Area
Potential Risks from Advanced AI
Amount
$75,000
Date
August 2023
September 2021
Grant Title

Stanford University — AI Index

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$78,000
Date
September 2021
January 2023
Grant Title

University of Toronto — Alignment Research

Organization Name

University of Toronto

Focus Area
Potential Risks from Advanced AI
Amount
$80,000
Date
January 2023
March 2023
Grant Title

University of Illinois — AI Alignment Research

Organization Name

University of Illinois

Focus Area
Potential Risks from Advanced AI
Amount
$80,000
Date
March 2023
August 2021
Grant Title

UC Berkeley — Adversarial Robustness Research (Aditi Raghunathan)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$87,829
Date
August 2021
December 2022
Grant Title

Apart Research — AI Alignment Hackathons

Organization Name

Apart Research

Focus Area
Potential Risks from Advanced AI
Amount
$89,000
Date
December 2022
November 2022
Grant Title

Berkeley Existential Risk Initiative — General Support (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
November 2022
November 2022
Grant Title

Jacob Steinhardt — AI Alignment Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
November 2022
February 2023
Grant Title

Responsible AI Collaborative — AI Incident Database

Organization Name

Responsible AI Collaborative

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
February 2023
June 2018
Grant Title

AI Impacts — General Support (2018)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
June 2018
July 2018
Grant Title

Stanford University — Machine Learning Security Research Led by Dan Boneh and Florian Tramer

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
July 2018
March 2023
Grant Title

FAR AI — AI Interpretability Research

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
March 2023
January 2023
Grant Title

University of British Columbia — AI Alignment Research

Organization Name

University of British Columbia

Focus Area
Potential Risks from Advanced AI
Amount
$100,375
Date
January 2023
September 2021
Grant Title

Center for a New American Security — Risks from Militarized AI

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$101,187
Date
September 2021
September 2023
Grant Title

University of Pennsylvania — AI Governance Roundtables

Organization Name

University of Pennsylvania

Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
September 2023
November 2022
Grant Title

Mordechai Rorvig — Independent AI Journalism

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
November 2022
December 2022
Grant Title

Jérémy Scheurer — Independent AI Alignment Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
December 2022
February 2022
Grant Title

AI Funding for Individuals — Work and Study Support

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$113,372
Date
February 2022
January 2023
Grant Title

UC Santa Cruz — Adversarial Robustness Research (2023)

Organization Name

University of California, Santa Cruz

Focus Area
Potential Risks from Advanced AI
Amount
$114,000
Date
January 2023
September 2023
Grant Title

Northeastern University — Mechanistic Interpretability Research

Organization Name

Northeastern University

Focus Area
Potential Risks from Advanced AI
Amount
$116,072
Date
September 2023
October 2020
Grant Title

Center for a New American Security — AI and Security Projects

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$116,744
Date
October 2020
September 2020
Grant Title

Center for Strategic and International Studies — AI Accident Risk and Technology Competition

Organization Name

Center for Strategic and International Studies

Focus Area
Potential Risks from Advanced AI
Amount
$118,307
Date
September 2020
November 2023
Grant Title

Stanford University — AI Economic Impacts Workshop

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$120,000
Date
November 2023
September 2023
Grant Title

Surge AI — Data Production for AI Safety Research

Organization Name

Surge AI

Focus Area
Potential Risks from Advanced AI
Amount
$126,250
Date
September 2023
November 2023
Grant Title

Alignment Research Engineer Accelerator — AI Safety Technical Program (2023)

Organization Name

Alignment Research Engineer Accelerator

Focus Area
Potential Risks from Advanced AI
Amount
$127,350
Date
November 2023
April 2023
Grant Title

University of Utah — AI Alignment Research

Organization Name

University of Utah

Focus Area
Potential Risks from Advanced AI
Amount
$140,000
Date
April 2023
April 2022
Grant Title

Berkeley Existential Risk Initiative — David Krueger Collaboration

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$140,050
Date
April 2022
May 2023
Grant Title

AI Safety Support — AI Safety Technical Program (May 2023)

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$146,165
Date
May 2023
June 2018
Grant Title

Machine Intelligence Research Institute — AI Safety Retraining Program

Organization Name

Machine Intelligence Research Institute

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
June 2018
January 2021
Grant Title

Berryville Institute of Machine Learning — Machine Learning Security Research

Organization Name

Berryville Institute of Machine Learning

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
January 2021
January 2020
Grant Title

Berkeley Existential Risk Initiative — General Support

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
January 2020
July 2022
Grant Title

Stanford University — AI Alignment Research (Barrett and Viteri)

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$153,820
Date
July 2022
April 2023
Grant Title

Rethink Priorities — AI Governance Research (2023)

Organization Name

Rethink Priorities

Focus Area
Potential Risks from Advanced AI
Amount
$154,810
Date
April 2023
February 2018
Grant Title

AI Scholarships — Scholarship Support (2018)

Organization Name

AI Scholarships

Focus Area
Potential Risks from Advanced AI
Amount
$159,000
Date
February 2018
September 2023
Grant Title

FAR AI — Alignment Workshop

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$166,500
Date
September 2023
December 2022
Grant Title

Purdue University — Language Model Research

Organization Name

Purdue University

Focus Area
Potential Risks from Advanced AI
Amount
$170,000
Date
December 2022
May 2021
Grant Title

Daniel Dewey — AI Alignment Project

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$175,000
Date
May 2021
August 2022
Grant Title

Daniel Dewey — AI Alignment Projects (2022)

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$175,000
Date
August 2022
February 2023
Grant Title

Epoch — AI Worldview Investigations

Organization Name

Epoch

Focus Area
Potential Risks from Advanced AI
Amount
$188,558
Date
February 2023
November 2021
Grant Title

Berkeley Existential Risk Initiative — SERI MATS Program

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$195,000
Date
November 2021
November 2016
Grant Title

Electronic Frontier Foundation — Artificial Intelligence Scenarios and Social Impacts

Organization Name

Electronic Frontier Foundation

Focus Area
Potential Risks from Advanced AI
Amount
$199,000
Date
November 2016
November 2019
Grant Title

UC Berkeley — Center for Human-Compatible AI (2019)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$200,000
Date
November 2019
February 2024
Grant Title

Center for Long-Term Cybersecurity — AI Risk Management Frameworks (2024)

Organization Name

Center for Long-Term Cybersecurity

Focus Area
Potential Risks from Advanced AI
Amount
$200,000
Date
February 2024
August 2022
Grant Title

Arizona State University — Adversarial Robustness Research

Organization Name

Arizona State University

Focus Area
Potential Risks from Advanced AI
Amount
$200,000
Date
August 2022
September 2022
Grant Title

AI Safety Hub — Startup Costs

Organization Name

AI Safety Hub

Focus Area
Potential Risks from Advanced AI
Amount
$203,959
Date
September 2022
April 2022
Grant Title

Berkeley Existential Risk Initiative — AI Standards (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
April 2022
March 2021
Grant Title

Berkeley Existential Risk Initiative – SERI Summer Fellowships

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
March 2021