Use this database to see grants and impact investments we have recommended.
To learn how to apply for a grant, read this page.
To see our principles for including grants in this database, read this page.
Grants
-
Grant
Title -
Organization
Name -
Focus
Area -
Amount
-
Date
December 2022
Grant Title
FAR AI — Interpretability Research
Organization Name
FAR AI
Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
December 2022
December 2022
Grant Title
FAR AI — Inverse Scaling Prize
Organization Name
FAR AI
Focus Area
Potential Risks from Advanced AI
Amount
$49,500
Date
December 2022
June 2023
Grant Title
Foundation for American Innovation — AI Safety Policy Advocacy
Organization Name
Foundation for American Innovation
Focus Area
Potential Risks from Advanced AI
Amount
$552,500
Date
June 2023
October 2021
Grant Title
Fund for Alignment Research — Language Model Misalignment
Organization Name
FAR AI
Focus Area
Potential Risks from Advanced AI
Amount
$425,800
Date
October 2021
August 2022
Grant Title
Fund for Alignment Research — Language Model Misalignment (2022)
Organization Name
FAR AI
Focus Area
Potential Risks from Advanced AI
Amount
$463,693
Date
August 2022
April 2022
Grant Title
Funding for AI Alignment Projects Working With Deep Learning Systems
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$15,700,072
Date
April 2022
March 2024
Grant Title
Future House — Benchmarks for Biology Research and Development
Organization Name
Future House
Focus Area
Potential Risks from Advanced AI
Amount
$2,946,250
Date
March 2024
March 2017
Grant Title
Future of Humanity Institute — General Support
Organization Name
Future of Humanity Institute
Focus Area
Potential Risks from Advanced AI
Amount
$1,995,425
Date
March 2017
August 2015
Grant Title
Future of Life Institute — Artificial Intelligence Risk Reduction
Organization Name
Future of Life Institute
Focus Area
Potential Risks from Advanced AI
Amount
$1,186,000
Date
August 2015
March 2024
Grant Title
FutureSearch – Benchmark for Language Model Forecasting
Organization Name
FutureSearch
Focus Area
Potential Risks from Advanced AI
Amount
$606,600
Date
March 2024
June 2016
Grant Title
George Mason University — Research into Future Artificial Intelligence Scenarios
Organization Name
George Mason University
Focus Area
Potential Risks from Advanced AI
Amount
$277,435
Date
June 2016
January 2019
Grant Title
Georgetown University — Center for Security and Emerging Technology
Organization Name
Center for Security and Emerging Technology
Focus Area
Potential Risks from Advanced AI
Amount
$55,000,000
Date
January 2019
December 2021
Grant Title
Georgetown University — Policy Fellowship (2021)
Organization Name
Georgetown University
Focus Area
Potential Risks from Advanced AI
Amount
$246,564
Date
December 2021
December 2022
Grant Title
Georgetown University — Policy Fellowship (2022)
Organization Name
Georgetown University
Focus Area
Potential Risks from Advanced AI
Amount
$239,061
Date
December 2022
August 2018
Grant Title
GoalsRL — Workshop on Goal Specifications for Reinforcement Learning
Organization Name
GoalsRL
Focus Area
Potential Risks from Advanced AI
Amount
$7,500
Date
August 2018
August 2023
Grant Title
Guide Labs — Open Access Interpretability Project
Organization Name
Guide Labs
Focus Area
Potential Risks from Advanced AI
Amount
$750,000
Date
August 2023
January 2024
Grant Title
Harvard University — AI Interpretability, Controllability, and Safety Research
Organization Name
Harvard University
Focus Area
Potential Risks from Advanced AI
Amount
$1,000,000
Date
January 2024
March 2022
Grant Title
Hofvarpnir Studios — Compute Cluster for AI Safety Research
Organization Name
Hofvarpnir Studios
Focus Area
Potential Risks from Advanced AI
Amount
$1,443,540
Date
March 2022
January 2024
Grant Title
Institute for AI Policy & Strategy — General Support
Organization Name
Institute for AI Policy and Strategy
Focus Area
Potential Risks from Advanced AI
Amount
$2,916,898
Date
January 2024
May 2020
Grant Title
International Conference on Learning Representations — Machine Learning Paper Awards
Organization Name
International Conference on Learning Representations
Focus Area
Potential Risks from Advanced AI
Amount
$3,500
Date
May 2020
April 2021
Grant Title
International Conference on Learning Representations — Security and Safety in Machine Learning Systems Workshop
Organization Name
International Conference on Learning Representations
Focus Area
Potential Risks from Advanced AI
Amount
$3,000
Date
April 2021
November 2022
Grant Title
Jacob Steinhardt — AI Alignment Research
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
November 2022
May 2021
Grant Title
Jennifer Dodd — Machine Learning Self-Study
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$19,200
Date
May 2021
December 2022
Grant Title
Jérémy Scheurer — Independent AI Alignment Research
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
December 2022
March 2020
Grant Title
Johns Hopkins University — Support for Jared Kaplan and Brice Ménard
Organization Name
Johns Hopkins University
Focus Area
Potential Risks from Advanced AI
Amount
$55,000
Date
March 2020
April 2023
Grant Title
Leap Labs — Interpretability Research
Organization Name
Leap Labs
Focus Area
Potential Risks from Advanced AI
Amount
$230,000
Date
April 2023
January 2024
Grant Title
Lee Foster — LLM Misuse Database
Organization Name
Lee Foster
Focus Area
Potential Risks from Advanced AI
Amount
$223,000
Date
January 2024
August 2023
Grant Title
Legal Priorities Project — Law & AI Summer Research Fellowship
Organization Name
Legal Priorities Project
Focus Area
Potential Risks from Advanced AI
Amount
$75,000
Date
August 2023
November 2023
Grant Title
London Initiative for Safe AI (LISA) — General Support
Organization Name
London Initiative for Safe AI
Focus Area
Potential Risks from Advanced AI
Amount
$237,000
Date
November 2023
February 2023
Grant Title
Longview Philanthropy — AI Policy Development at the OECD
Organization Name
Longview Philanthropy
Focus Area
Potential Risks from Advanced AI
Amount
$770,076
Date
February 2023
June 2018
Grant Title
Machine Intelligence Research Institute — AI Safety Retraining Program
Organization Name
Machine Intelligence Research Institute
Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
June 2018
August 2016
Grant Title
Machine Intelligence Research Institute — General Support (2016)
Organization Name
Machine Intelligence Research Institute
Focus Area
Potential Risks from Advanced AI
Amount
$500,000
Date
August 2016
October 2017
Grant Title
Machine Intelligence Research Institute — General Support (2017)
Organization Name
Machine Intelligence Research Institute
Focus Area
Potential Risks from Advanced AI
Amount
$3,750,000
Date
October 2017
February 2019
Grant Title
Machine Intelligence Research Institute — General Support (2019)
Organization Name
Machine Intelligence Research Institute
Focus Area
Potential Risks from Advanced AI
Amount
$2,652,500
Date
February 2019
February 2020
Grant Title
Machine Intelligence Research Institute — General Support (2020)
Organization Name
Machine Intelligence Research Institute
Focus Area
Potential Risks from Advanced AI
Amount
$7,703,750
Date
February 2020
February 2021
Grant Title
Massachusetts Institute of Technology — Adversarial Robustness Research
Organization Name
Massachusetts Institute of Technology
Focus Area
Potential Risks from Advanced AI
Amount
$1,430,000
Date
February 2021
November 2020
Grant Title
Massachusetts Institute of Technology — AI Trends and Impacts Research (2020)
Organization Name
Massachusetts Institute of Technology
Focus Area
Potential Risks from Advanced AI
Amount
$550,688
Date
November 2020
March 2022
Grant Title
Massachusetts Institute of Technology — AI Trends and Impacts Research (2022)
Organization Name
Massachusetts Institute of Technology
Focus Area
Potential Risks from Advanced AI
Amount
$13,277,348
Date
March 2022
July 2023
Grant Title
Massachusetts Institute of Technology — AI Trends and Impacts Research (2023)
Organization Name
Massachusetts Institute of Technology
Focus Area
Potential Risks from Advanced AI
Amount
$2,911,324
Date
July 2023
September 2023
Grant Title
Matthew Kenney – Language Model Capabilities Benchmarking
Organization Name
Matthew Kenney
Focus Area
Potential Risks from Advanced AI
Amount
$397,350
Date
September 2023
February 2022
Grant Title
Michael Page — Career Transition Grant
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$52,500
Date
February 2022
November 2021
Grant Title
Mila — Research Project on Artificial Intelligence
Organization Name
Montreal Institute for Learning Algorithms
Focus Area
Potential Risks from Advanced AI
Amount
$237,931
Date
November 2021
May 2023
Grant Title
Mila — Workshop on Human-Level AI
Organization Name
Mila
Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
May 2023
August 2023
Grant Title
Modulo Research — AI Safety Research
Organization Name
Modulo Research
Focus Area
Potential Risks from Advanced AI
Amount
$408,255
Date
August 2023
July 2017
Grant Title
Montreal Institute for Learning Algorithms — AI Safety Research
Organization Name
Montreal Institute for Learning Algorithms
Focus Area
Potential Risks from Advanced AI
Amount
$2,400,000
Date
July 2017
November 2022
Grant Title
Mordechai Rorvig — Independent AI Journalism
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
November 2022
February 2022
Grant Title
National Academies of Sciences, Engineering, and Medicine — Safety-Critical Machine Learning
Organization Name
National Academies of Sciences, Engineering, and Medicine
Focus Area
Potential Risks from Advanced AI
Amount
$309,441
Date
February 2022
April 2023
Grant Title
National Science Foundation — Safe Learning-Enabled Systems
Organization Name
National Science Foundation
Focus Area
Potential Risks from Advanced AI
Amount
$5,000,000
Date
April 2023
January 2023
Grant Title
Neel Nanda — Interpretability Research
Organization Name
Neel Nanda
Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
January 2023
November 2022
Grant Title
Northeastern University — Large Language Model Interpretability Research
Organization Name
Northeastern University
Focus Area
Potential Risks from Advanced AI
Amount
$562,128
Date
November 2022
September 2023
Grant Title
Northeastern University — Mechanistic Interpretability Research
Organization Name
Northeastern University
Focus Area
Potential Risks from Advanced AI
Amount
$116,072
Date
September 2023
May 2018
Grant Title
Open Phil AI Fellowship — 2018 Class
Organization Name
Open Phil AI Fellowship
Focus Area
Potential Risks from Advanced AI
Amount
$1,245,000
Date
May 2018
May 2019
Grant Title
Open Phil AI Fellowship — 2019 Class
Organization Name
Open Phil AI Fellowship
Focus Area
Potential Risks from Advanced AI
Amount
$2,325,000
Date
May 2019
May 2020
Grant Title
Open Phil AI Fellowship — 2020 Class
Organization Name
Open Phil AI Fellowship
Focus Area
Potential Risks from Advanced AI
Amount
$2,300,000
Date
May 2020
April 2021
Grant Title
Open Phil AI Fellowship — 2021 Class
Organization Name
Open Phil AI Fellowship
Focus Area
Potential Risks from Advanced AI
Amount
$1,000,000
Date
April 2021
April 2022
Grant Title
Open Phil AI Fellowship — 2022 Class
Organization Name
Open Phil AI Fellowship
Focus Area
Potential Risks from Advanced AI
Amount
$1,840,000
Date
April 2022
January 2022
Grant Title
Open Philanthropy Technology Policy Fellowship (2022)
Organization Name
Focus Area
Biosecurity & Pandemic Preparedness
Amount
$2,869,940
Date
January 2022
March 2017
Grant Title
OpenAI — General Support
Organization Name
OpenAI
Focus Area
Potential Risks from Advanced AI
Amount
$30,000,000
Date
March 2017
April 2022
Grant Title
OpenMined — Research on Privacy-Enhancing Technologies and AI Safety
Organization Name
OpenMined
Focus Area
Potential Risks from Advanced AI
Amount
$28,320
Date
April 2022
September 2023
Grant Title
OpenMined — Software for AI Audits
Organization Name
OpenMined
Focus Area
Potential Risks from Advanced AI
Amount
$6,000,000
Date
September 2023
May 2018
Grant Title
Ought — General Support (2018)
Organization Name
Ought
Focus Area
Potential Risks from Advanced AI
Amount
$525,000
Date
May 2018
November 2019
Grant Title
Ought — General Support (2019)
Organization Name
Ought
Focus Area
Potential Risks from Advanced AI
Amount
$1,000,000
Date
November 2019
January 2020
Grant Title
Ought — General Support (2020)
Organization Name
Ought
Focus Area
Potential Risks from Advanced AI
Amount
$1,593,333
Date
January 2020
May 2023
Grant Title
Owain Evans Research Group — AI Evaluations Research
Organization Name
Effective Ventures Foundation USA
Focus Area
Potential Risks from Advanced AI
Amount
$838,620
Date
May 2023
January 2020
Grant Title
Press Shop — Support for Human Compatible
Organization Name
Press Shop
Focus Area
Potential Risks from Advanced AI
Amount
$17,000
Date
January 2020
December 2022
Grant Title
Purdue University — Language Model Research
Organization Name
Purdue University
Focus Area
Potential Risks from Advanced AI
Amount
$170,000
Date
December 2022
April 2023
Grant Title
RAND Corporation — Emerging Technology Fellowships and Research
Organization Name
RAND Corporation
Focus Area
Potential Risks from Advanced AI
Amount
$5,500,000
Date
April 2023
October 2023
Grant Title
RAND Corporation — Emerging Technology Initiatives
Organization Name
RAND Corporation
Focus Area
Potential Risks from Advanced AI
Amount
$10,500,000
Date
October 2023
January 2020
Grant Title
RAND Corporation — Research on the State of AI Assurance Methods
Organization Name
The RAND Corporation
Focus Area
Potential Risks from Advanced AI
Amount
$30,751
Date
January 2020
November 2021
Grant Title
Redwood Research — General Support
Organization Name
Redwood Research
Focus Area
Potential Risks from Advanced AI
Amount
$9,420,000
Date
November 2021
August 2022
Grant Title
Redwood Research — General Support (2022)
Organization Name
Redwood Research
Focus Area
Potential Risks from Advanced AI
Amount
$10,700,000
Date
August 2022
June 2023
Grant Title
Redwood Research — General Support (2023)
Organization Name
Redwood Research
Focus Area
Potential Risks from Advanced AI
Amount
$5,300,000
Date
June 2023
February 2023
Grant Title
Responsible AI Collaborative — AI Incident Database
Organization Name
Responsible AI Collaborative
Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
February 2023
July 2021
Grant Title
Rethink Priorities — AI Governance Research (2021)
Organization Name
Rethink Priorities
Focus Area
Potential Risks from Advanced AI
Amount
$612,185
Date
July 2021
March 2022
Grant Title
Rethink Priorities — AI Governance Research (2022)
Organization Name
Rethink Priorities
Focus Area
Potential Risks from Advanced AI
Amount
$2,728,319
Date
March 2022
April 2023
Grant Title
Rethink Priorities — AI Governance Research (2023)
Organization Name
Rethink Priorities
Focus Area
Potential Risks from Advanced AI
Amount
$154,810
Date
April 2023
April 2023
Grant Title
Rethink Priorities — AI Governance Workshop
Organization Name
Rethink Priorities
Focus Area
Potential Risks from Advanced AI
Amount
$302,390
Date
April 2023
September 2020
Grant Title
Rice, Hadley, Gates and Manuel LLC — AI Accident Risk and Technology Competition
Organization Name
Rice, Hadley, Gates & Manuel LLC
Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
September 2020
March 2023
Grant Title
San José State University — AI Research
Organization Name
California State University, San José
Focus Area
Potential Risks from Advanced AI
Amount
$39,000
Date
March 2023
December 2022
Grant Title
Simon McGregor — AI Risk Workshop
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$7,000
Date
December 2022
October 2020
Grant Title
Smitha Milli — Participatory Approaches to Machine Learning Workshop
Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$370
Date
October 2020
August 2021
Grant Title
Stanford University — Adversarial Robustness Research (Dimitris Tsipras)
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$330,792
Date
August 2021
August 2021
Grant Title
Stanford University — Adversarial Robustness Research (Shibani Santurkar)
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$330,792
Date
August 2021
November 2021
Grant Title
Stanford University — AI Alignment Research (2021)
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$1,500,000
Date
November 2021
July 2022
Grant Title
Stanford University — AI Alignment Research (Barrett and Viteri)
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$153,820
Date
July 2022
November 2023
Grant Title
Stanford University — AI Economic Impacts Workshop
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$120,000
Date
November 2023
September 2021
Grant Title
Stanford University — AI Index
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$78,000
Date
September 2021
January 2020
Grant Title
Stanford University — AI Safety Seminar
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$6,500
Date
January 2020
April 2023
Grant Title
Stanford University — Language Model Evaluations
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
April 2023
July 2018
Grant Title
Stanford University — Machine Learning Security Research Led by Dan Boneh and Florian Tramer
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
July 2018
April 2018
Grant Title
Stanford University — NIPS Workshop on Machine Learning Security
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$6,771
Date
April 2018
March 2017
Grant Title
Stanford University — Percy Liang Planning Grant
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
March 2017
May 2017
Grant Title
Stanford University — Support for Percy Liang
Organization Name
Stanford University
Focus Area
Potential Risks from Advanced AI
Amount
$1,337,600
Date
May 2017
March 2022
Grant Title
Stiftung Neue Verantwortung — AI Policy Analysis
Organization Name
Stiftung Neue Verantwortung
Focus Area
Potential Risks from Advanced AI
Amount
$444,000
Date
March 2022
March 2020
Grant Title
Study and Training Related to AI Policy Careers — Scholarship Support
Organization Name
Study and Training Related to AI Policy Careers
Focus Area
Potential Risks from Advanced AI
Amount
$593,540
Date
March 2020
September 2023
Grant Title
Surge AI — Data Production for AI Safety Research
Organization Name
Surge AI
Focus Area
Potential Risks from Advanced AI
Amount
$126,250
Date
September 2023
August 2023
Grant Title
Swiss AI Safety Summer Camp — AI Safety Bootcamp
Organization Name
Swiss AI Safety Summer Camp
Focus Area
Potential Risks from Advanced AI
Amount
$51,248
Date
August 2023
October 2022
Grant Title
Thomas Liao — Foundation Model Tracker
Organization Name
Foundation Model Tracker
Focus Area
Potential Risks from Advanced AI
Amount
$15,000
Date
October 2022
August 2021
Grant Title
UC Berkeley — Adversarial Robustness Research (Aditi Raghunathan)
Organization Name
University of California, Berkeley
Focus Area
Potential Risks from Advanced AI
Amount
$87,829
Date
August 2021
February 2021