• Grant
    Title
  • Organization
    Name
  • Focus
    Area
  • Amount
  • Date
Grant Title

Epoch — General Support

Organization Name

Epoch

Focus Area
Potential Risks from Advanced AI
Amount
$1,960,000
Date
Grant Title

AI Impacts — General Support

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$364,893
Date
Grant Title

OpenMined — Research on Privacy-Enhancing Technologies and AI Safety

Organization Name

OpenMined

Focus Area
Potential Risks from Advanced AI
Amount
$28,320
Date
Grant Title

Open Phil AI Fellowship — 2022 Class

Organization Name

Open Phil AI Fellowship

Focus Area
Potential Risks from Advanced AI
Amount
$1,840,000
Date
Grant Title

Berkeley Existential Risk Initiative — AI Standards (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
Grant Title

Center for Long-Term Cybersecurity — AI Standards (2022)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$20,000
Date
Grant Title

Berkeley Existential Risk Initiative — SERI MATS Program (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$1,008,127
Date
Grant Title

Funding for AI Alignment Projects Working With Deep Learning Systems

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$15,700,072
Date
Grant Title

AI Safety Support — Research on Trends in Machine Learning

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$42,000
Date
Grant Title

Berkeley Existential Risk Initiative — David Krueger Collaboration

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$140,050
Date
Grant Title

Carnegie Endowment for International Peace — AI Governance Research

Organization Name

Carnegie Endowment for International Peace

Focus Area
Potential Risks from Advanced AI
Amount
$597,717
Date
Grant Title

Hofvarpnir Studios — Compute Cluster for AI Safety Research

Organization Name

Hofvarpnir Studios

Focus Area
Potential Risks from Advanced AI
Amount
$1,443,540
Date
Grant Title

Usman Anwar — Research Collaboration with David Krueger

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$6,526
Date
Grant Title

Massachusetts Institute of Technology — AI Trends and Impacts Research (2022)

Organization Name

Massachusetts Institute of Technology

Focus Area
Potential Risks from Advanced AI
Amount
$13,277,348
Date
Grant Title

Rethink Priorities — AI Governance Research (2022)

Organization Name

Rethink Priorities

Focus Area
Potential Risks from Advanced AI
Amount
$2,728,319
Date
Grant Title

Egor Krasheninnikov — Research Collaboration with David Krueger

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$6,526
Date
Grant Title

Stiftung Neue Verantwortung — AI Policy Analysis

Organization Name

Stiftung Neue Verantwortung

Focus Area
Potential Risks from Advanced AI
Amount
$444,000
Date
Grant Title

Alignment Research Center — General Support

Organization Name

Alignment Research Center

Focus Area
Potential Risks from Advanced AI
Amount
$265,000
Date
Grant Title

AI Funding for Individuals — Work and Study Support

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$113,372
Date
Grant Title

Berkeley Existential Risk Initiative — CHAI Collaboration (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$1,126,160
Date
Grant Title

Michael Page — Career Transition Grant

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$52,500
Date
Grant Title

National Academies of Sciences, Engineering, and Medicine — Safety-Critical Machine Learning

Organization Name

National Academies of Sciences, Engineering, and Medicine

Focus Area
Potential Risks from Advanced AI
Amount
$309,441
Date
Grant Title

Open Philanthropy Technology Policy Fellowship (2022)

Organization Name
Focus Area
Biosecurity & Pandemic Preparedness
Amount
$2,869,940
Date
Grant Title

Wilson Center — AI Policy Training Program (2022)

Organization Name

The Wilson Center

Focus Area
Potential Risks from Advanced AI
Amount
$2,023,322
Date
Grant Title

Centre for the Governance of AI — AI Field Building

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$2,537,600
Date
Grant Title

Georgetown University — Policy Fellowship (2021)

Organization Name

Georgetown University

Focus Area
Potential Risks from Advanced AI
Amount
$246,564
Date
Grant Title

Redwood Research — General Support

Organization Name

Redwood Research

Focus Area
Potential Risks from Advanced AI
Amount
$9,420,000
Date
Grant Title

Stanford University — AI Alignment Research (2021)

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$1,500,000
Date
Grant Title

Mila — Research Project on Artificial Intelligence

Organization Name

Montreal Institute for Learning Algorithms

Focus Area
Potential Risks from Advanced AI
Amount
$237,931
Date
Grant Title

Berkeley Existential Risk Initiative — SERI MATS Program

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$195,000
Date
Grant Title

Fund for Alignment Research — Language Model Misalignment

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$425,800
Date
Grant Title

University of Washington — Adversarial Robustness Research

Organization Name

University of Washington

Focus Area
Potential Risks from Advanced AI
Amount
$730,000
Date
Grant Title

Stanford University — AI Index

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$78,000
Date
Grant Title

Université de Montréal — Research Project on Artificial Intelligence

Organization Name

Université de Montréal

Focus Area
Potential Risks from Advanced AI
Amount
$210,552
Date
Grant Title

Center for a New American Security — Risks from Militarized AI

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$101,187
Date
Grant Title

UC Berkeley — Adversarial Robustness Research (Aditi Raghunathan)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$87,829
Date
Grant Title

Stanford University — Adversarial Robustness Research (Dimitris Tsipras)

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$330,792
Date
Grant Title

University of Southern California — Adversarial Robustness Research

Organization Name

University of Southern California

Focus Area
Potential Risks from Advanced AI
Amount
$320,000
Date
Grant Title

Stanford University — Adversarial Robustness Research (Shibani Santurkar)

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$330,792
Date
Grant Title

Center for Security and Emerging Technology — General Support (August 2021)

Organization Name

Center for Security and Emerging Technology

Focus Area
Potential Risks from Advanced AI
Amount
$38,920,000
Date
Grant Title

Berkeley Existential Risk Initiative — AI Standards (2021)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$300,000
Date
Grant Title

Center for Long-Term Cybersecurity — AI Standards (2021)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
Grant Title

Center for International Security and Cooperation — AI and Strategic Stability

Organization Name

Center for International Security and Cooperation

Focus Area
Potential Risks from Advanced AI
Amount
$365,361
Date
Grant Title

Applied Research Laboratory for Intelligence and Security — Report on Security Clearances

Organization Name

Applied Research Laboratory for Intelligence and Security

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Berkeley Existential Risk Initiative — MineRL BASALT Competition

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Rethink Priorities — AI Governance Research (2021)

Organization Name

Rethink Priorities

Focus Area
Potential Risks from Advanced AI
Amount
$612,185
Date
Grant Title

Carnegie Mellon University — Adversarial Robustness Research

Organization Name

Carnegie Mellon University

Focus Area
Potential Risks from Advanced AI
Amount
$330,000
Date
Grant Title

Jennifer Dodd — Machine Learning Self-Study

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$19,200
Date
Grant Title

Daniel Dewey — AI Alignment Project

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$175,000
Date
Grant Title

Open Phil AI Fellowship — 2021 Class

Organization Name

Open Phil AI Fellowship

Focus Area
Potential Risks from Advanced AI
Amount
$1,000,000
Date
Grant Title

Wilson Center — AI Policy Training Program

Organization Name

The Wilson Center

Focus Area
Potential Risks from Advanced AI
Amount
$291,214
Date
Grant Title

University of Cambridge — Machine Learning Research

Organization Name

University of Cambridge

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

International Conference on Learning Representations — Security and Safety in Machine Learning Systems Workshop

Organization Name

International Conference on Learning Representations

Focus Area
Potential Risks from Advanced AI
Amount
$3,000
Date
Grant Title

Brian Christian — The Alignment Problem Book Promotion

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$60,859
Date
Grant Title

Berkeley Existential Risk Initiative – SERI Summer Fellowships

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
Grant Title

UC Berkeley — Adversarial Robustness Research (David Wagner)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$330,000
Date
Grant Title

UC Berkeley — Adversarial Robustness Research (Dawn Song)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$330,000
Date
Grant Title

University of Tübingen — Robustness Research (Wieland Brendel)

Organization Name

University of Tübingen

Focus Area
Potential Risks from Advanced AI
Amount
$590,000
Date
Grant Title

University of Tübingen — Adversarial Robustness Research (Matthias Hein)

Organization Name

University of Tübingen

Focus Area
Potential Risks from Advanced AI
Amount
$300,000
Date
Grant Title

Massachusetts Institute of Technology — Adversarial Robustness Research

Organization Name

Massachusetts Institute of Technology

Focus Area
Potential Risks from Advanced AI
Amount
$1,430,000
Date
Grant Title

Center for Security and Emerging Technology — General Support (January 2021)

Organization Name

Center for Security and Emerging Technology

Focus Area
Potential Risks from Advanced AI
Amount
$8,000,000
Date
Grant Title

UC Berkeley — Center for Human-Compatible Artificial Intelligence (2021)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$11,355,246
Date
Grant Title

UC Santa Cruz — Adversarial Robustness Research

Organization Name

University of California, Santa Cruz

Focus Area
Potential Risks from Advanced AI
Amount
$265,000
Date
Grant Title

Berryville Institute of Machine Learning — Machine Learning Security Research

Organization Name

Berryville Institute of Machine Learning

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

University of Toronto — Machine Learning Research

Organization Name

University of Toronto

Focus Area
Potential Risks from Advanced AI
Amount
$520,000
Date
Grant Title

Massachusetts Institute of Technology — AI Trends and Impacts Research (2020)

Organization Name

Massachusetts Institute of Technology

Focus Area
Potential Risks from Advanced AI
Amount
$550,688
Date
Grant Title

AI Impacts — General Support (2020)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
Grant Title

Center for a New American Security — AI and Security Projects

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$116,744
Date
Grant Title

Center for a New American Security — AI Governance Projects

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$24,350
Date
Grant Title

Smitha Milli — Participatory Approaches to Machine Learning Workshop

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$370
Date
Grant Title

Center for International Security and Cooperation — AI Accident Risk and Technology Competition

Organization Name

Center for International Security and Cooperation

Focus Area
Potential Risks from Advanced AI
Amount
$67,000
Date
Grant Title

Rice, Hadley, Gates and Manuel LLC — AI Accident Risk and Technology Competition

Organization Name

Rice, Hadley, Gates & Manuel LLC

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
Grant Title

Center for Strategic and International Studies — AI Accident Risk and Technology Competition

Organization Name

Center for Strategic and International Studies

Focus Area
Potential Risks from Advanced AI
Amount
$118,307
Date
Grant Title

Wilson Center — AI Policy Seminar Series (June 2020)

Organization Name

The Wilson Center

Focus Area
Potential Risks from Advanced AI
Amount
$496,540
Date
Grant Title

Andrew Lohn — Paper on Machine Learning Model Robustness

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$15,000
Date
Grant Title

Centre for the Governance of AI — General Support (2020)

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$450,000
Date
Grant Title

International Conference on Learning Representations — Machine Learning Paper Awards

Organization Name

International Conference on Learning Representations

Focus Area
Potential Risks from Advanced AI
Amount
$3,500
Date
Grant Title

Open Phil AI Fellowship — 2020 Class

Organization Name

Open Phil AI Fellowship

Focus Area
Potential Risks from Advanced AI
Amount
$2,300,000
Date
Grant Title

World Economic Forum — Global AI Council Workshop

Organization Name

World Economic Forum

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
Grant Title

Johns Hopkins University — Support for Jared Kaplan and Brice Ménard

Organization Name

Johns Hopkins University

Focus Area
Potential Risks from Advanced AI
Amount
$55,000
Date
Grant Title

Study and Training Related to AI Policy Careers — Scholarship Support

Organization Name

Study and Training Related to AI Policy Careers

Focus Area
Potential Risks from Advanced AI
Amount
$593,540
Date
Grant Title

Wilson Center — AI Policy Seminar Series (February 2020)

Organization Name

The Wilson Center

Focus Area
Potential Risks from Advanced AI
Amount
$368,440
Date
Grant Title

WestExec — Report on Assurance in Machine Learning Systems

Organization Name

WestExec

Focus Area
Potential Risks from Advanced AI
Amount
$540,000
Date
Grant Title

Machine Intelligence Research Institute — General Support (2020)

Organization Name

Machine Intelligence Research Institute

Focus Area
Potential Risks from Advanced AI
Amount
$7,703,750
Date
Grant Title

Stanford University — AI Safety Seminar

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$6,500
Date
Grant Title

Berkeley Existential Risk Initiative — General Support

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

RAND Corporation — Research on the State of AI Assurance Methods

Organization Name

The RAND Corporation

Focus Area
Potential Risks from Advanced AI
Amount
$30,751
Date
Grant Title

Press Shop — Support for Human Compatible

Organization Name

Press Shop

Focus Area
Potential Risks from Advanced AI
Amount
$17,000
Date
Grant Title

Ought — General Support (2020)

Organization Name

Ought

Focus Area
Potential Risks from Advanced AI
Amount
$1,593,333
Date
Grant Title

UC Berkeley — AI Safety Research (2019)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$1,111,000
Date
Grant Title

Ought — General Support (2019)

Organization Name

Ought

Focus Area
Potential Risks from Advanced AI
Amount
$1,000,000
Date
Grant Title

UC Berkeley — Center for Human-Compatible AI (2019)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$200,000
Date
Grant Title

Berkeley Existential Risk Initiative — CHAI Collaboration (2019)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$705,000
Date
Grant Title

Open Phil AI Fellowship — 2019 Class

Organization Name

Open Phil AI Fellowship

Focus Area
Potential Risks from Advanced AI
Amount
$2,325,000
Date
Grant Title

Machine Intelligence Research Institute — General Support (2019)

Organization Name

Machine Intelligence Research Institute

Focus Area
Potential Risks from Advanced AI
Amount
$2,652,500
Date
Grant Title

Georgetown University — Center for Security and Emerging Technology

Organization Name

Center for Security and Emerging Technology

Focus Area
Potential Risks from Advanced AI
Amount
$55,000,000
Date
Grant Title

Berkeley Existential Risk Initiative — CHAI ML Engineers

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

Daniel Kang, Jacob Steinhardt, Yi Sun, and Alex Zhai — Study of the Robustness of Machine Learning Models

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$2,351
Date
Grant Title

UC Berkeley — AI Safety Research (2018)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$1,145,000
Date
Grant Title

GoalsRL — Workshop on Goal Specifications for Reinforcement Learning

Organization Name

GoalsRL

Focus Area
Potential Risks from Advanced AI
Amount
$7,500
Date