• Grant
    Title
  • Organization
    Name
  • Focus
    Area
  • Amount
  • Date
Grant Title

Adam Jermyn — Independent AI Alignment Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$19,231
Date
Grant Title

AI Alignment Awards — Shutdown Problem Contest

Organization Name

AI Alignment Awards

Focus Area
Potential Risks from Advanced AI
Amount
$75,000
Date
Grant Title

AI Funding for Individuals — Work and Study Support

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$113,372
Date
Grant Title

AI Impacts — Expert Survey on Progress in AI

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

AI Impacts — General Support

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$364,893
Date
Grant Title

AI Impacts — General Support (2016)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$32,000
Date
Grant Title

AI Impacts — General Support (2018)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

AI Impacts — General Support (2020)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
Grant Title

AI Impacts — General Support (2023)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$620,000
Date
Grant Title

AI Safety Hub — Safety Labs

Organization Name

AI Safety Hub

Focus Area
Potential Risks from Advanced AI
Amount
$63,839
Date
Grant Title

AI Safety Hub — Startup Costs

Organization Name

AI Safety Hub

Focus Area
Potential Risks from Advanced AI
Amount
$235,000
Date
Grant Title

AI Safety Support — AI Safety Technical Program (May 2023)

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$146,165
Date
Grant Title

AI Safety Support — Research on Trends in Machine Learning

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$42,000
Date
Grant Title

AI Safety Support — SERI MATS 4.0

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$1,207,840
Date
Grant Title

AI Safety Support — SERI MATS Program

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$1,538,000
Date
Grant Title

AI Safety Support — Situational Awareness Research

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$443,716
Date
Grant Title

AI Scholarships — Scholarship Support (2018)

Organization Name

AI Scholarships

Focus Area
Potential Risks from Advanced AI
Amount
$159,000
Date
Grant Title

Alignment Research Center — General Support

Organization Name

Alignment Research Center

Focus Area
Potential Risks from Advanced AI
Amount
$265,000
Date
Grant Title

Alignment Research Center — General Support (November 2022)

Organization Name

Alignment Research Center

Focus Area
Potential Risks from Advanced AI
Amount
$1,250,000
Date
Grant Title

Alignment Research Engineer Accelerator — AI Safety Technical Program

Organization Name

Alignment Research Engineer Accelerator

Focus Area
Potential Risks from Advanced AI
Amount
$18,800
Date
Grant Title

Andrew Lohn — Paper on Machine Learning Model Robustness

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$15,000
Date
Grant Title

Apart Research — AI Alignment Hackathons

Organization Name

Apart Research

Focus Area
Potential Risks from Advanced AI
Amount
$89,000
Date
Grant Title

Apollo Research — Startup Funding

Organization Name

Apollo Research

Focus Area
Potential Risks from Advanced AI
Amount
$1,535,480
Date
Grant Title

Applied Research Laboratory for Intelligence and Security — Report on Security Clearances

Organization Name

Applied Research Laboratory for Intelligence and Security

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Berkeley Existential Risk Initiative – SERI Summer Fellowships

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
Grant Title

Berkeley Existential Risk Initiative — AI Standards (2021)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$300,000
Date
Grant Title

Berkeley Existential Risk Initiative — AI Standards (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
Grant Title

Berkeley Existential Risk Initiative — CHAI Collaboration (2019)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$705,000
Date
Grant Title

Berkeley Existential Risk Initiative — CHAI Collaboration (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$1,126,160
Date
Grant Title

Berkeley Existential Risk Initiative — CHAI ML Engineers

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

Berkeley Existential Risk Initiative — Core Support and CHAI Collaboration

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$403,890
Date
Grant Title

Berkeley Existential Risk Initiative — David Krueger Collaboration

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$140,050
Date
Grant Title

Berkeley Existential Risk Initiative — General Support

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

Berkeley Existential Risk Initiative — General Support (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

Berkeley Existential Risk Initiative — Lab Retreat

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$35,000
Date
Grant Title

Berkeley Existential Risk Initiative — Language Model Alignment Research

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$30,000
Date
Grant Title

Berkeley Existential Risk Initiative — Machine Learning Alignment Theory Scholars

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$2,047,268
Date
Grant Title

Berkeley Existential Risk Initiative — MineRL BASALT Competition

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Berkeley Existential Risk Initiative — Scalable Oversight Dataset

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Berkeley Existential Risk Initiative — SERI MATS 4.0

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$428,942
Date
Grant Title

Berkeley Existential Risk Initiative — SERI MATS Program

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$195,000
Date
Grant Title

Berkeley Existential Risk Initiative — SERI MATS Program (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$1,008,127
Date
Grant Title

Berkeley Existential Risk Initiative — University Collaboration Program

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Berryville Institute of Machine Learning — Machine Learning Security Research

Organization Name

Berryville Institute of Machine Learning

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

Brian Christian — Psychology Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$37,903
Date
Grant Title

Brian Christian — The Alignment Problem Book Promotion

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$60,859
Date
Grant Title

Carnegie Endowment for International Peace — AI Governance Research

Organization Name

Carnegie Endowment for International Peace

Focus Area
Potential Risks from Advanced AI
Amount
$597,717
Date
Grant Title

Carnegie Mellon University — Adversarial Robustness Research

Organization Name

Carnegie Mellon University

Focus Area
Potential Risks from Advanced AI
Amount
$330,000
Date
Grant Title

Carnegie Mellon University — Research on Adversarial Examples

Organization Name

Carnegie Mellon University

Focus Area
Potential Risks from Advanced AI
Amount
$343,235
Date
Grant Title

Catherine Brewer — OxAI Safety Hub

Organization Name

OxAI Safety Hub

Focus Area
Potential Risks from Advanced AI
Amount
$11,622
Date
Grant Title

Center for a New American Security — AI and Security Projects

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$116,744
Date
Grant Title

Center for a New American Security — AI Governance Projects

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$24,350
Date
Grant Title

Center for a New American Security — Risks from Militarized AI

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$101,187
Date
Grant Title

Center for a New American Security — Work on AI Governance

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$4,816,710
Date
Grant Title

Center for AI Safety — General Support (2022)

Organization Name

Center for AI Safety

Focus Area
Potential Risks from Advanced AI
Amount
$5,160,000
Date
Grant Title

Center for AI Safety — General Support (2023)

Organization Name

Center for AI Safety

Focus Area
Potential Risks from Advanced AI
Amount
$4,025,729
Date
Grant Title

Center for AI Safety — Philosophy Fellowship and NeurIPS Prizes

Organization Name

Center for AI Safety

Focus Area
Potential Risks from Advanced AI
Amount
$1,433,000
Date
Grant Title

Center for International Security and Cooperation — AI Accident Risk and Technology Competition

Organization Name

Center for International Security and Cooperation

Focus Area
Potential Risks from Advanced AI
Amount
$67,000
Date
Grant Title

Center for International Security and Cooperation — AI and Strategic Stability

Organization Name

Center for International Security and Cooperation

Focus Area
Potential Risks from Advanced AI
Amount
$365,361
Date
Grant Title

Center for Long-Term Cybersecurity — AI Standards (2021)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
Grant Title

Center for Long-Term Cybersecurity — AI Standards (2022)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$20,000
Date
Grant Title

Center for Security and Emerging Technology — General Support (August 2021)

Organization Name

Center for Security and Emerging Technology

Focus Area
Potential Risks from Advanced AI
Amount
$38,920,000
Date
Grant Title

Center for Security and Emerging Technology — General Support (January 2021)

Organization Name

Center for Security and Emerging Technology

Focus Area
Potential Risks from Advanced AI
Amount
$8,000,000
Date
Grant Title

Center for Strategic and International Studies — AI Accident Risk and Technology Competition

Organization Name

Center for Strategic and International Studies

Focus Area
Potential Risks from Advanced AI
Amount
$118,307
Date
Grant Title

Centre for Effective Altruism — Harvard AI Safety Office

Organization Name

Centre for Effective Altruism

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

Centre for the Governance of AI — AI Field Building

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$2,537,600
Date
Grant Title

Centre for the Governance of AI — Compute Strategy Workshop

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$50,532
Date
Grant Title

Centre for the Governance of AI — General Support (2020)

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$450,000
Date
Grant Title

Centre for the Governance of AI — General Support (2023)

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$1,000,000
Date
Grant Title

Centre for the Governance of AI — Research Assistant

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$19,200
Date
Grant Title

Conjecture — AI Safety Technical Program

Organization Name

Conjecture

Focus Area
Potential Risks from Advanced AI
Amount
$223,569
Date
Grant Title

Conjecture — SERI MATS (2023)

Organization Name

Conjecture

Focus Area
Potential Risks from Advanced AI
Amount
$245,000
Date
Grant Title

Conjecture — SERI MATS Program in London

Organization Name

Conjecture

Focus Area
Potential Risks from Advanced AI
Amount
$457,380
Date
Grant Title

Cornell University — AI Safety Research

Organization Name

Cornell University

Focus Area
Potential Risks from Advanced AI
Amount
$342,645
Date
Grant Title

Daniel Dewey — AI Alignment Project

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$175,000
Date
Grant Title

Daniel Dewey — AI Alignment Projects (2022)

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$175,000
Date
Grant Title

Daniel Kang, Jacob Steinhardt, Yi Sun, and Alex Zhai — Study of the Robustness of Machine Learning Models

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$2,351
Date
Grant Title

Distill Prize for Clarity in Machine Learning — General Support

Organization Name

Distill Prize for Clarity in Machine Learning

Focus Area
Potential Risks from Advanced AI
Amount
$25,000
Date
Grant Title

Effective Ventures Foundation — AI Safety Communications Centre

Organization Name

Effective Ventures Foundation

Focus Area
Potential Risks from Advanced AI
Amount
$288,000
Date
Grant Title

Egor Krasheninnikov — Research Collaboration with David Krueger

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$6,526
Date
Grant Title

Electronic Frontier Foundation — Artificial Intelligence Scenarios and Social Impacts

Organization Name

Electronic Frontier Foundation

Focus Area
Potential Risks from Advanced AI
Amount
$199,000
Date
Grant Title

Eleuther AI — Interpretability Research

Organization Name

Eleuther AI

Focus Area
Potential Risks from Advanced AI
Amount
$2,642,273
Date
Grant Title

Epoch — AI Worldview Investigations

Organization Name

Epoch

Focus Area
Potential Risks from Advanced AI
Amount
$188,558
Date
Grant Title

Epoch — General Support

Organization Name

Epoch

Focus Area
Potential Risks from Advanced AI
Amount
$1,960,000
Date
Grant Title

Epoch — General Support (2023)

Organization Name

Epoch

Focus Area
Potential Risks from Advanced AI
Amount
$6,922,565
Date
Grant Title

FAR AI — AI Interpretability Research

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

FAR AI — Alignment Workshop

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$166,500
Date
Grant Title

FAR AI — FAR Labs Office Space

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$280,000
Date
Grant Title

FAR AI — General Support (2022)

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$625,000
Date
Grant Title

FAR AI — General Support (2023)

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$460,000
Date
Grant Title

FAR AI — Interpretability Research

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
Grant Title

FAR AI — Inverse Scaling Prize

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$49,500
Date
Grant Title

Forecasting Research Institute — AI Forecasting Project

Organization Name

Forecasting Research Institute

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

Foundation for American Innovation — AI Safety Policy Advocacy

Organization Name

Foundation for American Innovation

Focus Area
Potential Risks from Advanced AI
Amount
$552,500
Date
Grant Title

Fund for Alignment Research — Language Model Misalignment

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$425,800
Date
Grant Title

Fund for Alignment Research — Language Model Misalignment (2022)

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$463,693
Date
Grant Title

Funding for AI Alignment Projects Working With Deep Learning Systems

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$15,589,002
Date
Grant Title

Future of Humanity Institute — General Support

Organization Name

Future of Humanity Institute

Focus Area
Potential Risks from Advanced AI
Amount
$1,995,425
Date
Grant Title

Future of Life Institute — Artificial Intelligence Risk Reduction

Organization Name

Future of Life Institute

Focus Area
Potential Risks from Advanced AI
Amount
$1,186,000
Date
Grant Title

George Mason University — Research into Future Artificial Intelligence Scenarios

Organization Name

George Mason University

Focus Area
Potential Risks from Advanced AI
Amount
$277,435
Date