• Grant
    Title
  • Organization
    Name
  • Focus
    Area
  • Amount
  • Date
Grant Title

University of Maryland — Research on Neural Network Generalization

Organization Name

University of Maryland

Focus Area
Potential Risks from Advanced AI
Amount
$350,000
Date
Grant Title

AI Impacts — Expert Survey on Progress in AI

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$345,000
Date
Grant Title

Carnegie Mellon University — Research on Adversarial Examples

Organization Name

Carnegie Mellon University

Focus Area
Potential Risks from Advanced AI
Amount
$343,235
Date
Grant Title

Cornell University — AI Safety Research

Organization Name

Cornell University

Focus Area
Potential Risks from Advanced AI
Amount
$342,645
Date
Grant Title

Stanford University — Adversarial Robustness Research (Shibani Santurkar)

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$330,792
Date
Grant Title

Stanford University — Adversarial Robustness Research (Dimitris Tsipras)

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$330,792
Date
Grant Title

UC Berkeley — Adversarial Robustness Research (Dawn Song)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$330,000
Date
Grant Title

Carnegie Mellon University — Adversarial Robustness Research

Organization Name

Carnegie Mellon University

Focus Area
Potential Risks from Advanced AI
Amount
$330,000
Date
Grant Title

UC Berkeley — Adversarial Robustness Research (David Wagner)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$330,000
Date
Grant Title

University of Southern California — Adversarial Robustness Research

Organization Name

University of Southern California

Focus Area
Potential Risks from Advanced AI
Amount
$320,000
Date
Grant Title

University of Maryland — Policy Fellowship (2023)

Organization Name

University of Maryland

Focus Area
Potential Risks from Advanced AI
Amount
$312,959
Date
Grant Title

National Academies of Sciences, Engineering, and Medicine — Safety-Critical Machine Learning

Organization Name

National Academies of Sciences, Engineering, and Medicine

Focus Area
Potential Risks from Advanced AI
Amount
$309,441
Date
Grant Title

Rethink Priorities — AI Governance Workshop

Organization Name

Rethink Priorities

Focus Area
Potential Risks from Advanced AI
Amount
$302,390
Date
Grant Title

University of Tübingen — Adversarial Robustness Research (Matthias Hein)

Organization Name

University of Tübingen

Focus Area
Potential Risks from Advanced AI
Amount
$300,000
Date
Grant Title

Berkeley Existential Risk Initiative — AI Standards (2021)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$300,000
Date
Grant Title

Yale University — Research on the Global Politics of AI

Organization Name

Yale University

Focus Area
Potential Risks from Advanced AI
Amount
$299,320
Date
Grant Title

Wilson Center — AI Policy Training Program

Organization Name

The Wilson Center

Focus Area
Potential Risks from Advanced AI
Amount
$291,214
Date
Grant Title

Effective Ventures Foundation — AI Safety Communications Centre

Organization Name

Effective Ventures Foundation

Focus Area
Potential Risks from Advanced AI
Amount
$288,000
Date
Grant Title

FAR AI — FAR Labs Office Space

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$280,000
Date
Grant Title

George Mason University — Research into Future Artificial Intelligence Scenarios

Organization Name

George Mason University

Focus Area
Potential Risks from Advanced AI
Amount
$277,435
Date
Grant Title

Alignment Research Center — General Support

Organization Name

Alignment Research Center

Focus Area
Potential Risks from Advanced AI
Amount
$265,000
Date
Grant Title

UC Santa Cruz — Adversarial Robustness Research

Organization Name

University of California, Santa Cruz

Focus Area
Potential Risks from Advanced AI
Amount
$265,000
Date
Grant Title

Centre for Effective Altruism — Harvard AI Safety Office

Organization Name

Centre for Effective Altruism

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

Berkeley Existential Risk Initiative — CHAI ML Engineers

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

University of Chicago — Research on Complementary AI

Organization Name

University of Chicago

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

University of Cambridge — Machine Learning Research

Organization Name

University of Cambridge

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

Stanford University — Language Model Evaluations

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$250,000
Date
Grant Title

Georgetown University — Policy Fellowship (2021)

Organization Name

Georgetown University

Focus Area
Potential Risks from Advanced AI
Amount
$246,564
Date
Grant Title

Conjecture — SERI MATS (2023)

Organization Name

Conjecture

Focus Area
Potential Risks from Advanced AI
Amount
$245,000
Date
Grant Title

Georgetown University — Policy Fellowship (2022)

Organization Name

Georgetown University

Focus Area
Potential Risks from Advanced AI
Amount
$239,061
Date
Grant Title

Mila — Research Project on Artificial Intelligence

Organization Name

Montreal Institute for Learning Algorithms

Focus Area
Potential Risks from Advanced AI
Amount
$237,931
Date
Grant Title

London Initiative for Safe AI (LISA) — General Support

Organization Name

London Initiative for Safe AI

Focus Area
Potential Risks from Advanced AI
Amount
$237,000
Date
Grant Title

Leap Labs — Interpretability Research

Organization Name

Leap Labs

Focus Area
Potential Risks from Advanced AI
Amount
$230,000
Date
Grant Title

AI Worldviews Contest Winners

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$225,000
Date
Grant Title

Conjecture — AI Safety Technical Program

Organization Name

Conjecture

Focus Area
Potential Risks from Advanced AI
Amount
$223,569
Date
Grant Title

Lee Foster – LLM Misuse Database

Organization Name

Lee Foster

Focus Area
Potential Risks from Advanced AI
Amount
$223,000
Date
Grant Title

Université de Montréal — Research Project on Artificial Intelligence

Organization Name

Université de Montréal

Focus Area
Potential Risks from Advanced AI
Amount
$210,552
Date
Grant Title

Berkeley Existential Risk Initiative – SERI Summer Fellowships

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
Grant Title

Berkeley Existential Risk Initiative — AI Standards (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$210,000
Date
Grant Title

AI Safety Hub — Startup Costs

Organization Name

AI Safety Hub

Focus Area
Potential Risks from Advanced AI
Amount
$203,959
Date
Grant Title

UC Berkeley — Center for Human-Compatible AI (2019)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$200,000
Date
Grant Title

Center for Long-Term Cybersecurity – AI Risk Management Frameworks (2024)

Organization Name

Center for Long-Term Cybersecurity

Focus Area
Potential Risks from Advanced AI
Amount
$200,000
Date
Grant Title

Arizona State University — Adversarial Robustness Research

Organization Name

Arizona State University

Focus Area
Potential Risks from Advanced AI
Amount
$200,000
Date
Grant Title

Electronic Frontier Foundation — Artificial Intelligence Scenarios and Social Impacts

Organization Name

Electronic Frontier Foundation

Focus Area
Potential Risks from Advanced AI
Amount
$199,000
Date
Grant Title

Berkeley Existential Risk Initiative — SERI MATS Program

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$195,000
Date
Grant Title

Epoch — AI Worldview Investigations

Organization Name

Epoch

Focus Area
Potential Risks from Advanced AI
Amount
$188,558
Date
Grant Title

Daniel Dewey — AI Alignment Project

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$175,000
Date
Grant Title

Daniel Dewey — AI Alignment Projects (2022)

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$175,000
Date
Grant Title

Purdue University — Language Model Research

Organization Name

Purdue University

Focus Area
Potential Risks from Advanced AI
Amount
$170,000
Date
Grant Title

FAR AI — Alignment Workshop

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$166,500
Date
Grant Title

AI Scholarships — Scholarship Support (2018)

Organization Name

AI Scholarships

Focus Area
Potential Risks from Advanced AI
Amount
$159,000
Date
Grant Title

Rethink Priorities — AI Governance Research (2023)

Organization Name

Rethink Priorities

Focus Area
Potential Risks from Advanced AI
Amount
$154,810
Date
Grant Title

Stanford University — AI Alignment Research (Barrett and Viteri)

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$153,820
Date
Grant Title

Berryville Institute of Machine Learning — Machine Learning Security Research

Organization Name

Berryville Institute of Machine Learning

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

Berkeley Existential Risk Initiative — General Support

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

Machine Intelligence Research Institute — AI Safety Retraining Program

Organization Name

Machine Intelligence Research Institute

Focus Area
Potential Risks from Advanced AI
Amount
$150,000
Date
Grant Title

AI Safety Support — AI Safety Technical Program (May 2023)

Organization Name

AI Safety Support

Focus Area
Potential Risks from Advanced AI
Amount
$146,165
Date
Grant Title

Berkeley Existential Risk Initiative — David Krueger Collaboration

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$140,050
Date
Grant Title

University of Utah — AI Alignment Research

Organization Name

University of Utah

Focus Area
Potential Risks from Advanced AI
Amount
$140,000
Date
Grant Title

Alignment Research Engineer Accelerator — AI Safety Technical Program (2023)

Organization Name

Alignment Research Engineer Accelerator

Focus Area
Potential Risks from Advanced AI
Amount
$127,350
Date
Grant Title

Surge AI — Data Production for AI Safety Research

Organization Name

Surge AI

Focus Area
Potential Risks from Advanced AI
Amount
$126,250
Date
Grant Title

Stanford University — AI Economic Impacts Workshop

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$120,000
Date
Grant Title

Center for Strategic and International Studies — AI Accident Risk and Technology Competition

Organization Name

Center for Strategic and International Studies

Focus Area
Potential Risks from Advanced AI
Amount
$118,307
Date
Grant Title

Center for a New American Security — AI and Security Projects

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$116,744
Date
Grant Title

Northeastern University — Mechanistic Interpretability Research

Organization Name

Northeastern University

Focus Area
Potential Risks from Advanced AI
Amount
$116,072
Date
Grant Title

UC Santa Cruz — Adversarial Robustness Research (2023)

Organization Name

University of California, Santa Cruz

Focus Area
Potential Risks from Advanced AI
Amount
$114,000
Date
Grant Title

AI Funding for Individuals — Work and Study Support

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$113,372
Date
Grant Title

Mordechai Rorvig — Independent AI Journalism

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
Grant Title

Jérémy Scheurer — Independent AI Alignment Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
Grant Title

University of Pennsylvania — AI Governance Roundtables

Organization Name

University of Pennsylvania

Focus Area
Potential Risks from Advanced AI
Amount
$110,000
Date
Grant Title

Center for a New American Security — Risks from Militarized AI

Organization Name

Center for a New American Security

Focus Area
Potential Risks from Advanced AI
Amount
$101,187
Date
Grant Title

University of British Columbia — AI Alignment Research

Organization Name

University of British Columbia

Focus Area
Potential Risks from Advanced AI
Amount
$100,375
Date
Grant Title

Responsible AI Collaborative — AI Incident Database

Organization Name

Responsible AI Collaborative

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

AI Impacts — General Support (2018)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

Stanford University — Machine Learning Security Research Led by Dan Boneh and Florian Tramer

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

FAR AI — AI Interpretability Research

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

Berkeley Existential Risk Initiative — General Support (2022)

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

Jacob Steinhardt — AI Alignment Research

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$100,000
Date
Grant Title

Apart Research — AI Alignment Hackathons

Organization Name

Apart Research

Focus Area
Potential Risks from Advanced AI
Amount
$89,000
Date
Grant Title

UC Berkeley — Adversarial Robustness Research (Aditi Raghunathan)

Organization Name

University of California, Berkeley

Focus Area
Potential Risks from Advanced AI
Amount
$87,829
Date
Grant Title

University of Illinois — AI Alignment Research

Organization Name

University of Illinois

Focus Area
Potential Risks from Advanced AI
Amount
$80,000
Date
Grant Title

University of Toronto — Alignment Research

Organization Name

University of Toronto

Focus Area
Potential Risks from Advanced AI
Amount
$80,000
Date
Grant Title

Stanford University — AI Index

Organization Name

Stanford University

Focus Area
Potential Risks from Advanced AI
Amount
$78,000
Date
Grant Title

AI Alignment Awards — Shutdown Problem Contest

Organization Name

AI Alignment Awards

Focus Area
Potential Risks from Advanced AI
Amount
$75,000
Date
Grant Title

Legal Priorities Project — Law & AI Summer Research Fellowship

Organization Name

Legal Priorities Project

Focus Area
Potential Risks from Advanced AI
Amount
$75,000
Date
Grant Title

Berkeley Existential Risk Initiative — University Collaboration Program

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Neel Nanda — Interpretability Research

Organization Name

Neel Nanda

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Berkeley Existential Risk Initiative — Scalable Oversight Dataset

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Applied Research Laboratory for Intelligence and Security — Report on Security Clearances

Organization Name

Applied Research Laboratory for Intelligence and Security

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Berkeley Existential Risk Initiative — MineRL BASALT Competition

Organization Name

Berkeley Existential Risk Initiative

Focus Area
Potential Risks from Advanced AI
Amount
$70,000
Date
Grant Title

Center for International Security and Cooperation — AI Accident Risk and Technology Competition

Organization Name

Center for International Security and Cooperation

Focus Area
Potential Risks from Advanced AI
Amount
$67,000
Date
Grant Title

Brian Christian — The Alignment Problem Book Promotion

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$60,859
Date
Grant Title

Johns Hopkins University — Support for Jared Kaplan and Brice Ménard

Organization Name

Johns Hopkins University

Focus Area
Potential Risks from Advanced AI
Amount
$55,000
Date
Grant Title

Michael Page — Career Transition Grant

Organization Name
Focus Area
Potential Risks from Advanced AI
Amount
$52,500
Date
Grant Title

Swiss AI Safety Summer Camp — AI Safety Bootcamp

Organization Name

Swiss AI Safety Summer Camp

Focus Area
Potential Risks from Advanced AI
Amount
$51,248
Date
Grant Title

Centre for the Governance of AI — Compute Strategy Workshop

Organization Name

Centre for the Governance of AI

Focus Area
Potential Risks from Advanced AI
Amount
$50,532
Date
Grant Title

FAR AI — Interpretability Research

Organization Name

FAR AI

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
Grant Title

Mila — Workshop on Human-Level AI

Organization Name

Mila

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
Grant Title

AI Impacts — General Support (2020)

Organization Name

AI Impacts

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date
Grant Title

World Economic Forum — Global AI Council Workshop

Organization Name

World Economic Forum

Focus Area
Potential Risks from Advanced AI
Amount
$50,000
Date