Advances in AI could lead to extremely positive developments, but could also potentially pose risks from intentional misuse or catastrophic accidents.
Potential Risks from Advanced Artificial Intelligence
We aim to support research and strategic work that could reduce risks and improve preparedness.
In recent years, we’ve seen rapid progress in artificial intelligence. And within a decade or two, we think it’s plausible that AI systems will arrive that can outperform humans in nearly all intellectual domains (as do many of the world’s foremost AI experts).
These systems could have enormous benefits, from accelerating scientific progress to vastly increasing global GDP. However, they could also pose severe risks from misuse, accidents, or drastic societal change — with potentially catastrophic effects. We’re interested in supporting technical, strategic, and policy work that could reduce the risk of accidents or help society prepare for major advances in AI.
Funding opportunities and requests for proposals
We encourage interested individuals to submit expressions of interest for our RFP on AI governance. We’re seeking proposals in six areas: technical AI governance, policy development, frontier company policy, international AI governance, law, and strategic analysis and threat modeling.
The following Open Philanthropy staff oversee the Potential Risks from Advanced Artificial Intelligence program.
Potential Risks from Advanced AI, at a glance
-
280+ Grants
Made -
$400+ Million
Given