Your work on scheming/deception seems quite important.

Creating an "FHI of the West" seems pretty valuable.

The AI Futures Project is a nonprofit research organization working to research and understand the trajectory of AI development

The **AI Futures Project** is a 501(c)(3) nonprofit research organization. We have developed a scenario forecast detailing the development of artificial general intelligence (AGI) and artificial superintelligence (ASI). Based on our research, we’ve come to believe that we might cross the thresholds to AGI and ASI within just a few years—and that plausible outcomes include unprecedented concentration of power, global catastrophe, or progress and flourishing.

The world is not ready for such a radical transformation. We hope to help policymakers, AI companies, AI entrepreneurs, AI safety researchers, and the general public to make sense of what’s coming, so they can take action and steer us in a better direction. In addition to our scenario forecast, we are developing [policy recommendations](https://time.com/collection/time100-voices/7086285/ai-transparency-measures/) and tabletop exercises (wargames) for decisionmakers.



AI Futures Project

This century is critical for humanity. We build tech, infrastructure, and community to navigate it.

This century is critical for humanity. We build tech, infrastructure, and community to navigate it.

Humanity's future could be vast, spanning billions of flourishing galaxies, reaching far into our future light cone [1]. However, it seems humanity might never achieve this; we might not even survive the century. To increase our odds, we build services and infrastructure for people who are helping humanity navigate this crucial period.

[1]: Or even more than the light cone, depending on how the [acausal trade stuff](https://www.lesswrong.com/tag/acausal-trade) works out.

Learn more about what we do here: https://www.lesswrong.com/posts/5n2ZQcbc7r4R8mvqc/the-lightcone-is-nothing-without-its-people-lw-lighthaven-s-5 

Lightcone Infrastructure

We are a think tank dedicated to figuring out the best ways to make the world a better place.

Rethink Priorities is a research organization that conducts critical research to inform policymakers and major foundations about how to best help people and nonhuman animals in both the present and the long-term future.

Our research spans everything from animal welfare to the threat of nuclear war. We explore neglected but promising areas to improve the world and try to further build the community of researchers working on understanding how to do this most effectively.

If you'd like to support one of our fiscally sponsored projects (e.g. Epoch), you can give via Every.org, and let us know how to allocate your gift at info@rethinkpriorities.org.

Rethink Priorities

We research the offensive capabilities of AI systems today to better understand the risk of losing control to AI systems forever.

We research dangerous AI capabilities to better understand misuse risks from current systems, and how advances in hacking, deception, and persuasion will affect the risk of catastrophic AI outcomes. We create concrete demonstrations of dangerous capabilities to advise policy makers and the public on AI risks.

We are working closely with government agencies, policy think tanks, and media organizations to inform relevant decision makers. For example, [our](https://arxiv.org/abs/2310.20624) [work](https://arxiv.org/abs/2311.00117) demonstrating that it is possible to effectively undo Llama 2-Chat 70B’s safety fine-tuning for less than $200 has been used to [confront](https://www.washingtonpost.com/technology/2023/09/13/senate-ai-hearing-musk-zuckerburg-schumer/) Mark Zuckerberg in the first of Chuck Schumer’s Insight Forums, cited by Senator Hassan in a [senate hearing](https://www.hsgac.senate.gov/subcommittees/etso/hearings/advanced-technology-examining-threats-to-national-security/) on threats to national security, and used to advise the UK AI Safety Institute.

Palisade Research

1067431123

1431630327

148788709

1675433849

1873740264

2310049938

2352003526

2551237796

2595251256

281961830

2883383521

2899462032

316638097

338811242

3705164611

3874769064

3934974605

4083678788

4124487947

4167807122

440668958

698107245

91415239

1287028958

2729980760

3440869557

671754822

87081813

1014384873

1112422858

153399038

2028390811

220342792

2266630408

2519810400

2539558839

2826465835

We are a nonprofit, so instead of charging fees we rely on the generosity of donors like you.

Choose a donation for Every.org

2843798242

2898624300

2916352438

3259439560

339774024

3642494300

3902459442

4250940449

472232120

585491400

641510716

91682487