We research the offensive capabilities of AI systems today to better understand the risk of losing control to AI systems forever.

We research dangerous AI capabilities to better understand misuse risks from current systems, and how advances in hacking, deception, and persuasion will affect the risk of catastrophic AI outcomes. We create concrete demonstrations of dangerous capabilities to advise policy makers and the public on AI risks.

We are working closely with government agencies, policy think tanks, and media organizations to inform relevant decision makers. For example, [our](https://arxiv.org/abs/2310.20624) [work](https://arxiv.org/abs/2311.00117) demonstrating that it is possible to effectively undo Llama 2-Chat 70B’s safety fine-tuning for less than $200 has been used to [confront](https://www.washingtonpost.com/technology/2023/09/13/senate-ai-hearing-musk-zuckerburg-schumer/) Mark Zuckerberg in the first of Chuck Schumer’s Insight Forums, cited by Senator Hassan in a [senate hearing](https://www.hsgac.senate.gov/subcommittees/etso/hearings/advanced-technology-examining-threats-to-national-security/) on threats to national security, and used to advise the UK AI Safety Institute.

Palisade Research

CivAI is a non-profit that educates the public about AI's capabilities and dangers using live software demonstrations.

**CivAI is a non-profit that educates the public about AI's capabilities and dangers using live software demonstrations.** To date, CivAI has delivered 100+ briefings to organizations across civil society (on AI-cyber risks, deepfakes, and elder fraud) and government (on biological risks, elections, and more). Its work has been featured on national television by ABC News and FOX, and in print by the New York Times, the Washington Post, TIME, CNN, and many others.

CivAI

A research nonprofit that works on assessing whether cutting-edge AI systems could pose catastrophic risks to society.

METR (Model Evaluation and Threat Research) builds the science of accurately assessing risks, so that humanity is informed before developing transformative AI systems.

We believe that AI could change the world quickly and drastically, with potential for both enormous good and enormous harm. We also believe it’s hard to predict exactly when and how this might happen.

At some point, AIs will probably be able to do most of what humans can do, including developing new technologies; starting businesses and making money; finding new cybersecurity exploits and fixes; and more.

We think it’s very plausible that AI systems could end up pursuing goals that are at odds with a thriving civilization. This could be due to someone’s deliberate effort to cause chaos, or happen despite the intention to only develop AI systems that are safe.

Given how quickly things could play out, we don’t think it’s good enough to “wait and see” whether there are dangers.

We believe in vigilantly, continually assessing risks. If an AI brings significant risk of a global catastrophe, the decision to develop and/or release it can’t lie only with the company that creates it.

METR

148788709

1578280819

1873740264

2052641908

2088874155

We are a nonprofit, so we rely on the generosity of donors like you.

Choose a donation for Every.org

2109878826

2140519340

2310049938

2551237796

2576076625

2594001433

283252266

2883383521

3026174861

316638097

3170054231

338811242

3705164611

3842241318

3934974605

4167807122

440668958

1287028958

2729980760

2939442496

3440869557

671754822

87081813

1014384873

1112422858

153399038

2028390811

220342792

2266630408

2519810400

2539558839

2826465835

2843798242

2898624300

3259439560

339774024

3642494300

3902459442

4250940449

472232120

585491400

641510716

91682487