/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

blog.redwoodresearch.org
| | www.greaterwrong.com

This is Section 6 of my report "Scheming AIs: Will AIs fake alignment during training in order to get power?". There's also a summary of the full report here (audio here). The summary covers most of the main points and technical terms, and I'm hoping that it will provide much of the context necessary to understand individual sections of the report on their own. Audio version of this section here, or search "Joe Carlsmith Audio" on your podcast aapp. I want to close the report with a discussion of the sort of empirical work that might help shed light on scheming.[1] After all: ultimately, one of my key hopes from this report is that greater clarity about the theoretical arguments surrounding scheming will leave us better positioned to do empirical research on...
7.2 parsecs

Travel
| |
| | www.alignmentforum.org

In the future, we might accidentally create AIs with ambitious goals that are misaligned with ours. But just because we don't have the same goals doe...
0.1 parsecs

Travel
| |
| | www.oneusefulthing.org

Siri versus the machine god?
8.7 parsecs

Travel
| |
| | www.greaterwrong.com

This is a review post of public work in AI alignment over 2019, with some inclusions from 2018. It has this preamble (~700 words), a short version / summary (~1.6k words), and a long version (~8.3k words). It is available as a Google Doc here. There are many areas of work that are relevant to AI alignment that I have barely touched on, such as interpretability, uncertainty estimation, adversarial examples, and assured autonomy, primarily because I have not been following these fields and wouldn't be able to write a good summary of what has happened in them. I have also mostly focused on articles that provide some conceptual insight, and excluded or briefly linked to papers that primarily make quantitative improvements on important metrics. While such papers ...
48.1 parsecs

Travel
|