/explore
|
You are here 
|
joecarlsmith.com | ||
| | | | |
www.alignmentforum.org
Evan et al argue for developing "model organisms of misalignment" - AI systems deliberately designed to exhibit concerning behaviors like deception o... |
|
| | | | | ||
| | | | |
blog.redwoodresearch.org
More thoughts on making deals with schemers |
|
| | | | | ||
| | | | |
www.greaterwrong.com
This is a link-post for a new paper I read: Safety Pretraining: Toward the Next Generation of Safe AI by Pratyush Maini, Sachin Goyal, et al.For a couple of years I (and others) have been proposing an approach to alignment: what the authors of this recent paper name "safety pretraining". In a nutshell: that it's best to apply your alignment training as part of the standard pretraining process to produce a base model that is already aligned - simply pretrain it on data including a lot of clearly marked examples of aligned behavior (then prompt for it). |
|
| | | | | ||
| | | | |
www.lesswrong.com
Our alignment research aims to make artificial general intelligence (AGI) aligned with human values and follow human intent. We take an iterative, em... |
|
| | | |||
