/explore
|
You are here 
|
www.alignmentforum.org | ||
| | | | |
www.lesswrong.com
|
|
| | | | | When will AGI systems want to solve the alignment problem? At some point, I expect AGI systems to want/need to solve the alignment problem in order... | |
| | | | |
www.lesswrong.com
|
|
| | | | | A "good project" in AGI research needs:1) Trustworthy command, 2) Research closure, 3) Strong operational security, 4) Commitment to the common good,... | |
| | | | |
www.lesswrong.com
|
|
| | | | | We founded Anthropic because we believe the impact of AI might be comparable to that of the industrial and scientific revolutions, but we aren't conf... | |
| | | | |
www.greaterwrong.com
|
|
| | | In a recent tweet, Anthropic seems to have asserted that hyperstitionis responsible for observed misalignment in their AIs. Strangely, the research post they use as evidence appears to be only vaguely related to hyperstition[1]? I think this is part of a pattern by Anthropic of promoting the theory of hyperstition- the idea that writing about misaligned AI helps bring misaligned AI into existence- without explicitly calling it that. However, the research post shared with this tweet doesn't seem to be about writing misaligned AI into existence. Instead they find that training the model on reasoning traces- generated by reflecting on its constitution while giving users ethical advice on difficult dilemmas- reduces misaligned behavior. This presumably works by ... | ||
