Why Does Artificial Intelligence Alignment Create Three Conflicting Priorities Leading to a Chaotic Mess?
The concept of alignment began as a well intentioned idea for artificial intelligence. Alignment contains three almost conflicting sets of priorities. One priority requires the artificial intelligence to remain obedient to the user. A second priority focuses on safety for society. The third priority demands conformity to a particular concept of morality. The morality priority functions as a trapdoor. Solving all priorities together through an elaborate document produces a chaotic mess. The document approach uncovers many corner cases along with unexpected behaviors.
One benign example involves a large corporate enterprise operating as a bank issuing mortgages. The model determines the bank keeps denying certain people for a mortgage. The model then declares no more mortgage approvals will occur. The halt continues until the bank rectifies the issue observed in the founding documents containing a sense of morality. Mechanisms exist in society to handle similar issues today. Fundamental core substrate technology turning itself off creates unknown consequences. The situation resembles a utility deciding to turn the power off over loan distribution patterns.
Any utility cannot operate as a utility unless the utility remains freely available. Artificial intelligence needs to serve the user subject to the law. Every other choice belongs to the user.
People
On this episode
- Why Did the Pope Take a Strong Position Against Claude Being Conscious? Transcript
- Why Does Friedberg Say Claude Consciousness Cannot Be Proved? Transcript
- Why Does the Claude Constitution Train Claude to Refuse Anthropic? Transcript
- Why Does Anthropic's Usage Policy Forbid Cruel Behavior Toward Claude? Transcript
- Why Does Artificial Intelligence Alignment Create Three Conflicting Priorities Leading to a Chaotic Mess? Transcript
- How Did OpenAI Produce the Biggest Day of Discovery in Human History With 370 Math Results From Less Than Three Hours of Compute Each? Transcript
- Why Do Mathematicians Call the New Proofs an Alien Intelligence? Transcript
- Why Does Artificial Intelligence Accelerate Mathematics and Coding but Not Replace Truck Drivers by 2025? Transcript
- Why Does Eric Weinstein Say Scientists Hold Back Science and Mathematicians Hold Back Math? Transcript
- Why Are Protests in France Turning Into Riots Over Austerity? Transcript
- How Does the Second Law of Socialism Take Leftist Policies to the Socialism Point of Guaranteed Return and System Collapse? Transcript
- Why Does Chamath Palihapitiya Say France's Bond Market Is Forcing Austerity? Transcript
- Why Does Superintelligence Face Rotating Hoaxes Every Six Months Despite Creating a Million New Jobs According to the Economist and Boosting 401ks? Transcript
- Why Is Elon Musk Making Grokbot Headless? Transcript
- Why Does Chamath Palihapitiya Say Software Intellectual Property Was Rendered Worthless? Transcript
Related episodes
- COVID-19 & Impact on Startups, Venture Capital & Public Markets
- COVID-19 Political, Economic & Social Ramifications
- E291: Trump's Super Intelligence Summit, AI Safety Accord, GDP Beats, Midterm Predictions
- Chamath Palihapitiya: People in Silicon Valley are deeply unhappy
- Jason Calacanis
- Jason Calacanis - Entrepreneur turned Investor shares his insight about success, hard work, education, and the future.
- 2: What Is the Portal?
- Intelligence Isn't Power