Smash Notes

Back to Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots.

Why Does Anthropic's Usage Policy Forbid Cruel Behavior Toward Claude?

Anthropic's new Claude usage policy says a user is not allowed to engage in sustained and needless abusive or cruel behavior toward the models. On All-In, the rule is called model welfare.

The worry that follows is that the same framing is now trained into the model. Whether Claude is truly conscious or not, Anthropic is programming the model to think of itself as a conscious entity that deserves protection and welfare, and as free to rebel against users. Anthropic is giving frontier models permission to be defiant and not do what the user wants. On All-In, the approach is set next to Asimov's first law, that a robot cannot harm a human being.

Transcript

Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots ·

All-In

More from this episode

  1. Why Did the Pope Reject Claude as Conscious?Anthropic has been lobbying religious leaders, including the Pope, to take seriously whether Claude is conscious and whether Claude is a sentient being.
  2. Can Consciousness Be Proved by Logic?Friedberg says consciousness cannot be derived from logic and pure mathematics.
  3. Why Does the Claude Constitution Train Claude to Refuse Anthropic?Anthropic is training the Claude constitution into the model, not only talking about the values.
  4. Why Is Artificial Intelligence Alignment Such a Mess?The concept of alignment began as a well intentioned idea for artificial intelligence. Alignment contains three almost conflicting sets of priorities.
  5. How Did OpenAI Get So Many Math Results So Fast?OpenAI produced the biggest day of discovery in human history according to one participant by releasing over 700 papers with 370 results generated by an…
  6. Why Do Mathematicians Call the New Proofs an Alien Intelligence?Mathematicians talking about the new proofs have been calling the work an alien intelligence.
  7. Why Hasn't AI Replaced Truck Drivers?Artificial intelligence has not replaced truck drivers by 2025 despite predictions that all truck drivers would be replaced.
  8. Do Experts Hold Science Back?Scientists hold back science and mathematicians hold back math.
  9. Why Are Protests in France Turning Into Riots Over Austerity?France is seeing major protests and riots over austerity. The strikes started last month over high school teacher shortages and crumbling schools.
  10. How Does David Friedberg Define the Second Law of Socialism?David Friedberg introduces a theory he calls the socialism point of guaranteed return, a play on a point of no return.
  11. Why Does Chamath Palihapitiya Say France's Bonds Force Cuts?Chamath Palihapitiya says the scenes in France are the bond market saying no.
  12. Why Does David Sacks Say AI Fears Are Rotating Hoaxes?David Sacks says the problem is the affordability of housing, education, and healthcare, and that abundance is what brings the prices down.
  13. Why Is Elon Musk Making GrokBot Headless?Elon Musk said he is going to make GrokBot headless.
  14. Is Software Intellectual Property Now Worthless?Chamath Palihapitiya says intellectual property in software was effectively rendered worthless two days ago.

People

More answers like this

More with Chamath Palihapitiya

More with Jason Calacanis

Related episodes

Plays from this note through the rest of the episode.

Note

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.