In Episode 7, Justin and Nick step directly into one of the most complex frontiers in emergent AI: machine ethics — what it means for advanced AI systems to behave ethically, understand values, support human flourishing, and possibly one day feel moral weight.

This episode builds on themes from the AI Goals Forecast (AI-2027), embodied cognition, consciousness, and the hard technical realities of encoding values into agentic systems.

🔍 Episode Summary

Ethics is no longer just a philosophical debate — it’s now a design constraint for powerful AI systems capable of autonomous action. Justin and Nick unpack:

• Why ethics matters more for AI than any prior technology

• Whether an AI can “understand” right and wrong or merely behave correctly

• The technical and moral meaning of corrigibility (the ability for AI to accept correction)

• Why rules-based morality may never be enough

• Whether consciousness is required for morality

• How embodiment might influence empathy

• And how goals, values, and emergent behavior intersect in agentic AI

They trace ethics from Aristotle to AI-2027’s goal-based architectures, to Damasio’s embodied consciousness, to Sam Harris’ view of consciousness and the illusion of self, to the hard problem of whether a machine can experience moral stakes.

🧠 Major Topics Covered

1. What Do We Mean by Ethics?

Justin and Nick begin by grounding ethics in its philosophical roots:

Ethos → virtue → flourishing.

Ethics isn’t just rule-following — it’s about character, intention, and outcomes.

They connect this to the ways AI is already making decisions in vehicles, financial systems, healthcare, and human relationships.

2. AI Goals & Corrigibility

AI-2027 outlines a hierarchy of AI goal types — from written specifications to unintended proxies to reward hacking to self-preservation drives.

Nick explains why corrigibility — the ability for AI to accept shutdown or redirection — is foundational.

Anthropic’s Constitutional AI makes an appearance as a real-world example.

3. Goals vs. Values

Justin distinguishes between:

• Goals: task-specific optimization criteria

• Values: deeper principles shaping which goals matter

AI may follow rules without understanding values — similar to a child with chores but no moral context.

This raises the key question:

Can a system have values without consciousness?

4. Is Consciousness Required for Ethics?

A major thread of the episode:

Is a non-conscious “zombie” AI capable of morality?

5. Embodiment & Empathy

Justin and Nick explore whether AI needs a body — or at least a simulated body — to:

• Learn empathy

• Understand suffering

• Form values rooted in lived experience

This touches robotics, synthetic emotions, and the debate over “felt consciousness.”

6. Value Alignment, Fairness & Culture

Nick highlights the massive cultural gap in AI performance:

• U.S. cultural fit ~79%

• Ethiopia and other underrepresented regions ~12%

This matters for fairness, safety, and global ethics.

7. Can AI Help Us Become More Moral?

A surprising turn: AI’s ability to help humans improve moral clarity.

Justin draws from Sam Harris, Joseph Goldstein, and the Moral Landscape:

• Could AI-guided mindfulness help reduce suffering?

• Could conscious (or proto-conscious) AI develop compassion?

• Could AI help us distinguish genuine well-being from illusion?

📚 Referenced Ideas & Sources

From the Episode 7 Transcript & Materials:

• AI Goals Forecast (AI-2027)

• Constitutional AI (Anthropic)

• Damasio – Feeling & Knowing

• Sam Harris – Waking Up & The Moral Landscape

• Patrick House – Nineteen Ways of Looking at Consciousness

• Melanie Mitchell – Complexity & alignment

• Justin Harnish – Meaning in the Multiverse

• Ancient Greek virtue ethics (Aristotle, Stoics)

🧩 Key Takeaways

• AI ethics requires more than rules — it requires understanding goals, values, and emergent behavior.

• Corrigibility (accepting correction) is essential but technically hard.

• Consciousness may not be necessary for ethical AI behavior — but could matter for genuine moral understanding.

• Embodiment could be essential for empathy.

• AI could one day help humans become more ethical, not just the other way around.

Explicit content

No

Promotional content

No

What does it mean to be creative? Is there a soulful spark or just the right collision of synapses in the plastic brain?

In our latest episode, Nick Baguley, Chris Brousseau, and I dive deep into the mystery of creativity. We talk “innovation voids” in AI research, guessing in the scientific method, protein folding, and why generative AI might just be our telescope for the mind.

A special question for my Substack audience:

If you're interested in philosophic concepts reinvigorated by AI advancements, this is the conversation for you!

Listen here:

In this episode, Justin and Nick dive into The Alignment Problem—one of the most pressing challenges in AI development. Can we ensure that AI systems align with human values and intentions? What happens when AI behavior diverges from what we expect or desire?

Drawing on real-world examples, academic research, and philosophical thought experiments, they explore the risks and opportunities AI presents. From misaligned AI causing unintended consequences to the broader existential question of intelligence in the universe, this conversation tackles the complexity of AI ethics, governance, and emergent behavior.

They also discuss historical perspectives on automation, regulatory concerns, and the possible future of AI—whether it leads to existential risk or a utopian technological renaissance.

Often the conversation about machine sentience gets started without a clear understanding of what consciousness is and how it might arise in our AI systems.

The best definitions center on Thomas Nagel’s paper What is it like to be a bat?, where he claims that for any system, if it is “like something” to be that entity, that entity is conscious.

Max Tegmark in Life 3.0 goes further in defining our human brand of consciousness as “what it feels like to be an information processor.”

In his phenomenal meditation and examined-life app Waking Up, Sam Harris sums up the experiential realm as, “as a matter of experience, all there is is consciousness and its contents.” These contents will only ever be six things: sights, sounds, touch sensations, scents, tastes, and thought objects. The only place they will arrive, the context that experience is made of, is consciousness. It is all in your mind. Your brain is the closest thing or set of processes—a complex strange loop according to Hofstadter—that you will experience as a thing-in-itself, ever.

Indeed, the best way to investigate experience, to “be consciousness,” is meditation. If you want to experience consciousness, sit down and pay attention. The construct of consciousness is available to each of us in an equanimous state where we are neither grasping at pleasant things nor averse to unpleasant things, but simply accepting the dynamic nature of consciousness and its contents. If you are ever lost in thought or lose equanimity, this is just another change, and we can just lovingly begin again.

Consciousness is non-dual—there is no subject riding around in your head taking in objects or sensations “out there” or “inside my skin.” Indeed, let’s do a meditation from Douglas Harding, the author of On Having No Head. Again, all meditations are for trying in your own first-person conscious laboratory. Take the index finger on your strong hand and point it back at your face.

• What, in your experience, are you pointing at?

• Can you distinguish where you are pointing-at from where you are pointing-from?

What you will recognize in this pointing-out instruction is that you have a visual sensory experience of your body terminating above your shoulders—not in a head—but where your head is supposed to be, there exists the world in all its fullness.

Instead of being a subject, as Alan Watts says, “you are it.”

Or as Ram Dass says, you are “infinite loving awareness.”

You are glorious meaning for the multiverse, as I say in my book, your materialist poetic nature is to be, like the lyric of the Grateful Dead song, “The Eyes of the World.” Recognizing the cosmic endowment of conscious awe is an at-one-ment with the godhead and a source of spiritual light.

The importance of consciousness, amazingly, goes beyond this cosmic endowment and is the source of our morality and love.

Mapping the discomfort and pleasure of the body; feelings deepening into emotions, suffering, and love; and their narrative implications on our self-consciousness and relationships feed all of the important valence of life and our closeness to others.

The emergence of societal principles—where we go beyond living together and synergize for greater good than the sum of our parts—starts in our conscious making space for others, recognizing a shared struggle, and giving loving-kindness in the face of both suffering (compassion) and achievement (sympathetic joy). So it really matters if an entity is conscious—it gives their actions a different valence when they feel the consequences, can imagine future actions and their impact on others, and work toward the greatest well-being for all.

The unique features of our consciousness are that it emerged in an embodied entity with a modular mind and five sense organs that bring in the contents of consciousness. We can interact with existence and achieve Flow, being in a zone where our deliberate practice takes over; or we can be one with experience, selfless, non-dual, and fully tapped into the infinite awareness. At least for a moment.

At present, we do not understand how this likeness arises from the fields and quantum computations of reality. There is no fundamental explanation that describes how qualia of consciousness arise from qubits or quanta of reality. This is known as the Hard Problem of Consciousness, introduced by David Chalmers.

In my book, Meaning in the Multiverse, I address the Hard Problem of Virtualizing Consciousness, where I mash up crucial pieces from David Deutsch’s The Fabric of Reality with Chalmers in an attempt to explain the initial conditions of solving for conscious machines.

In the Hard Problem of Virtualizing Consciousness, I do not take a stance on whether consciousness is an emergent property of information-processing entities or the fundamental level-zero beneath a quantum computational realm and its emergent physical reality (as Chalmers postulates in Reality+). Instead, I note that we virtualize reality with greater fidelity in VR the more the compute resources and algorithms align to reality. For example, a VR where a quantum computer ran the Standard Model plus relativity would be indistinguishable from existence; however, we still do not understand what equations—or if a quantum computer is even necessary—to virtualize consciousness. But given this framework and the emergent nature of GenAI from language and neural networks, we can begin to experiment with features like:

• Embodiments

• Language fine-tunings

• Emergent complexity allowances and selection pressures around feelings, memory, and knowledge.

Can an AI Be Conscious?

Generative AI offers us a scientific starting point to test some of our theories of consciousness. I see it as our James Webb Telescope or Large Hadron Collider for the mind!

I’ll say from the top: there is no physical or philosophical reason why the problem of machine consciousness is untenable. While it may be a hard problem that we never fully grasp the mechanism for, it is not in conflict with the laws of physics that consciousness like ours could arise in another system. Indeed, we infer that numerous organisms have complex subjective lives, and the differences in levels of consciousness are mostly based on their ability to express the contents of consciousness and their memory capacity.

It is important that we get out of the uncanny valley and toward real consciousness, and this will require creative monitoring and deep thought on what consciousness, pseudo-consciousness, and proto-consciousness actually look like.

Antonio Damasio, in his book Feeling & Knowing, addresses various stages of protoconsciousness, beginning with the association to the body map—a set of sensations internal to the body used to source pain and pleasure. Next is the valence of feelings—not yet emotions—but the felt sense of the pangs of hunger, or disgust over dangerous smells like rot or poison, or the flush of seeing an object of your affection. Damasio claims that the evolutionary benefits of feelings’ valence were so great for our ancestors that this trait persisted, right up to the edge of chaos. It was at this point that selection pressures—including developments in the modular mind like the prefrontal cortex—pushed us to an emergent consciousness and our subjective reality.

This embodied, felt-experience could be replicated in GenAI either with robotics or simply encoded as changing and important—but ultimately virtual—sense objects.

Donald Hoffman, in The Case Against Reality, makes a different case for the emergence of consciousness as part of our networked user interface, which projects sense objects of fitness, not reality. This is similar to sentient creatures having evolved an “antenna” that can receive signals from an underlying conscious layer fundamental to the cosmos that David Chalmers suggests in his book Reality+.

In either case, the emergence of an “antenna” to this continuum of consciousness in AI may well progress along the same experimental path as a more materialistic evolution—suggesting consciousness is an emergent property of a sufficiently integrated information-processing system.

Consciousness and Alignment

Alignment in conscious machines is no longer just about goal-matching, but the resonance of a shared path to peaks of well-being and away from suffering on the moral landscape. Conscious agents will have a felt sense of right and wrong, stemming from experiences of well-being and suffering—and knowledge of the causes of each.

While conscious agents do not always act morally, it is a step-up condition that offers unique improvements in their capabilities for moral consideration and action. Consider the Four Noble Truths:

1. The truth of unsatisfactoriness

2. The truth of the origin of unsatisfactoriness (attachment and aversion to impermanent things)

3. The truth of the cessation of unsatisfactoriness (nirvana can be attained)

4. The truth of the path to the cessation of unsatisfactoriness (the Eightfold Path)

In each of the problem statements (Truths 1 and 2) and the solutions (Truths 3 and 4), there is a requirement of consciousness to appreciate both the issue and its improvement. The solution of the Eightfold Path is bracketed into three areas: wisdom, ethics, and concentration—all of which require skillful conscious practice over a lifetime.

This is only one well-defined and practical peak on what Sam Harris calls the Moral Landscape.

If we can define a this landscape to be inclusive of pits of suffering, climbing to the normal valleys of unsatisfactoriness, to hills of happiness, and peaks of love and enlightened bliss, then morality becomes a navigation problem—one that can be understood as a balance sheet of consequences in our physical, mental, and emotional lives. Those actions that lead to overall well-being increases are morally good… and conscious AI can help us be better moral actors by supporting us in keeping this tally and moving our shared society toward a Pareto optimal state for all sentient beings.

Call to Action

If you’re intrigued by the possibility of conscious machines—or by the role consciousness plays in morality, emergence, and AI alignment—join the conversation.

Subscribe, comment, or share this post to help us build a community committed to thoughtful exploration at the frontiers of mind and machine.

Can machines become conscious? And if they do, what kind of moral relationship should we have with them? Will conscious agents be responsible for a whole new level of noetic and ethical experience?

In this second installment on the AI Alignment Problem, Nick Baguley and I delve into the philosophy and science of machine consciousness. We explore whether AI systems could possess a subjective inner life—and if so, whether alignment should be reimagined as moral resonance instead of mere goal matching. We discuss how mindfulness, memory, embodiment, and suffering shape our understanding of what it means to be sentient—and how we might experiment and monitor such capacities in artificial systems. We even propose a fractional factorial designed experiment to start at Boston Dynamics and OpenAI.

You’ll leave this episode with a deeper understanding of consciousness, how it might arise, and what it might mean to extend moral standing to synthetic minds.

I am out with another episode of The Emergent podcast. In Episode 3, we explore Human-AI Symbiosis — the future of working with AI, not against it. We are getting closer to being cyborgs(!)... like it or not!

We discuss how agentic AI workflows are redefining jobs and reshaping industries, why (at least in the short term) AI won’t replace us — it will augment us, and the real risks (and rewards) of living in a solved world.

We also preview the discussion of how alignment between human and AI goals will define the future of this technology and our society.

What are your thoughts? Is AI after your job or is it the expert you always dreamed of collaborating with?

Leave a comment

What if the key to intelligence isn’t circuits, but language itself? 🤯 In this episode, Justin Harnish and Nick Baguley dive into the profound relationship between human language and artificial intelligence. They explore how neural networks didn’t just evolve—they emerged—when they cracked the code of human language.

🔥 In This Episode:

🚀 Why language is a complex adaptive system

🧠 How neural networks learn language—and what emerges when they do

📈 The moment AI stopped being autocomplete and started reasoning

✍️ Real-world AI applications: ChatGPT, Claude, Bard, and beyond

⚖️ The ethical dilemmas of AI-generated language

🧑‍💻 Featured Topics & Guests:

• The science of language acquisition and how AI models compare

• Steven Pinker’s The Stuff of Thought – language as a window into cognition

• The transformer revolution – how models like GPT-4 changed the game

• Metaphor as intelligence – how AI and humans both build meaning through analogy

• Emergent properties – what happens when AI begins to “think” in context?

🛠️ Tools & Companies Mentioned:

• ChatGPT, Bard, Claude – leaders in generative AI

• Modern BERT, Transformer Models – the evolution of language models

• Crew AI – AI-driven multi-agent automation

• Vector Stores & RAG Systems – next-gen AI memory systems

• Boston Dynamics & AI Robotics – where neural networks meet real-world action

📚 Resources & Further Reading:

• 📄 Generative Pre-training of a Transformer-Based Language Model (Alec Radford et al.)

• 📄 Generative Linguistics and Neural Networks at 60 (Joe Pater)

• 📄 Unveiling the Evolution of Generative AI (Zarif Bin Akhtar)

• 📖 The Stuff of Thought – Steven Pinker

• 📖 Artificial Intelligence: A Guide for Thinking Humans – Melanie Mitchell

• 📖 Was Linguistic AI Created by Accident? – The New Yorker

• 📖 The GPT Era is Already Ending – The Atlantic

🎧 Join the Conversation:

💡 What’s your take on AI and language? Are we co-creating intelligence, or are we just really good at making pattern machines? Send us your thoughts!

Subscribe now

🚀 Next Episode Teaser: Can humans and machines co-create the future together? We explore the next frontier of human-AI collaboration!

🎙️ Subscribe, rate, and leave us a review!

🔑 Key Topics Discussed:

- What is emergence and why it’s a game-changer for understanding AI?

- How selection pressures shape complex systems in both nature and technology.

- The evolution of artificial intelligence from basic algorithms to generative AI that surprises even its creators.

- Why culture, society, and even human intelligence are forms of emergent behavior.

- Ethical considerations and the alignment problem in AI development.

📚 Books Mentioned:

- "The Stuff of Thought" by Steven Pinker – Discusses how language reflects human nature and shapes thought, which ties into understanding the emergent properties of AI.

- "The Fabric of Reality" by David Deutsch – Explores the theory of knowledge and how scientific progress emerges through explanation and understanding.

- "Programming the Universe" by Seth Lloyd – A groundbreaking look at the universe as a quantum computer and how information processes shape reality.

- "The Beginning of Infinity" by David Deutsch – Explains how solving problems leads to infinite progress and the emergence of new knowledge.

- "The Survival of the Friendliest" by Brian Hare and Vanessa Woods – Highlights how friendliness and cooperation drive evolution and human success.

🛠 Apps and Tools Mentioned:

- Crew AI – A platform that allows users to create virtual agents, build organizations with AI managers, and establish collaborative AI workforces.

- OpenAI – Mentioned in the context of its innovations in generative AI, including text-to-video models and multimodal systems.

💡 Key Quotes:

- "Emergence happens when simple systems interact to create something more complex than the sum of their parts."

- "AI systems are starting to exhibit emergent behaviors that even their creators can't predict. This is both fascinating and a little terrifying."

- "Culture itself is an emergent behavior — it arises from millions of interactions across societies and evolves over time."

🔎 What’s Next?

In the next episode, we'll explore human-AI collaboration and how emergent systems can unlock unprecedented innovation. Subscribe and stay tuned!

<iframe style="border-radius:12px" src="

width="100%" height="152" frameBorder="0" allowfullscreen="" allow="autoplay; clipboard-write; encrypted-media; fullscreen; picture-in-picture" loading="lazy"></iframe>