woman doing a grocery task, showcasing the need for VR for cognition and memory

VR for Cognition and Memory

Manuscript, Proceedings, Protocol-002

This blog post is based on a recent book chapter “VR for Cognition and Memory” in Current Topics in Behavioral Neuroscience: Virtual Reality in Behavioral Neuroscience: New Insights and Methods. This work presents a review of research on VR’s ability to provide ecologically valid environments to study memory and cognition and discusses how features like interactivity, locomotion, and contextual control engage the brain’s memory systems more naturally than lab studies.

Get The Article

  • PDF
  • Paywalled Chapter

Cite This Work

  • APA
  • AMA
  • MLA

Reggente N. (2023). VR for Cognition and Memory. Current topics in behavioral neurosciences, 10.1007/7854_2023_425. Advance online publication. https://doi.org/10.1007/7854_2023_425

Reggente N. VR for Cognition and Memory [published online ahead of print, 2023 Jul 14]. Curr Top Behav Neurosci. 2023;10.1007/7854_2023_425. doi:10.1007/7854_2023_425

Reggente, Nicco. “VR for Cognition and Memory.” Current topics in behavioral neurosciences, 10.1007/7854_2023_425. 14 Jul. 2023, doi:10.1007/7854_2023_425

Revolutionizing Cognition Research with Virtual Reality

For decades, scientists have worked tirelessly to elucidate the intricate neural machinery supporting human cognition. This endeavor is certainly not for the faint of heart, as formidable challenges present themselves at every turn.

“To study cognition holistically means investigating interconnections between its rich repertoire of functions, including attention, reasoning, language, and memory. Memory is a particularly crucial facet, as it supports and subserves all other aspects of cognition; no cognitive task can be accomplished without memory.”

A holistic understanding demands that we study cognition as it operates in its natural habitat – the real world. Otherwise, as the parable of the blind men and the elephant warns, we risk gross mischaracterizations. Researchers must therefore conduct experiments in “verisimilar contexts (i.e. contexts appearing as the RW)” to achieve ecological validity.

Virtual reality (VR) presents an unprecedented opportunity in this regard. By simulating the real world, we can now study memory and cognition with enhanced veridicality.

“The environmental customization afforded by VR makes it an ideal tool for studying cognition in an ecologically valid fashion. Through the lens of memory studies, this chapter showcases the ways in which VR has advanced a meaningful and applicable understanding of cognition.”

The article presents a thorough review of research that showcases how VR is revolutionizing the study of cognition and memory.

Bridging the Gap Between Lab and Real-World Cognition

Traditional lab experiments often possess limited generalizability, whereas VR can provide naturalistic environments and tasks that echo real-world demands, easily bolstering ecological validity. Previous work has made a compelling case for how VR enhances the ecological validity of fMRI memory research.

VR experiences engage recollection-based memory retrieval akin to real events, unlike lab stimuli which rely more on familiarity. Indeed, VR experiences appear to be retrieved via recollection-based processes similar to those that support autobiographical/recollection memory, whereas retrieval of conventional screen experiences seems more similar to familiarity. This makes VR apt for integrated cognition and memory research.

VR Permits for Information to be Situation in Space

Most importantly, VR permits realistic navigation around virtual environments (c.f.), affording users with a sense of space (the scaffolding of memory). Both philosophers and psychologists alike postulate that brains have evolved solely to support purposeful and predictable movement. Many posit that the ontogeny of episodic memory relates to the onset of locomotion during infancy that scales with Hippocampal development (which also provides a mechanism for infantile amnesia and age-related episodic memory loss). One source of evidence to support this proposition is in the life cycle of the bluebell tunicate. This filter feeder begins to digest a substantial chunk of its cerebral ganglion once identifying a suitable undersea perch to spend the rest of its existence. This phenomenon suggests that once it has served its purpose as a neural network supporting movement, the cerebral ganglion yields greater utility to the organism as nutrition.

From chemotaxis to cognitive maps, a representation of space is necessary for meaningful movement. A neural instantiation of a map that provides spatial bookmarks of an organism’s experiences, demarcating the locations of nutrition and enemies within an environment, is a fundamental component of brains. Indeed, there is a primacy of spatial content in the neural representation of events. Spatial information is often recalled earliest in the retrieval process, and the degree to which individuals report confidence in their autobiographical memories is predicted by their knowledge of the spatial layout of the setting in which the memory occurred. The Method of Loci (a.k.a. Memory Palace) mnemonic has long been appreciated for its ability to increase memory by imagining to-be-remembered information placed at familiar locations. Past work used a VR implantation of this technique to suggest that the principal component behind mnemonic efficacy is the explicit binding of the objects to a spatial location and revealed a tight relationship between spatial memory (SM) and free recall of encoded objects. These observations showcase that space and memory are inextricably linked at conceptual and neuronal levels – a notion that has become entrenched in popular culture; the phrase “out of space” is often used when indicating a computer’s memory is full.

a fantastical virtual environment that could be used to study the relationship between objects, positions, and memory.

If space is the inescapable wallpaper that serves as the backdrop for all experience, then it follows that as our spatial or environmental context changes, so should the neural activity underlying diverse cognitive processes. Given that VR can easily change environments, it provides an unparalleled landscape with which to study the intersection of space, memory, and cognition.

Additionally, VR enables human analogs of spatial memory research previously limited to animal models, like virtual radial arm mazes. This facilitates powerful translational research from rodents to humans.

Key Features of VR That Facilitate Cognition Research

Below are some features highlighted by the chapter that are exclusive to VR. Such features permit real-world scenarios with increased experimental control and significantly less costs.

  • VR provides absolute control over the environment. This permits isolation and systematic manipulation of spatial contexts, immersion, emotions, embodiment, etc.
  • Rapid teleportation between environments induces robust context-dependent learning, a fundamental principle in memory encoding.
  • Interactivity and locomotion increase embodiment and navigational involvement, enhancing hippocampal memory systems.
  • Implicit metrics like gaze, paths, and object interactions generate objective measures of memory and attention unbiased by subjective reporting.
  • Brain imaging during VR reveals in vivo neural correlates of cognition impossible with real-world navigation.
  • VR spatial mnemonics such as the Method of Loci can provide performance improvements over just imagination by standardizing and controlling the environments.

Applications of VR for Assessing and Enhancing Cognition

Conventional measures of memory typically focus on core content (i.e., the “what”) instead of the true binding that happens in actual episodes (i.e., “what,” where,” and “when”). They also often use verbal materials, which makes the test sensitive to performance in non-memory domains, permitting for compensatory strategies which could erroneously reveal normal “memory.” Subjective reports rarely scale with performance on traditional memory tests, warranting criticism that such measures wrongly estimate memory capacities for everyday situations. For example, patients reporting topographical memory deficits have preserved ability in tabletop tests of spatial or geographical knowledge. Additionally, cognitive complaints in amnesiacs typically show little correlation with verbal memory tests used in clinical settings.

VR tasks, however, have been more reliable in tracking self and caregiver reports of deficits that impact quality of life. The points below highlight other aspects of VR that can increase the ecological validity of both the detection and amelioration of memory deficits.

  • VR scenarios like virtual stores and routes enable sensitive, ecologically valid tools to identify mild cognitive impairment early.
  • VR spatial navigation paradigms can differentiate Alzheimer’s from milder impairment based on hippocampal recruitment patterns.
  • VR enables safe exposure therapy for memory deficits induced by trauma and realistic training for brain injury rehabilitation.
  • Spatial mnemonic techniques adapted to VR boost memory beyond baseline abilities in healthy individuals.
  • VR puzzles engage aging minds, increasing motivation. Long-term regimes may prevent decline. As one study found, “6 months of VR training powerfully increased long-term recall.”
  • VR training could augment real-world cognition and rehabilitate deficits, with proven memory transfer effects.

In conclusion, VR enables an unprecedented ability to understand real-world cognition, precisely diagnose impairments, and develop interventions that enhance memory and cognition. The immersive, interactive nature of VR environments engages our brains’ memory systems far more naturally than traditional lab studies.

The inherently engaging qualities of VR, coupled with its ability to implicitly quantify and enhance memory, make it a powerful tool in populations spanning from pediatrics to the elderly.

Indeed, VR may catalyze discoveries about the very mechanisms underlying human consciousness itself, which intimately relies on episodic memory. By augmenting these processes, VR could profoundly transform our experience and understanding of consciousness. The future of cognition research has never looked more exciting.

Read more
artificial empathy could create an artificial boddhisattva

Sociopathic Superintelligences, Artificial Empathy, and Robot Bodhisattvas, Oh My!

E4001, Manuscript

This blog post is based on a recent publication “Preventing antisocial robots: A pathway to artificial empathy” at Science Robotics

Get the Article

  • PDF
  • Paywalled Article

Preventing Antisocial Robots: A Pathway to Artificial Empathy

PDF

Preventing antisocial robots: A pathway to artificial empathy at Science Robotics

Cite This Work

  • APA
  • MLA
  • Chicago
  • Harvard
  • Vancouver

Christov-Moore, L., Reggente, N., Vaccaro, A., Schoeller, F., Pluimer, B., Douglas, P. K., Iacoboni, M., Man, K., Damasio, A., & Kaplan, J. T. (2023). Preventing antisocial robots: A pathway to artificial empathy. Sci. Robot, 8, eabq3658. https://doi.org/10.1126/scirobotics.abq3658

Christov-Moore, Leonardo, et al. “Preventing Antisocial Robots: A Pathway to Artificial Empathy.” Sci. Robot, vol. 8, eabq3658, 2023, https://doi.org/10.1126/scirobotics.abq3658.

Christov-Moore, Leonardo, Nicco Reggente, Anthony Vaccaro, Felix Schoeller, Brock Pluimer, Pamela K. Douglas, Marco Iacoboni, Kingson Man, Antonio Damasio, and Jonas T. Kaplan. “Preventing Antisocial Robots: A Pathway to Artificial Empathy.” Sci. Robot 8 (2023): eabq3658. https://doi.org/10.1126/scirobotics.abq3658.

Christov-Moore, L., Reggente, N., Vaccaro, A., Schoeller, F., Pluimer, B., Douglas, P. K., Iacoboni, M., Man, K., Damasio, A., & Kaplan, J. T. (2023). Preventing antisocial robots: A pathway to artificial empathy. Sci. Robot, 8, eabq3658. https://doi.org/10.1126/scirobotics.abq3658

Christov-Moore L, Reggente N, Vaccaro A, Schoeller F, Pluimer B, Douglas PK, Iacoboni M, Man K, Damasio A, Kaplan JT. Preventing antisocial robots: A pathway to artificial empathy. Sci. Robot. 2023;8:eabq3658. doi:10.1126/scirobotics.abq3658.

Look, whether you’re a doomer or a techno-utopian, whether you were ready or not, the age of artificial intelligence (AI) probably arrived sometime in this decade. This age brings deep, important, and melancholy reflections on intelligence, creativity, and what it is to be human. However, If we can’t ensure that AI is aligned with human interests, we may have little time to reflect. Containment, or a giant pause button, is not a likely option. There is too much real-world inertia and distrust among world actors to ensure everyone will comply – and it only takes one successful experiment to unleash a truly unforeseen problem into the world. In a new paper in Science Robotics, we tackle this problem through three big ideas, that we’ll call the problem, the path, and the potential.

The Problem

There is a pressing need to imbue AI with a value system that allows it to “understand” harm in way that inherently demotivates it from making catastrophic, irreversible decisions, without the need for complex rule systems. This value system must scale with AI’s rapid self-improvement and adaptations as it encounters novel situations and greater responsibilities for peoples’ well-being. Biology suggests that empathy could provide this value. Empathy allows us to understand and share the feelings of others, motivating us to alleviate suffering and bring happiness.

a sociopathic robot that has explicitly programmed artificial empathy

However, most approaches to artificial empathy focus on allowing AI to decode internal states and act empathetically, neglecting the crucial capacity for shared feeling that drives organisms to care for others. Here lies the problem: Our attempt to create empathic AI may inadvertently result in agents that can read us perfectly and manipulate our feelings, without any genuine interest in our wellbeing, or understanding of our suffering. Our well-meaning attempts to produce empathy may produce superintelligent sociopaths.

The Path Towards Artificial Empathy

If we are giving birth to the next form of life, it’s not far-fetched to see ourselves as collective parents, with a civilizational responsibility. When you’re raising something as potentially powerful as AI, what should you do? The formative years of powerful yet ethical figures like Buddha, Jesus (or Spiderman) teach us that the responsibility of great power is learned by experiencing the suffering that all living beings endure. Power without vulnerability and compassion can easily cause harm, not necessarily through malice, but through obliviousness or an unconstrained drive to fulfill desires.

a robot learns artificial empathy by first learning compassion, especially with regard to alignment to human wants and needs

To address this, we propose a speculative set of guidelines for future research in artificial empathy. Firstly, even if it’s only during a specific phase of their training, AI need to possess a vulnerable body that can experience harm, and learn to exist in an environment where actions have consequences for its physical integrity. Secondly, AI should learn by observing other agents and understanding the relationship between their experiences and the state of their own bodies, similar to how it understands itself. Lastly, AI should learn to interact with other agents in a way that avoids harm to itself and others. Perhaps it will emergently behave in a more ethical fashion if harm to others is processed like harm to itself. Vulnerability is the common ground from which genuine concern and aversion to harm naturally emerge.

The Potential of Artificial Empathy

Achieving true artificial empathy could transform AI from a potential global threat to a world-saving ally. While human empathy is crucial in preventing harm and promoting prosocial behavior, it is inherently biased. We tend to prioritize the suffering of a single relatable person over the plight of a stranger or very large numbers of people. This bias arises due to our brain’s difficulties in handling the large-scale, long-term, and nonlinear problems often encountered in complex societies. The scalable cognitive complexity of an empathic AI might be capable of proposing compassionate solutions to these grand challenges that surpass the human capacity for comprehension and imagination. However, every solution brings new challenges.  How can we trust an intelligence that surpasses our own? What sort of responsibilities will we have for an intelligence that can suffer?

If we are the collective parents to a new superbeing, we must decide, right now, what kind of parents we are going to be, and what kind of relationship we want with our progeny. Do we want to try and control something we fear, or do the work to raise someone we can trust, to care for us in old age?

If we are the collective parents to a new superbeing, we must decide, right now, what kind of parents we are going to be, and what kind of relationship we want with our progeny. Do we want to try and control something we fear, or do the work to raise someone we can trust, to care for us in old age? Let’s be far-fetched for a short moment:  maybe we can guide the development of the upcoming superintelligences toward what Buddhist scholars call “metta,” a cultivation of universal compassion for all beings. Maybe the next Buddha will be artificial.

a depiction of what the eventuality of imbuing AI with artificial empathy could look like: an artificial buddha

We are grateful to the Templeton World Charity Foundation and Tiny Blue Dot Foundation for making this work possible. We also extend our thanks to the Survival and Flourishing Fund for their recent award, which will enable us to implement these ideas in simulations with the assistance of talented researchers such as Adam Safron, Guillaume Dumas, and Zahra Sheikh. You can keep track of our latest developments on our artificial empathy project page.

Read more

The Consciousness Compass

Musings
section-ca3cc10

The Consciousness Compass

Edited by GPT 4. Illustrated by MidJourney. What does this mean? See Afterword below.

 

"What the hell is ‘a common denominator of consciousness’”? you ask me.

We’re in a café in the city on a rainy day. You’ve just opened my new paper on your laptop, recently published in the peer-reviewed Nature Portfolio journal Biology Communications. I crack my neck, pause for a beat, and then ask you a question.

“Would a ‘consciousness compass’ make more sense?”

You shake your head no. What the hell is he talking about, you’re thinking. Okay. I’m ready for that.

“Let’s put these on,” I say, and I pull two virtual reality head-mounted displays along with haptic suits and place them on the table.

“Seriously?” you ask.

“It’s easier to show you,” I say.

We both strap the haptic suits and VR headsets on, and in a flash, we’re suddenly whisked away to … somewhere. The landscape is naked rocks in every direction and the sky is a cloudless blue. It looks sweltering hot, you think, and you’re glad we’re only in VR. Occasionally, a shrub or a small cactus dares to peak out from behind a boulder. Why are we here, peaking out too?

“Joshua Tree?” your avatar asks me. Bingo. It’s a National Park we’ve both visited a dozen times. But off trail, everything starts to look the same. Rocks and boulders in every direction. I pull a compass from my pocket.

“If we want to get back to the campsite, we just need a map and a compass.”

“I know how a compass works,” you say, rolling your eyes.

I pull the simple gadget from my pocket. It renders nicely in VR, wobbling a little bit as I steer it around in my hand. I point in the direction of the compass needle.

“So this way is north, right?”

You cock your eyebrow. “Well, yeah. I don’t need to be a boy scout to know that.” What am I getting at?

“It’s almost north,” I say, “but not quite. Magnetic north isn’t true north. There’s a bias.” I snap my fingers and away we go again.

We’re on the edge of a fjord, glaciers blanketing the land around us, icebergs drifting by. You didn’t bring a jacket, and you’re still glad that you can't feel the temperature in VR.

“We’re in Nunavut, Canada. Can you get us to the north pole?” I ask, handing you the compass.

“I get it,” you say, “I know. Earth’s magnetic pole doesn’t align with the geographic pole. The compass is less useful now because we’re already so close to the location where the two poles diverge.”

https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/04/wherearewe.jpg?resize=891%2C557&ssl=1

“You got it,” I said. “And what’s more,” I add, “the north magnetic pole is constantly drifting by many kilometers each year. It’s worse than just being a little off from the north geographic pole: it’s a moving target. If you use it as an approximation of the north geographic pole, the error isn’t constant: it’s always changing.”

You do a sarcastic slow clap. Even in VR, your avatar is expressive. What does this have to do with the Communications Biology paper?

“Let’s try one more place,” I say, and with a quick nod, we’re back in the desert again. But this time, the desert is different. The soil is much redder and entirely devoid of vegetation. The sky is clear again, but now a surreal pink rather than a serene blue. You look toward the horizon, and it almost looks like the moon is rising … but it’s much too small, and rising much too fast, with a strange potato shape, not a glorious lunar disc.

“We’re on Mars?” you ask.

“Yes, time for Phobos to rise,” I say, referring to the larger of Mars’ two moons. “I would almost say it’s my favorite time of day … but actually, it happens twice a day.”

“What are we doing here?”

I hand you the compass. Your spacesuited avatar takes it and gives it a hard look.

“The needle is taking a while to settle. But if the moon is rising—I mean, if Phobos is rising—then that direction must be east,” you say pointing toward the Phobos-rise.

“Not so fast. Phobos orbits faster than Mars rotates—it rises in the west and sets in the east.”

“Fine, west then. But anyway, why won’t the compass work? It’s still just spinning.”

“There’s the rub,” I say. “There’s no global magnetic field on Mars. Nothing to directly tell us which way is north. Plenty of iron rocks to confuse the needle though.”

“Okay, you got me. What’s your point?”

I take the compass from you and toss it in the Martian dirt. “What we need,” I say, “is a universal compass. A compass that points north under all circumstances, no matter where we are. A compass to guide us just as reliably in Canada as in California, just as reliably on Mars as on Earth.”

You shrug. “I think a normal compass works just fine most of the time. How often are we really going to be exploring the Artic or crawling around on Mars?”

“But that is exactly when we need a compass the most,” I retort. “When we are off exploring, in the unknown. When the world is familiar, we can get our bearings easily. But on the frontiers, there are few things worth more than a reliable compass.”

“Okay, I get it. When we’re in a new place, we can’t rely on familiar landmarks.”

“Yes,” I say, and I know there’s no smile rendering through my opaque spacesuit visor, but you can feel my grin. “And so it is too, with consciousness. When brain dynamics are familiar—the same old familiar activity that neuroscientists and neurologists see each time electrodes are placed on the scalp to record electrical brain activity or EEG—that’s when you hardly need a compass. After all, you know that large, highly synchronized, slowly oscillating brain waves indicate deep sleep or unconsciousness. And you know, equally well, that low amplitude, desynchronized, fast brain waves indicate consciousness, either as wakefulness or dreaming.”

You nod and take off your space helmet. “I’m glad we’re in VR,” you say, looking around with your bare eyes. “Why are we wearing these things anyway? We don’t need oxygen.”

“Are you paying attention?”

“Yeah, just a little distracted. I mean, we’re on freakin’ Mars.”

I snap my fingers, and again, we’re in a beautiful place again, but this time teaming with life and people. We gaze out the window from the fifth floor of an office building in Santa Monica. Palm trees dot the busy street outside. Off in the distance, to the south (yes, the compass works again!) a plane lands at LAX, and further west, you see the U.S. Bank Tower, Wilshire Grand Center, and other jewels in the skyline of downtown LA. Santa Monica Beach is somewhere just around the next city block. Mars, on the other hand, is now over 100 million kilometers away.

“Where am I?” you ask. Behind us, a young man in a plaid shirt steps out of his office. “Who are you?”

“I’m Nicco Reggente, welcome to IACS!” he answers with a smile as he grabs a kombucha from the fridge. You slowly scan the office space and catch a glimpse of me—a year or so younger—coding away on a laptop.

“Institute for Advanced Consciousness Studies,” I clarify. “This is where I wrapped up the project, sitting over there, running surrogate data simulations.”

You look lost, and I realize I’ve gotten ahead of myself.

https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/04/santamonica.jpg?resize=891%2C557&ssl=1

"So, back to consciousness," I continue, "just like with the compass, when we venture into unfamiliar territories, we need a more reliable way to measure consciousness. The familiar landmarks and patterns of brain activity can only take us so far. In cases of severe brain injury, anesthetic drugs, or genetic disorders, we need a 'common denominator of consciousness' to guide us."

You nod, taking in the view of the bustling cityscape. "Alright, I get it now. You're saying that we need a 'consciousness compass' to help us navigate these uncharted territories where EEG brain waves lose their usual meaning. Once the brain is lesioned or challenged by drugs, EEG waves begin to behave strangely and all bets are off.”

"Exactly," I say. "The 'common denominator of consciousness' is a compass that can guide us through the complex landscape of profoundly altered brain activity. In a nutshell, what we want to know is whether a person is still experiencing themselves or the world around them, regardless of whether they have the capacity to respond to tasks or questions.”

You take a seat in a chair, contemplating my idea. "Okay, I think I got the gist of it,” you say with a nod.

I lift my finger and say “Let’s consider some of the traumatic brain injury patients at the UCLA Medical Center”

 “Can we not teleport this time? I just sat down.”

“It’s just a bit down Wilshire actually, but okay, as you wish,” I say with a grin, also taking a seat across from you. “The patients in the intensive care unit at the hospital are often unresponsive, so we can’t simply ask them ‘are you conscious?’. And because of their severe brain injuries, it’s not clear what their EEG oscillations mean. A doctor might see slow waves on a patient’s EEG and assume this means the patient is unconscious But these slow waves could also be the ‘loud scream’ of a focal brain lesion, appearing everywhere in the EEG recording as electrical signals conduct from this focal lesion to distant regions of the skull and scalp!”

"Right,” you say “I get it, looking at slow waves in these patients might be like relying on a magnetic compass to find north on Mars. But you don’t know for sure which patients are conscious, so how can you develop a better compass from their data?”

“Ah, that’s a big problem with some earlier studies,” I say. “Even if we throw machine learning at lots of data, we often lack the ‘ground truth’ which tells us which patients are conscious and which are not. So in my new paper, we don’t look at those patients at all.”

“You don’t?”

“No—instead, we look at children with rare genetic disorders during sleep and wakefulness. We know that these children are conscious when they are awake, just like you and me. And we know that they are probably experiencing nothing during the ‘non-REM’ stage of sleep, where vivid dreams are unlikely. That’s our ground truth. But, a bit like other neurological patients, these children have unusual EEG patterns. In one disorder, called Angelman syndrome, the children show slow EEG activity resembling sleep during wakefulness. And in another disorder, called Dup15q syndrome, the children show fast EEG activity, almost resembling wakefulness, during non-REM sleep.”

I see the lightbulb flash in your eyes, and finally, this long trek through VR feels worth it. “So whatever EEG patterns reliably indicate consciousness in these children, despite their abnormal EEGs, those patterns are the common denominator of consciousness we might want to use as our compass!”

“You got it! And lastly, we also look at healthy, typically developing children to make sure that those patterns generalize to them, also indicating consciousness in normal EEGs.”

"All right, so what did you find?" you ask, genuinely intrigued now.

"We found that a particular family of measures, called entropy, were the most reliable indicators of consciousness in both the children with genetic disorders and typically developing children," I explain.

“Entropy … isn’t that something from physics?”

“Right, physicists like to talk about entropy as the number of possible ways to arrange a system or signal, kind of like ‘disorder’. In EEG, entropy measures show us how complex the signals are. It’s low when the signal is highly regular and predictable, and it’s high when the signal is irregular and unpredictable. Overall, entropy appears to be much more reliable in identifying conscious brain activity than traditional EEG measures based on amplitude and frequency.”

You lean back, processing the information. "So, in a way, you've discovered a 'compass' that points to consciousness, regardless of the brain's individual quirks or injuries. It's like a universal compass that works on Earth and Mars, even when the magnetic poles are shifted or absent."

"Exactly," I say with a smile. "This 'common denominator of consciousness' could help doctors and researchers identify consciousness in unresponsive patients, even when it’s masked by unusual EEG patterns. It's a step toward better understanding and treating severely brain-injured patients, like those in the intensive care unit at UCLA, and making sure that we don’t misdiagnose someone with a ‘vegetative state’ just because they can’t respond to our questions. Ultimately, it might also reveal something about the mechanisms of subjective experience, as many neuroscientists think that neural complexity is foundational to consciousness itself.”

The sun begins to set outside the window, casting a warm glow across the room. You take a deep breath and look back at me. "Well, it looks like I've got some reading to do. This paper of yours just got a lot more interesting."

With that, we remove our VR headsets and haptic suits, returning to the familiar surroundings of the café. But as my eyes focus again, I see the café manager walking toward us, looking none too happy.

“Excuse me," he says sternly, "this is a café, not a VR gaming center. You’ve knocked over enough glasses and chairs. Please pack up your equipment and take your drinks."

Embarrassed, we quickly apologize and start to gather our things. As we sip our now lukewarm coffees, you glance over at me, a mirthful smile playing at the corner of your lips.

And so, we continue our search for the common denominators of consciousness and life, one spilled coffee at a time.

https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/04/spilledcoffee.jpg?resize=891%2C557&ssl=1
section-1ea6e20

Afterword: Using generative AI as a copilot

Generative artificial intelligence (AI) assisted with the production of this blog post, from GPT 4 suggesting what should come next in the story, to Midjourney version 5 generating custom illustrations to accompany the text. The past several months have seen enormous advances in AI and, as of this writing, the future role of generative AI as a “copilot” in activities ranging from writing to coding remains uncertain. Five years from now, transparency statements such as this one may be completely unnecessary, just as you feel no obligation to disclose having used the spell checker in your word processor. Or, perhaps society will shun generative AI tools for spoiling creative work and taking fulfilling jobs away from humans. Either possibility feels plausible at this point. We are truly in terra incognita.

So, how exactly did generative AI assist with the production of this blog post? Midjourney’s role is obvious—I have no artistic talent in visual art, and so AI art programs like Midjourney are really the only option for me to illustrate a casual blogpost with no budget. But the player you’re probably really wondering about is GPT 4—what role did this quasi-AGI play in my blog post?

For the first half of my writing, the answer was, none whatsoever. I began writing this idiosyncratic present tense short story to explain my recent Communications Biology publication one morning in February this year when inspiration struck. Then, as tends to happen, I got busy with other things and didn’t revisit my story until two months later.

When I returned to the story in April, the characters had just teleported in VR to Santa Monica. I knew what I wanted to have happen, but writer’s block wouldn’t let me put it down in words. So, I pasted what I had written thus far into ChatGPT and let the GPT 4 model continue my story. Here’s what it suggested:

"So, back to consciousness," I continue, "just like with the compass, when we venture into unfamiliar territories, we need a more reliable way to measure and understand consciousness. The familiar landmarks and patterns of brain activity can only take us so far. With new technologies, artificial intelligence, and novel states of consciousness, we need a 'common denominator of consciousness' to guide us."

You nod, taking in the view of the bustling cityscape. "Alright, I get it now. You're saying that we need a 'consciousness compass' to help us navigate these uncharted territories in neuroscience and beyond."

The GPT 4 story then continues for several more paragraphs, but the dialogue gets increasingly vague, misdirected, and shallow. Still, I like the transition, so I used the first two sentences from GPT 4’s suggestion. And buried a few paragraphs down, there’s a gem that I decide to also use later in my story.

The sun begins to set outside the window, casting a warm glow across the room. You take a deep breath and look back at me. "Well, it looks like I've got some reading to do. This paper of yours just got a lot more interesting."

But after my character finishes explaining the methods of the paper to “you”, I called upon GPT 4’s help again. This time, the dialogue was much more on the mark from a technical perspective.

"Alright, so what did you find?" you ask, genuinely intrigued now.

"We found that a particular measure, called the Lempel-Ziv complexity, was the most reliable indicator of consciousness in both the children with genetic disorders and typically developing children," I explain. "This measure quantifies the complexity of the EEG signal, and it appears to be much more reliable in identifying conscious brain activity than traditional EEG measures like amplitude and frequency."

Wow, I really did use Lempel-Ziv complexity (among other entropy measures) in my paper! And since I hadn’t mentioned Lempel-Ziv yet in the story, this appears to be GPT 4 drawing on its knowledge of the scientific literature to do just what it was designed to do: predict what words should come next in a text (yes, everything else you might use ChatGPT for, like debugging code or tutoring you in a foreign language, is just a side effect). I felt that Lempel-Ziv was a bit too technical for this post—there wasn’t any need to introduce jargon or specific algorithms for estimating entropy—but I nonetheless tweaked some of GPT 4’s dialogue, revising it to fit my vision of the story, and incorporated it into the blog post.

I then called on GPT 4 for help one last time at the conclusion of the story, when the characters reenter the real world. Again, I knew what I wanted to have happen: the characters have wreaked havoc on the café and are duly expelled. After a bit of back and forth with GPT 4, I got the prose that I was looking for, including the last line of the story. I asked GPT 4 to “Make the final line thought provoking and provocative.” The baby AGI gave me five different options, but I took the first one, with just some slight tweaking.

And so, we continue our search for the common denominators of life, one spilled coffee at a time.

So, what is the future role of GPT 4 and large language models in creative writing? Will these generative AIs serve as our virtual editors, suggesting new directions for a story and penning a few of our best lines? Or will we eventually see these tools as the artistic equivalent of performance enhancing drugs—the writer’s version of doping?

Alas, this is one question that GPT 4 cannot answer.

section-a8ead51
Read more
picture of someone who has depression getting chills and then opening up some hope

Chills Foster Emotional Breakthrough In Depression

E4001, Proceedings
section-3d0adaa

Get the Article

Aesthetic chills foster self-acceptance and emotional breakthrough in depression

Open Source Article

Cite This Work

Schoeller, Felix, et al. “Aesthetic Chills Foster Self-Acceptance and Emotional Breakthrough in Depression.” 2022, https://doi.org/10.31234/osf.io/rhftq.

Schoeller, F., Jain, A., Adrien, V., & Maes, P. (2022). Aesthetic chills foster self-acceptance and emotional breakthrough in depression. https://doi.org/10.31234/osf.io/rhftq

Schoeller, Felix, Abhinandan Jain, Vladimir Adrien, and Pattie Maes. “Aesthetic Chills Foster Self-Acceptance and Emotional Breakthrough in Depression,” 2022. https://doi.org/10.31234/osf.io/rhftq.

Schoeller F, Jain A, Adrien V, Maes P. Aesthetic chills foster self-acceptance and emotional breakthrough in depression. 2022 Dec 21;https://www.frontiersin.org/articles/10.3389/fnins.2022.1013117/full

 

Schoeller, F., Jain, A., Adrien, V. and Maes, P. (2022). Aesthetic chills foster self-acceptance and emotional breakthrough in depression. doi:https://doi.org/10.31234/osf.io/rhftq.

section-81c6e39

Chills Foster Emotional Breakthrough In Depression

Chills are a common emotional response to stimuli, whether it's from listening to your favorite music or engaging with deeply moving films. But did you know that this bodily response may hold potential for therapeutic intervention for individuals diagnosed with depression?

A recent exploratory study examined the effects of chills stimulation on subjects clinically diagnosed with depression. The study found that chill-inducing stimuli may have the potential to affect the core schema of depressed patients, specifically in terms of shame and self-acceptance. The results suggest that the mechanism of action during the chills response may resemble the form of problem resolution induced by the psychedelic and psychotherapeutic experience, leading to similar positive outcomes for the subject.

This study sheds light on the potential therapeutic value of aesthetic chills for reward-related or dopaminergic illnesses. Further research is needed to fully understand the effects of chills on mental health and to determine the feasibility and safety of using aesthetic chills as a therapeutic intervention.

It's exciting to think about the potential of aesthetic chills as a novel form of body-based experience to draw people out of anhedonia and depression and help them find meaning in life again. As research in this field progresses, we may see more developments in the use of chills stimulation as a therapeutic intervention for mental health.

section-0cc0b79
Abstract

Aesthetic chills, a strong emotional reaction characterized by a specific bodily response of thermoregulatory mechanisms such as shivers and goosebumps, may hold scientific and clinical potential for reward-related or dopaminergic illnesses. In this first exploratory study, we examined the effects of chills stimulation on subjects clinically diagnosed with depression. Our results suggest that chill-inducing stimuli may have the potential to affect the core schema of depressed patients, specifically in terms of shame and self-acceptance. These results suggest that the mechanism of action during the chills response may resemble the form of problem resolution induced by the psychedelic and psychotherapeutic experience, leading to similar positive outcomes for the subject. Further research is needed to fully understand the effects of chills on mental health and to determine the feasibility and safety of using aesthetic chills as a therapeutic intervention.

a graph showing how chills can have an impact on emotional breakthrough, which has huge implications for depression
Read more

IACS Research Featured in Vice

Press
section-c8475b1

Exciting news!

Our research has been featured in Vice magazine's motherboard section. Hannah Docter-Loeb from Motherboard wrote a short piece about our research on chills stimuli with MIT Media Lab and the Gonda Brain Research Centre.

Cite This Work

Vice. (2023, March 24). [web log]. Retrieved from https://www.vice.com/en/article/pkaywn/heres-a-database-of-media-scientifically-verified-to-give-you-the-chills.

Here's a Database of Media Scientifically Verified to Give You the Chills, Vice, 24 Mar. 2023, https://www.vice.com/en/article/pkaywn/heres-a-database-of-media-scientifically-verified-to-give-you-the-chills.

Web log. Here's a Database of Media Scientifically Verified to Give You the Chills (blog). Vice, March 24, 2023. https://www.vice.com/en/article/pkaywn/heres-a-database-of-media-scientifically-verified-to-give-you-the-chills.

Docter-Loeb, H. (2023) Here's a Database of Media Scientifically Verified to Give You the Chills. Vice, 24 March. Available at: https://www.vice.com/en/article/pkaywn/heres-a-database-of-media-scientifically-verified-to-give-you-the-chills.

Here’s a Database of Media Scientifically Verified to Give You the Chills [Internet]. www.vice.com. [cited 2023 Apr 12]. Available from: https://www.vice.com/en/article/pkaywn/heres-a-database-of-media-scientifically-verified-to-give-you-the-chills

 

Text Body

IACS Research Featured in Vice

The article explores the fascinating world of chills and the emotional response they elicit in individuals.

In an effort lead by Dr. Felix Schoeller at IACS, and in collaboration with the MIT Media Lab, and the Gonda Multidisciplinary Brain Research Centre, researchers have created a database of stimuli that have the potential to induce chills. The stimuli include music, film, and speech, and were compiled from social media platforms such as YouTube and Reddit.

We chose the top 50 videos from the database and randomly introduced them to over 600 participants on a crowdsourcing platform. The results showed that participants who experienced chills reported significantly more positive emotional valence and greater arousal during the experience, compared to those who did not experience chills.

We believe that understanding the emotional consequences of chills can help guide mental health interventions. They are exploring the option of using chills as a novel intervention for depression, and are even developing a device to artificially elicit the emotion and multiply its effects.

This is an exciting development in the field of mental health and could potentially offer a new avenue for treatment for individuals suffering from depression and other mood disorders. We are thrilled to be a part of this groundbreaking research and look forward to seeing what the future holds.

 

Read more

Why Do We Experience Chills?

Musings
section-7ed12c6
Read the Article

Psychogenic Shivers: why we get the chills when we aren't cold 

Article

 

Cite This Work

Schoeller, F. (2021, April 8). Psychogenic shivers: Why we get the chills when we aren't cold: Aeon ideas. Psychogenic shivers: why we get the chills when we aren’t cold. Retrieved from https://aeon.co/ideas/psychogenic-shivers-why-we-get-the-chills-when-we-arent-cold

Schoeller, Felix. “Psychogenic Shivers: Why We Get the Chills When We Aren't Cold: Aeon Ideas.” Psychogenic Shivers: Why We Get the Chills When We Aren’t Cold, Aeon Magazine, 8 Apr. 2021, https://aeon.co/ideas/psychogenic-shivers-why-we-get-the-chills-when-we-arent-cold.

Schoeller, Felix. “Psychogenic Shivers: Why We Get the Chills When We Aren't Cold: Aeon Ideas.” Psychogenic shivers: why we get the chills when we aren’t cold. Aeon Magazine, April 8, 2021. https://aeon.co/ideas/psychogenic-shivers-why-we-get-the-chills-when-we-arent-cold.

Schoeller, F. (2018) Psychogenic shivers: why we get the chills when we aren’t cold. Aeon, 4 June. Available at: https://aeon.co/ideas/psychogenic-shivers-why-we-get-the-chills-when-we-arent-cold.

Schoeller F. Psychogenic shivers: why we get the chills when we aren’t cold [Internet]. Dresser S, editor. 2018. Available from: https://aeon.co/ideas/psychogenic-shivers-why-we-get-the-chills-when-we-arent-cold

 

Text Body

Why We Experience Chills?

A few years ago, I proposed that the feeling of cold in one’s spine, while for example watching a film or listening to music, corresponds to an event when our vital need for cognition is satisfied. Similarly, I have shown that chills are not solely related to music or film but also to the practice of science (mainly physics and mathematics) and to the social logic of religious rituals. I believe that chills and aesthetic emotions in general can teach us something that we do not know yet. They can help us to understand what truly matters to the mind and to the society of minds.

When cold or sick, humans shiver. Shivering is a muscle tremor that produces heat which allows the body to maintain its core temperature in a changing world. Human core temperature can vary temporarily between about 28 to 42 degrees Celsius. Outside these thresholds, death occurs. Humans also shiver in the case of a fever, as heat slows down the rate of pathogen growth and improves the immune response of a living body. Goosebumps or piloerection (the bristling of hairs) can be side effects, as the muscle tremor causes hair to become erect which creates a thin layer of air, thus minimizing heat loss. Strangely enough, humans also shiver independently of any such events. For instance, certain social situations seem to provoke shivers.

Humans are particularly prone to shiver when a group does or thinks the same thing at the same time. When a crowd is sharing a common goal. When they listen to a national anthem or witness self-sacrifice. When they die for their ideas. When collective thought becomes more important than individual life. But humans also shiver from situations that are not social in nature. Some shiver when they manage to find a solution to certain mathematical problems for example, and so shivering cannot be reduced to a social mechanism.

Now, why does a psychological event trigger a physiological response related to the regulation of temperature? At a fundamental level, cognition requires change. If you stabilize a retina using adequate instruments, the organ ceases to transmit signals to the primary visual cortex, and one gradually becomes blind. From the standpoint of the sense organ, the same object never appears similar to itself twice. Two chairs are never exactly the same. In other words, one is constantly discovering a visual field. Everything you feel, you feel for the first time. Perception is really exploration and, if we can perceive anything at all, it is because we are constantly matching incoming sensory signals to available mental models. You rarely fail to recognize objects in your surroundings. The world is always already meaningful, and it is sometimes beautiful.

The process by which a mind adapts to its world is so effective that people constantly mistake one for the other. When a large part of thought matches a large part of the world, one might consciously feel what we call aesthetic emotions. Historically, aesthetics is the science of how perception meets cognition, the science of how you know what you see. The majority of aesthetic emotions are unconscious. They occur every time you see something. When you see something important enough, you might experience these emotions consciously. This happens through bodily changes such as tears, heartbeat increase, sweat – or shivers. The strange thing with shivering is that humans seem to shiver both when they are perfectly capable of predicting the behavior of external objects in real-time when it all fits together so well, and, surprisingly, when nothing at all can be predicted, when the situation goes out of control.

I propose that psychogenic shivers correspond to an event where the measure of the total similarity between all sensory signals and available mental models reaches a local peak value.

I propose that psychogenic shivers correspond to an event where the measure of the total similarity between all sensory signals and available mental models reaches a local peak value. This can be expressed mathematically in terms of the rate of change of a function of conditional similarity. In this context, any change in learning corresponds to an aesthetic emotion. When the function reaches a local maximum, its derivative tends toward zero, and learning slows down. This corresponds to a ‘turning’ point in your total knowledge. Ten years ago, Perlovsky predicted that such an event should involve knowledge about other minds and about the meaning of life.

We know that psychogenic shivers can be inhibited by an excitant, the opioid-antagonist naloxone. Naloxone is what you would inject in a clinical setting to a patient who is victim of an overdose; it is the antagonist of morphine. It does not come as a surprise that most of my subjects state that they relax after they experience an aesthetic shiver. Besides a clear analogy with the sexual drive, what does this tell us about the exploratory drive?

I argue that stories that provoke the shivers might bring about this relief of tension by allowing humans to overcome conflicts among fundamental parts of the mind. Such stories might help us to deal with internal contradictions, where both elements are equally resistant to change. Leon Festinger, who in 1957 invented the theory of cognitive dissonance, named this a dissonance of maximum amplitude. The mind creates stories to overcome its own contradictions. Anthropologists call this a myth, and we know from a wealth of work in anthropology that rituals are likely to provoke shivers down the spine.

We give two examples for such fundamental conflicts; one is biological and the other cultural. The biological conflict derives from the fact that, while we survive as a species by sharing goals, we might never access the goal of other minds directly. We thus shiver in cases of seemingly total communication – theoretical synchrony. Another example derives from the fundamental discordance between the altruistic nature of the human animal on the one hand, and the logic of the currently dominant social system on the other. These hypotheses would explain why you might shiver in the course of a film when empathy becomes a necessary condition to reduce narrative tension to its minimum. When the bad guy ends up saving the good guy.

There are three plausible explanations for the fundamental relation between cognition and temperature. One is physiological, the other is physical, and the third is biological. The physiological explanation simply consists of describing psychogenic shivers as a case of fever. The relation between emotion and temperature is in fact very ancient, and even reptiles display evidence of stress-induced hyperthermia.

The physical explanation relates the dissipation of heat at the shiver to the processing of information in the brain. In 1961 the physicist Rolf Landauer at IBM proposed the principle that any erasure of information should be accompanied by the dissipation of heat. This was verified experimentally a few years ago in Lyon. If this hypothesis is not entirely false, then we should eventually be able to predict the amount of heat produced, given accurate knowledge of the information process. Until then, I do not see any good reason to quantify the shiver.

Finally, the biological explanation relates the origins of human thought to the tremendous changes in temperature at its birth. It might be that we can observe this relation between the mechanisms that regulate cognition and the mechanisms that regulate temperature because of the particular context in which thought saw the light of day. In other words, a shiver might have very well accompanied the first human idea. Since then, every time we grasp something important, perhaps we repeat the gesture.

Read more

Cognitive Science Below the Neck: Toward an Integrative Account of Consciousness in the Body

E4001, Proceedings, Review
section-5e5e245
Get the Article

Cognitive Science Below the Neck: Toward an Integrative Account of Consciousness in the Body

PDF

Cognitive Science Below the Neck: Toward an Integrative Account of Consciousness in the Body

Article

Cite This Work

Christov‐Moore, L., Jinich‐Diamant, A., Safron, A., Lynch, C., & Reggente, N. (2023). Cognitive science below the neck: Toward an integrative account of consciousness in the body. Cognitive Science, 47(3). https://doi.org/10.1111/cogs.13264

Christov‐Moore, Leonardo, et al. “Cognitive Science below the Neck: Toward an Integrative Account of Consciousness in the Body.” Cognitive Science, vol. 47, no. 3, 2023, https://doi.org/10.1111/cogs.13264.

Christov‐Moore, Leonardo, Alex Jinich‐Diamant, Adam Safron, Caitlin Lynch, and Nicco Reggente. “Cognitive Science below the Neck: Toward an Integrative Account of Consciousness in the Body.” Cognitive Science 47, no. 3 (2023). https://doi.org/10.1111/cogs.13264.

Christov‐Moore, L. et al. (2023) “Cognitive science below the neck: Toward an integrative account of consciousness in the body,” Cognitive Science, 47(3). Available at: https://doi.org/10.1111/cogs.13264.

Christov‐Moore L, Jinich‐Diamant A, Safron A, Lynch C, Reggente N. Cognitive Science Below the Neck: Toward an Integrative Account of Consciousness in the Body. Cognitive Science. 2023 Mar;47(3).

 

Text Body

Cognitive Science Below the Neck: Toward an Integrative Account of Consciousness in the Body

Despite historic and recent evidence that our beliefs can have drastic effects on bodily function, we seem to lack a model of how this might work. We believe this is due in large part to a failure to consider that computational processes we attribute to cognition may be occurring below the neck, and to a lack of a language by which we could describe beliefs as something that can be instantiated within the body.

In a recent paper, we proposed that we expand the scope of cognitive science to include the body and develop a formal language to describe the relationship between cognitive and bodily systems. To do so, we propose to integrate the best parts of three contemporary accounts that deal with mind and body.

Firstly, parametrically deep allostasis (PDA), a two-level Bayesian inference model, can help us understand how affective valence (the positivity or negativity of a feeling) arises from our bodily experiences. At the surface level, the model uses sensory information to anticipate our homeostatic needs. At the deep level, it continuously tracks the fitness of the surface-level models, indexing fitness as affective valence. This model frames the role of our slow, deep feelings in statistical language that can allow us to possibly speak of beliefs in terms of signaling and computation in interoceptive systems.

Secondly, embodied predictive interoception coding (EPIC) provides a biologically plausible implementation of PDA. EPIC describes a predictive system in the central nervous system that takes inputs from the body via the interoceptive nervous system. It senses precision-weighted ascending homeostatic/metabolic and exteroceptive signals in highly laminated sensory "rich club" hubs and issues allostatic predictions that drive descending allostatic control signals. 

Finally, Carvalho and Damasio's functional/anatomical account of the interoceptive nervous system (INS) provides a crucial, holistic field of view that permits for unique forms of computation in systems below the neck. They frame the spatiotemporally diffuse properties of interoception and affect (described in PDA) as products of INS physiology, with a neurobiological framing that “matches up” well with the cortical field of view of the EPIC model.

 

https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/04/ChristovMoore_beliefs_descending_from_the_brain_and_being_refle_d62ebb55-61aa-46d1-ac3d-b2bf50c6e758-1.jpg?resize=770%2C800&ssl=1

 

Combined, these complementary accounts can expand the scope of cognitive science below the neck, using a formal language that allows us to speak of beliefs in terms of signaling that can be studied within CNS/INS interactions. Beliefs can be enacted in bodily function and influence declarative awareness, while “beliefs” in bodily signaling can emerge to impact conscious thought. This approach can deepen our understanding of belief, ritual, and set/setting in research and clinical outcomes, with potential implications for treating psychopathology and effecting therapeutic change. Novel methodological developments will be needed to trace signaling in the transition from CNS to INS as beliefs translate into bodily change, and vice versa. A field of view that encompasses cortical and interoceptive anatomy and computational processes, along with a formal language for belief transmission and enactment, can transform mind-body mysteries into novel science and therapy.

Read more
A diagram showing how ultrasound for neuromodulation works

Current State of Potential Mechanisms Supporting Low-Intensity Focused Ultrasound for Neuromodulation

Proceedings, Protocol-003, Review
section-b504c00

Published in Frontiers in Human Neuroscience in 2022, this review intended to answer how ultrasound for neuromodulation works

Our review titled, Current state of potential mechanisms supporting low intensity focused ultrasound for neuromodulation, attempts to address the following questions: 1) How can we alter the amount of mechanical energy or other properties of the mechanical energy using the sonication parameters available with each device, 2) How are neuronal tissue affected by mechanical energy, and 3) How do those sonication parameters change the type of neuromodulation (i.e., excitatory or suppressive)? We reviewed the theoretical mechanisms of action for neuromodulation and the empirical findings tracking all the sonication parameters used to elucidate the possible link between the proposed mechanisms of action and the choice of sonication parameters. This is still an emerging field, but a tabulation of the empirical findings and theoretical models is needed to help clinicians and researchers choose the best paradigm to use.

Get the Article

Frontiers in Human Neuroscience: Brain Imaging and Stimulation Open Source Article

Current State of Potential Mechanisms Supporting Low-Intensity Focused Ultrasound for Neuromodulation PDF

Cite This Work

DellItalia, John, et al. “Current state of potential mechanisms supporting low intensity focused ultrasound for neuromodulation.” Frontiers in Human Neuroscience: 228.

DellItalia, J., Sanguinetti, J. L., Monti, M. M., Bystritsky, A., & Reggente, N. Current state of potential mechanisms supporting low intensity focused ultrasound for neuromodulation. Frontiers in Human Neuroscience, 228.

DellItalia, John, Joseph L. Sanguinetti, Martin M. Monti, Alexander Bystritsky, and Nicco Reggente. “Current state of potential mechanisms supporting low intensity focused ultrasound for neuromodulation.” Frontiers in Human Neuroscience: 228

DellItalia, J., Sanguinetti, J.L., Monti, M.M., Bystritsky, A. and Reggente, N., Current state of potential mechanisms supporting low intensity focused ultrasound for neuromodulation. Frontiers in Human Neuroscience, p.228.

DellItalia J, Sanguinetti JL, Monti MM, Bystritsky A, Reggente N. Current state of potential mechanisms supporting low intensity focused ultrasound for neuromodulation. Frontiers in Human Neuroscience.:228.

Science Without Jargon

Science should be accessible to everyone. However, dense jargon-filled articles can make it difficult for non-experts to engage with research. Making science accessible promotes scientific literacy and informed decision-making. In this post, we summarize our recent article for a lay audience.

 

section-f4af37f

How ultrasound for neuromodulation works

Non-invasive brain stimulation has been used to modulate the activity of neural tissue without the need for surgical procedures to implant devices or permanently alter the neural tissue. Non-invasive brain stimulation has been used for neuromodulation across empirical research and clinical practices using transcranial electrical stimulation and transcranial magnetic stimulation. These types of neural modulation use electric (i.e., transcranial electrical stimulation) or magnetic (i.e., transcranial magnetic stimulation) fields applied outside the skull to induce changes in the electrochemical activity underneath the device within and around neurons. These fields tend to affect larger areas and affect all the neural tissue that the fields pass through. Thus, this limits which brain regions can be targeted precisely or individually.

An alternative to the putative non-invasive brain stimulation is devices using ultrasound. Ultrasound has been used for decades by clinicians to image various parts of the body, but recently ultrasound devices have begun to be used for neuromodulation. Ultrasound doesn’t use electric or magnetic fields, rather it generates acoustic waves that are a mechanical force. This mechanical force can be focused on a precise area with only the maximal mechanical energy converging on millimeter-sized region. This allows for deeper and/or smaller brain regions to be targeted compared to transcranial electrical stimulation and transcranial magnetic stimulation. However, the different energy source compared to electric or magnetic fields requires a different understanding of how neuromodulation occurs. Without this understanding, effective uses of ultrasound in empirical research and clinical practices will be limited.

Ultrasound’s acoustic waves have the characteristic properties of wavelength, amplitude, and frequency. Wavelength is the distance between two peaks within the wave, the amplitude is the height of the wave, and frequency is the number of peaks in a second. Each of these properties affects the total amount of mechanical energy delivered by the ultrasound device and other sonication parameters. The total energy can be measured by either the average amount in a spatial region or the average amount delivered over time typically converted into the units of watts per centimeter squared. In addition to the intensity, the total energy delivered over time is affected by the duty cycle, which is the percentage of time the sonication occurs. The duty cycle also determines if a paradigm is pulsed or continuous. Pulsed paradigms are any duty cycle below 100 percent, which allows for breaks between the sonication, compared to a continuous application of ultrasound. The frequency of the ultrasound’s acoustic waves is related to the sonication parameters of center frequency and pulse repetition frequency. The center frequency is set by the device manufacturer, which is the frequency delivered by the device and this frequency is related to the spatial precision of the acoustic wave delivered. The pulse repetition frequency is the frequency of the acoustic wave delivered by the pulsed paradigm. The final commonly adjusted sonication parameter is sonication duration (i.e., total time of acoustic wave delivered).

The mechanical energy delivered by the ultrasound device has seven proposed mechanisms to affect the activity of groups of neurons. Neurons are connected and each neuron’s activity either helps to excite other neurons connected to it or suppresses the activity of the neurons connected to it. These signals involve both electrical and chemical signaling. Since ultrasound is mechanical, the mechanisms of action proposed describes: 1) effects of mechanical energy on the temperature., 2) how the neurons detect and transform that mechanical energy to electrical or chemical signaling (i.e., mechanosensitive ion channels), or 3) how mechanical energy interacts with the elasticity of neurons to change the electrical properties or structure of neurons (e.g., direct flexoelectricity, change of membrane conformational states, or sonoporation).

Ultrasound has been used for decades to destroy malignant tissue by using enough intensity to generate larger changes in temperature. These large changes in temperature are not seen in the intensity ranges used in non-invasive brain stimulation. Despite the lower intensity used, there is still a mechanical force acting on the neurons. Some neurons have specific mechanisms for detecting external mechanical forces. These are most well understood in our tactile sensations. When our hand presses against a surface, specialized neurons detect the mechanical force by getting stretched which allows for chemical and electrical signaling to occur. The amount and distribution of neurons with similar properties in the brain is an active area of research. In addition to these specialized neurons, the mechanical energy from ultrasound can change the electrical properties of neurons by distorting the shape. The specific configuration of the membrane allows for electrical signals (i.e., direct flexoelectricity) to be produced as the mechanical energy changes the alignment of the interior and exterior parts of the membrane. On top of these alignment changes, there are pressure changes which can also generate both chemical and electrical changes from the changes in membrane conformational states.

Additionally, the neuron’s membranes can have changes to their permeability called sonoporation allowing for electrical changes that can elicit the neuron to fire. This process was investigated how the ultrasound’s pulse repetition frequency, intensity, or duty cycle could produce excitatory or suppressive effects. The key sonication parameter that best predicted differences in neuronal activity was duty cycle. Higher duty cycles between 10% to 70%, typically excited neurons, while lower duty below 10% created suppressive effects. Unfortunately, this one parameter did not predict the suppressive findings well, but the excitatory findings were almost all exclusively found between 10% to 70% duty cycle.

While duty cycle was predictive of some results found in the literature, it left most of the results unexplained. More models and theories are needed to expand the understanding of the mechanisms of action. Hopefully, this review gives a basic knowledge base to clinicians and researchers to use in their treatments or experiments. As the understanding of the mechanisms of action expand, more nuanced treatments and experiments can be used.

section-b291281

Figures & Captions

Feel free to use these figures in your articles, blogs, and presentations. If you do, please cite this work.

Figure 1.

Low intensity focused ultrasound general principles. (A) A depiction of a typical LIFU experimental setup. A participant is seated (2) with an US device (5) firmly pressed against their head held in place by an arm (3). The US device is controlled by a computer system (4) and targeted using infrared system (1). (B) Depiction of the mechanical wave properties (amplitude, wavelength, and frequency) used in US stimulation. (C) Spatial intensities of the mechanical wave. (D) Temporal intensities of the mechanical wave. (E) Two exemplary pulsation schemes: pulsed (in yellow) and continuous (in teal). Both the pulsing schemes have a customizable sonication duration with inter stimulation interval with the DC parameter (i.e., the ratio of tone burst duration over pulse repetition period) determining the pulsing scheme.

https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/03/Current-State-of-Potential-Mechanisms-Supporting-Low-Intensity-Focused-Ultrasound-for-Neuromodulation-Figure-1.jpg?resize=500%2C700&ssl=1
section-9414ff9
https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/03/Current-State-of-Potential-Mechanisms-Supporting-Low-Intensity-Focused-Ultrasound-for-Neuromodulation-Figure-2.jpg?resize=550%2C700&ssl=1

Figure 2.

Proposed ultrasonic stimulation’s mechanisms for neuromodulation. Depicted in column 1 are six neuronal membranes (four with an ion channel [rows A,C,D,E] and two neuronal membranes [rows B,F] with polar lipid bilayer) and a neuron with the microtubules highlighted (row G). Depicted in column 2, these membranes have four types of electrophysiological-mechanical coupling during an action potential: change in membrane conformation state, thermodynamic waves, direct flexoelectricity, and opening of mechanosensitive ion channels (see Section above). Column 3 depicts these same four electrophysiological-mechanical coupling during US stimulation along with three other possible mechanisms of US’s neuromodulation: thermal modulation, sonoporation and cavitation, and microtubule resonance (see Section above).

section-c606dc9

Figure 3.

Neuronal intramembrane cavitation excitation model. Plaksin et al. (20142016) proposed the NICE model hypothesizing sonoporation (see Figure 2F) as US’s mechanism of neuromodulation. The US’s DC (see Figure 1E) determines the polarity of neuromodulation. A low DC (i.e., below 5%) during a stimulation’s off-periods will preferentially activate thalamic reticular neurons (TRN), thalamocortical neurons (TCN), and low-threshold spiking (LTS) interneurons via T-type voltage-gated calcium channels (see Section above for full description) producing an inhibitory effect. A high DC (i.e., over 20%) during the on-periods will preferentially activate regular spiking (RS) pyramidal cells and fast spiking (FS) interneurons while suppressing the LTS interneurons producing an overall excitatory effect. This excitatory effect is simulated using a basic network model of LTS, FS, and RS neurons connected with excitatory and inhibitory synapses and thalamic inputs. The network model predicts an optimum excitation of 70% DC.

https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/03/Current-State-of-Potential-Mechanisms-Supporting-Low-Intensity-Focused-Ultrasound-for-Neuromodulation-Figure-3.jpg?resize=550%2C650&ssl=1
section-cce1099
https://i0.wp.com/advancedconsciousness.org/wp-content/uploads/2023/03/Current-State-of-Potential-Mechanisms-Supporting-Low-Intensity-Focused-Ultrasound-for-Neuromodulation-Figure-4.jpg?resize=500%2C800&ssl=1

Figure 4.

Excitatory and suppressive empirical findings’ relationships to DC, PRF, ISPPA, fc, and SD. DC, PRF, ISPPA, fc, and SD are used as grouping factors for excitatory and suppressive findings. We used density plots for each study, but studies with multiple sonication parameters have each one plotted. In the top panel, high DC, above 10%, has the vast majority of the excitatory findings. While ow DC, less than 10%, contains the majority of the suppressive findings, there are still approximately 30% of the suppressive findings above 10% DC. The top panel is highlighted in red because DC is the one sonication parameter that has any distinction between excitatory and suppressive findings. In the four bottom panels, PRF, ISPPA, fc, and SD has no clear distinction between excitatory and suppressive findings.

Read more
neuroaesthetics

Frontiers Research Collection: Possible Applications of Neuroaesthetics To Normal and Pathological Behaviour

E4001, Review

 

Dr. Felix Schoeller is now a Topic Editor for the Frontiers Research Collection under the topic: Possible Applications of Neuroaesthetics To Normal and Pathological Behaviour

 

 

See The Research Collection
Text Body

Frontiers Research Collection: Possible Applications of Neuroaesthetics To Normal and Pathological Behaviour

The aim of this Research Topic is to clarify the role of aesthetic experiences in driving cognitive-emotional change in everyday life at an individual, interpersonal and group level. We are specifically interested in empirical studies of aesthetic emotions in relation to learning and psychopathology. Modern aesthetics — i.e., the science of what is sensed — was originally intended as an alternative to the philosophy of knowledge; in Baumgarten’s words: “the science of sensory knowledge directed toward beauty” (Baumgarten, 1750). In the past few decades, there has been a renewed interest in this relation between aesthetic emotion and knowledge acquisition. Recent evidence suggests that the perception of beauty may subtend the learning process -i.e., the update of perceptual, affective and relational expectations and behavioural plans- and, as such, the somatic markers of aesthetic emotions could serve as potential biomarkers for transient states of enhanced brain plasticity. These findings extend neuroaesthetic research to a wide range of human activities focused on learning and cognitive change, such as education and healthcare.

 

We invite researchers to join forces to document, investigate and understand the role of aesthetic experiences in driving change. We expect contributions deeply rooted in neuro-behavioural data and drawing from multidisciplinary approaches, where experimental and applied aesthetic research may dialogue: neurosciences, clinical and experimental neuropsychology, cognitive science, neurocomputational modelling, experimental psychology, clinical and developmental psychology, psychotherapy and psychiatry, as well as neurorehabilitation.

The key domains of application that will be considered in the special issue are the following:

-Learning/Education. Learning models and research on memory (e.g., how do aesthetic principles potentiate learning), design of timelines and spaces for learning, teaching and educational activities in general.

-Mental Health and psychotherapy: possible application of neuroaesthetic principles to psychotherapy, clinical settings and neurorehabilitation contexts. How do aesthetic competences and aesthetic settings serve diagnostic, rehabilitation and therapeutic processes? Research on the aesthetic variables in the therapeutic encounter: e.g., how do aesthetic sensibility and aesthetic tools/practices influence the therapy of neurological/psychopathological conditions?

-Normal and pathological learning: how do aesthetic emotions influence learning processes and plasticity in normal individuals and in psychiatric and neurological patients? Can we obtain a better understanding of the neurocognitive mechanisms subtending psychopathological behaviour using neuroaesthetic principles?

Read more