Citation: Robertson EM (2009) From Creation to Consolidation: A Novel Framework for Memory Processing. PLoS Biol 7(1): e1000019. doi:10.1371/journal.pbio.1000019
Published: January 27, 2009
Copyright: © 2009 Edwin M. Robertson. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: I am also grateful to the US National Institutes of Health for supporting my work (R01 NS051446). Those who funded this work had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Abbreviations: EEG, electroencephalographic; M1, primary motor cortex; MTL, mediotemporal lobe; NREM, nonrapid eye movement; REM, rapid eye movement; SWS, slow-wave sleep; TMS, transcranial magnetic stimulation
Long after playing a game of squash or reading this essay, your memory for playing and reading continues to be processed by your brain. These “offline” processes improve your game and your understanding of this essay, and more generally, enhance adaptive behavior. Yet progress in understanding how the brain regulates the offline processing of memories has been hampered by the absence of robust models for interpreting diverse, and often contradictory, experimental results.
In the last 20 years, highly fertile quantitative models across the biological spectrum from the molecular to the behavioral have proved critical in advancing our understanding of memory encoding (e.g., [1–5]). But these models have focused upon the exact moment a memory is formed; while our ability to recall an event is dictated, at least in part, by events that precede and follow the encoding of a new memory. The critical role that events following memory encoding play in determining subsequent recall have been recognized for at least the past 100 years . Yet few, if any, models have been formulated for these “offline” processes that produce qualitative and quantitative changes in a memory during consolidation (Box 1). Our attempts to understand these mysterious processes have generated a purely descriptive set of observations. Although these observations have provided critical glimpses into offline memory processing, they have also produced unresolved contradictions between some of the most fundamental and critical sets of observations (for reviews, see [7–11]).
Box 1. Memory Consolidation
A memory passes through at least three key milestones in its development: initially it is encoded, then it is consolidated, and finally it is retrieved. During consolidation a memory can undergo both quantitative and qualitative changes. A memory may be enhanced, demonstrated by a quantitative increase in performance, or it may be stabilized, demonstrated by becoming quantitatively less susceptible to interference [10,46,47]. A memory can also undergo qualitative changes: there can be a shift in the strategy used to solve a problem or the emergence of awareness for what had earlier been learned [49,50]. Although there is a rich diversity in the behavioral expression of consolidation, each of these examples may rely upon the same underlying computation (see main text). Consolidation is measured as a change in performance between testing and retesting [46,47]. Contrasting final performance at retesting against an initial baseline provides a direct measure of “offline” performance changes that occur during consolidation.
For example, one set of observations suggests that consolidation may occur over any time interval, whereas another body of data suggests that these processes require sleep [6,8]. Clearly, both cannot be true. Resolving the inherent conflict between these perspectives strikes at the very heart of how biological mechanisms process memories after their initial encoding. Making sense of what threatens to become an avalanche of disconnected and incoherent empirical findings may require novel theories that can simultaneously reconcile apparently inconsistent observations and provide a fertile, hypothesis-driven framework for future work. Here, drawing upon examples mainly from the processing of motor skill memories, I take the first tentative steps toward assembling such a framework.
Toward a Unifying Framework
Distinct circuits operate during sleep and wakefulness.
Important clues about the offline processing of memories can be gleaned from understanding how the brain initially encodes memories. The motor skill memories acquired by a squash player, for example, ensure the production of rapid and powerful arm movements, either backhand or forehand, to hit a ball. The goal is always the same—to hit a ball; however, the exact movements can be very different. This classical distinction between goal and movement can be mapped onto distinct brain circuits (Figure 1, [3,12,13]). These distinct circuits are differentially affected by wakefulness and sleep: activity within the goal-component circuit changes substantially between wakefulness and sleep, with far smaller changes in activity occurring within the movement-based circuit . Having differential changes in activity may produce a differential processing of the motor skill components during wakefulness and sleep. Consistent with this idea, experimental work has shown that only the movement component is processed during wakefulness; whereas only the goal component is processed during sleep (Figure 2, ). Converging with this behavioral work are observations from functional imaging and transcranial magnetic stimulation (TMS) studies showing that distinct circuits are engaged during wakefulness and sleep to support offline processing (Figure 2, [16–20]).
Figure 1. A Motor Skill Memory Has Classically Been Split into Two Components
One component encodes the spatial goal of the movement, and the other encodes the movements needed to achieve that goal [84–86]. For example, the goal of playing out a sequence of spatial positions—2-3-1—can be achieved by a sequence of finger movements. The goal of a motor skill is encoded within a circuit that includes the dorsolateral prefrontal cortex (DLPFC), the inferior parietal lobule (IPL), and perhaps the mediotemporal lobe (MTL); whereas the movements associated with a skill are encoded within a circuit that includes the primary motor cortex (M1) and subcortical areas such as the striatum [12,13]. Other memories can be split into similar components. For example, navigating around a city relies upon learning the spatial location of landmarks plus learning the sequence of right-and-left turns needed to get to the landmark.doi:10.1371/journal.pbio.1000019.g001
Figure 2. Motor Skill Memories Are Differentially Processed over Wakefulness and Sleep
(A) The spatial goal of a motor skill is processed over sleep but not during wakefulness, whereas the skilled movements are processed over wakefulness but not over sleep . This double dissociation implies that distinct mechanisms are engaged to support consolidation over wakefulness and sleep. The offline processing of memories during consolidation can be expressed as an offline increase in motor skill [8,46]. (B) Using high-density EEG, the parietal cortex has been implicated in supporting motor skill improvements over sleep . The high-density electrodes (yellow dots) were aligned with a magnetic resonance image of a participant's brain. Following motor skill learning, a cluster of electrodes (white dots, enclosed by a red circle) centered over the parietal cortex showed an increase in slow-wave activity during sleep. (C) In contrast, a circuit that includes M1 makes a critical contribution to the consolidation of motor skills over wakefulness but not over sleep [16–18]. Disruption of M1, by applying TMS, blocks the development of motor skills over wakefulness but not over sleep.doi:10.1371/journal.pbio.1000019.g002
Recent functional imaging work has shown that the primary motor cortex (M1), which is associated with movement-based processing, and parietal areas, which are associated with goal-based processing, are both activated after motor skill learning . But subsequent consolidation is limited to being either goal- or movement-based [15,21]; suggesting that the offline activation of brain areas, alone, is not sufficient to support consolidation. Movement-based consolidation is dependent upon M1, and communication within that small local circuit is facilitated by high-frequency oscillations that are prominent during wakefulness [16–18]. In contrast, goal-based consolidation may be dependent upon communication across a large circuit including the parietal and prefrontal cortices, which is facilitated by slow-frequency oscillations that are a hallmark of nonrapid eye movement (NREM) sleep (Box 2, [22–24]). Thus multiple circuits may remain activated after learning; but because of the properties of specific brain states (e.g., wakefulness versus NREM sleep), only one of these circuits may make a functional contribution to subsequent consolidation.
Box 2. Mammalian Sleep
There are two broad types of sleep: NREM sleep and REM sleep. At the onset of sleep, humans enter the first of the four stages (1 to 4) of NREM sleep. As sleep deepens, stage 1 progresses into stage 4 and there is a decrease of electroencephalographic (EEG) frequency . Each of the NREM stages is defined by arbitrary criteria. For example, stage 2 sleep is defined by K-complexes (large, sharp waves on the EEG) and sleep spindles (12–14 Hz bursts of synchronized EEG activity). Increasingly, experimental work has attempted to link these electrophysiological features, as opposed to the sleep stages they define, to specific functions; for example, fast and slow sleep spindles may be linked to different aspects of memory processing . The final two stages of NREM sleep, stages 3 and 4, are characterized by the increasing predominance of low-frequency oscillations (<4 Hz). These oscillations travel slowly across the cortex, earning these latter two sleep stages the combined term of slow-wave sleep (SWS). REM sleep follows a bout of NREM sleep, and is characterized by desynchronized, high-frequency activity similar to the pattern of activity during wakefulness . During REM sleep there is a functional paralysis of many of the skeletal muscles; however, bursts of rapid eye movements are still possible and earn this sleep stage its name. Along with these electrophysiological changes, there are also dramatic changes in neurochemistry as the brain passes from NREM into REM sleep . Blocks of NREM-REM appear throughout the night and last for approximately 90–100 minutes before another NREM-REM cycle begins. The length of the cycle remains roughly constant throughout the night; however, its composition changes with SWS dominating early in the night; while REM comes to dominate later in the night.
Many recent functional imaging studies have sought to provide insight into the neural basis of consolidation. These studies have contrasted the patterns of activation before and after consolidation to reveal how the brain has been changed by consolidation [25–28]. Yet just because the activation of a brain area is changed by consolidation does not mean that area was responsible for supporting consolidation . For example, changes within one brain area may have been driven by another brain area. To reveal the brain areas supporting consolidation, it is first necessary to identify those brain areas activated during consolidation (e.g., [19,20]). Disrupting the function of these activated areas, by using TMS or through lesion studies, would determine which areas are necessary for consolidation . Thus, the challenge for future studies is to identify those circuits activated during consolidation, as opposed to those circuits altered by consolidation, and use this as a foundation to define those circuits making a functional contribution to consolidation.
Our declarative memories—those corresponding to facts and events—may also be processed offline through distinct mechanisms (Box 3). For example, when only a single word list is learned, the subsequent offline processing occurs during both sleep and wakefulness . In contrast, when an association is learned between list of words, the subsequent processing takes place only during sleep [32,33]. So one mechanism, engaged during wakefulness, supports consolidation when there are no associative links among a list of words, and another distinct mechanism, engaged during sleep, may support consolidation when there are associative links between declarative memories. Recent work has shown that the retrieval of a simple list of words is enhanced after sleep . However, retrieval is influenced by many factors, only one of which is memory consolidation (Box 1). Future studies might determine whether the enhanced retrieval of a simple word list after sleep is due to sleep-dependent consolidation.
Box 3. Memory Classification
Human memories have been classified into two broad types: declarative memories, dealing with memories for facts and events, and procedural memories, dealing with memories for skills . Overlying this classification is another classification distinguishing between memories that individuals are aware of acquiring (explicit memory) and unaware of acquiring (implicit memory). These different classifications should be seen as being largely independent. We can be aware of acquiring a new skill; for example, learning to ride a bike (explicit-procedural), but it is also possible to be unaware of acquiring a new skill, as occurs for the grammatical rules we learn (implicit-procedural). Similarly, we are aware of learning a new set of terms (explicit-declarative) but unaware that subliminal advertising, or priming in a psychology experiment, may affect our selection of a brand, or cause us to declare that we have already seen a list of words (implicit-declarative). The declarative-procedural classification has been mapped onto specific neural circuits: the mediotemporal lobe (MTL) supports declarative memories while motor cortical areas and subcortical areas, including the striatum and cerebellum, support procedural memories . This concept has been challenged by recent work showing that the MTL, at times, makes important contributions to procedural learning [25,37,56,66]. Rather than constituting part of a declarative memory system, the MTL may support a set of computations that are important to both declarative and procedural memory processing .
A differential organization—with distinct mechanisms engaged over wakefulness and sleep—is highly flexible, and may allow memories to be processed offline across a wide variety of different situations. When both sets of mechanisms are engaged, offline memory processing can occur over any time interval; but when one or the other mechanism is inhibited, processing will be restricted to either sleep or wakefulness. A differential organization, therefore, provides a unique framework for explaining the rich variety of contexts in which offline memory processing has been observed to occur. Controlling the flow of information through this framework may be achieved, at least in part, by the effects of practice and memory system interactions.
Practice and its effects on consolidation.
A high degree of flexibility can arise from a differential organization when the distinct sets of mechanisms are independently controlled. One way for independent control to be achieved is for practice to engage the distinct mechanisms in an asymmetric manner. For example, short bouts of practice can produce a motor skill memory with a large goal-based and minimal movement-based component, while prolonged practice periods may produce the reverse [3,13]. These motor skill components are processed offline over different brain states (i.e., sleep versus wakefulness), and so differences in the relative size of these component may restrict the benefits of consolidation to a specific brain state . Should the larger component be movement-based, then the benefits of consolidation may develop only during wakefulness; if the larger component is primarily goal-based, then consolidation may occur only during sleep. Such a prediction assumes that any component is sufficiently large to trigger consolidation ; but not so large that any possible benefits of consolidation have already been achieved through practice (; e.g., great skill may have already been acquired with practice, leaving little opportunity to enhance skill further during consolidation). Thus, by altering the relative proportions of motor skill components, practice may determine whether the benefits of offline processing are predominately wake- or sleep-dependent.
Rate of skill acquisition may also alter the relative proportions of motor skill components, with fast learning favoring the acquisition of goal-based improvements and leading to improvements that are predominately sleep-dependent (; see also [35,38]). Similarly, task properties may alter the relative proportions of the motor skill components [39,40]. For example, we communicate face-to-face by learning to articulate a language while also learning a set of nonverbal cues such as hand gestures, which provide important contextual cues to our spoken words . Having a contextual element embedded within a task shifts the circuits responsible for supporting motor skill learning to favor those implicated in goal-based learning [39,41]. Potentially, this leads to motor skill acquisition that is predominately goal-based, and as this component is preferentially processed over sleep, to a task that shows sleep-dependent consolidation (; see also [40,42]). Thus the extent of practice and task properties, by altering the relative proportions of motor skill components, may determine whether consolidation occurs over any time interval or is specifically dependent upon wakefulness or sleep.
Interactions across memory systems may support offline processing.
Many behaviors are supported by a combination of motor skill and declarative knowledge; for example, skillfully tapping out and knowing your personal ID number to get cash from a machine . In contrast, many other behaviors—such as exercising social judgment, applying grammatical rules, or using intuition—require little or no declarative knowledge . When a motor skill and declarative knowledge are acquired simultaneously, the subsequently offline motor processing depends on sleep; whereas, when a motor skill is acquired with little or no declarative knowledge, the subsequent offline motor processing occurs during wakefulness or sleep [39,45]. So when skills are acquired along with declarative knowledge there is little offline motor skill processing during wakefulness, which implies that declarative knowledge may block offline motor processing.
Two important predictions flow from this hypothesis. When a motor skill is acquired without declarative knowledge—as occurs during implicit learning—the subsequent offline processing of the motor skill should be blocked by declarative learning (Box 3, ). This idea was tested by having participants acquire a motor skill, declaratively learn a list of words, and later have their skill retested. Motor skill decreased between testing and retesting in proportion to the amount of prior declarative learning . The decrease in motor skill implies that the offline mechanisms, which normally support maintenance or enhancement of motor skill, are blocked by declarative learning [46,47]. These observations are consistent with the hypothesis that declarative knowledge blocks offline motor processing.
When a motor skill is acquired along with declarative knowledge—as occurs during explicit learning—removing or “knocking out” the declarative memory should induce offline motor memory processing, leading to enhanced performance (Box 3 and Figure 3). Consistent with this prediction, when declarative knowledge for a previously acquired motor skill was knocked out, participants' motor skill was enhanced . Disrupting declarative knowledge for the motor sequence was achieved by having participants learn a list of words. The declarative knowledge for the list of words interfered with and so reduced participants' declarative knowledge for the 12-item sequence from 7.3 ± 0.9 to 4.0 ± 0.8 items. In principle, any intervention that disrupts declarative knowledge should result in the offline enhancement of motor skill. In contrast, when declarative knowledge for the motor skill is not disrupted, there is no enhancement of motor skill. Thus, interactions occurring between memory systems can play an important role in controlling the processing of memories after their acquisition.
Figure 3. Memory System Interactions during Consolidation
(A) Our behaviors are frequently supported by a blend of declarative (D) and procedural (P) knowledge. In such behaviors, procedural (ΔP, blue bar) and declarative (ΔD, red bar) knowledge change little over wakefulness. (B) When the declarative component of such behaviors is knocked out—for example, by learning an interfering word list—there is a substantial enhancement in motor performance. This implies that declarative knowledge inhibits motor consolidation over wakefulness .doi:10.1371/journal.pbio.1000019.g003
Disengagement of memory systems during sleep.
During wakefulness, reciprocal interactions occur between memory systems; whereas during sleep these systems operate independently [31,45,48]. For example, declarative learning can block the consolidation of motor skills during wakefulness but not during sleep . Likewise, motor skill learning can block the consolidation of declarative memories during wakefulness but not during sleep . Such observations may specifically arise from a reciprocal interaction between the movement component of a motor skill memory, which is processed during wakefulness, and a declarative memory [15,21]. Overall, these observations show that reciprocal interactions occur between memory systems during wakefulness, but that these systems operate independently during sleep.
The transformation from interactive to independent processing implies that the memory systems disengage during sleep, through various potential mechanisms (Figure 4 in Box 4), allowing the simultaneous processing of both procedural and declarative memories [31,49]. Aspects of disengagement can be replicated during wakefulness by removing the inhibitory influence of declarative knowledge and allowing the consolidation of motor skills (Figure 3, ). Thus, offline memory processing may involve not only engaging specific neuroplastic mechanisms, but also disengaging interacting memory systems.
Figure 4. A Schematic Showing How Memory Systems May Interact during Wakefulness, and Operate Independently during Sleepdoi:10.1371/journal.pbio.1000019.g004
Box 4. Mechanisms of Disengagement
Several mechanisms can explain how memory systems interact during wakefulness and operate independently during sleep. (A) The same neuronal resources may support procedural (blue) and declarative (red) processing during wakefulness; whereas distinct resources may support memory processing during sleep. (B) Alternatively, declarative and procedural processing may partially share resources during wakefulness but not during sleep. For example, some brain areas, such as the MTL, support the processing of both declarative and procedural memories [37,56,66]. Having shared neuronal resources during wakefulness may account for the reciprocal interactions between the declarative and procedural memory systems. (C) Finally, sleep may functionally disconnect the declarative and procedural systems, allowing them to operate as independent memory systems. Combinations of these broad mechanisms are also possible: for example, overlapping neuronal resources may become functionally disconnected during sleep. These different scenarios make unique sets of predictions; consequently, future work should be able to distinguish among them.
Disengagement may increase the computational power of memory processing during sleep by removing the interfering effects of memory system interactions. It is during sleep that the brain's capacity to reorganize information and reveal “hidden patterns” becomes particularly marked (Box 5). This greater ability to discover hidden patterns may underlie our intuitive sense that “sleeping on a problem” can produce a solution. For example, a mathematical problem can be solved either by systematically working through a series of intermediary steps to calculate the final solution, or by discovering a hidden pattern and seeing that one of the early steps predicts the final solution . An individual's capacity to bypass the intermediary steps increases following sleep  and requires the formation of an association between one of the early steps and the final solution. Forming associations between temporally distant events occurs readily during sleep [50,51] and may depend upon placing small fragments of juxtaposed events in the correct temporal order, and then fusing those events together. For example, a sequence of items may be recalled as a series of short fragments, such as 2-1-2, 2-3, and 3-4. After a night's sleep, these fragments may be fused together to form 2-1-2-3-4 . Forming these high-order associations may allow memories that have been disrupted during the day to be reconstructed during sleep [36,52]. Such high-order processing can occur within the declarative memory system—expressed as enhanced declarative recall —and within the procedural system—expressed as improved motor performance [39,45,53–55].
Box 5. Mechanisms of Engagement
Although disengagement may be necessary for offline memory processing, it is unlikely to be sufficient: as some mechanisms are disengaged, other mechanisms will become engaged. Two prominent theories describe the mechanisms that may be engaged. One theory focuses on increasing the signal associated with a memory by replaying past experiences . Consistent with this theory, neuronal activity patterns associated with the performance of an earlier behavior are played out again during an offline interval [69,70]. Such neuronal reactivation is a common feature of offline activity and has been found within many brain areas and across many brain states [69–73]. Thus, neuronal reactivation occurs within brain areas, such as the hippocampus, that are associated with memory processing, and over intervals that are known to support offline processing.
An important challenge for future work is to test the link between neuronal reactivation and offline memory processing. Recent studies have started to address this challenge. Offline performance changes are correlated with neuronal reactivation [74,75], and these offline performance changes can be increased by increasing neuronal reactivation . These latter observations suggest a causative link between neuronal reactivation and offline performance improvements . A critical future test for the neuronal replay theory will be to establish that disrupting neuronal reactivation can prevent offline performance changes.
An alternative theory, the synaptic homeostasis theory, suggests that rather than increasing the signal associated with a memory, offline processing may reduce the noise associated with a memory. During wakefulness, much of the increase in the efficacy and number of synapses [77,78] may be driven by chance events that add noise to a network by obscuring synaptic changes driven by predictable events that can guide adaptive behavior. Removing noise-related synaptic changes is thought to be the function of SWS [77,78]. Synaptic changes—driven by learning or the induction of neuroplasticity—have been convincingly linked to SWS [20,79,80]. Yet the nature of this link, and specifically whether it is due to SWS reducing the efficacy of a specific population of synapses, is poorly understood. It is conceivable that both of these mechanisms operate together—one improving the signal of a memory, the other decreasing the noise—to mediate offline memory processing.
Generation of high-order associations has been linked to the hippocampus, a brain area frequently implicated in sleep-dependent processing [11,25,39,56]. The brain's greater affinity to generate high-order associations during sleep may stem, at least in part, from disengaging the memory systems. Yet disengagement is unlikely to explain all aspects of memory processing over sleep (Box 5). Although disengagement may increase the capacity for processing within each memory system by decreasing the potential for interference between the systems, this independence comes at the cost of impairing integration across memory systems. Disengagement, and its associated costs, may be restricted to a specific stage of sleep (e.g., NREM; Box 2); while other brain states, including other stages of sleep (e.g., rapid eye movement [REM] sleep; Box 2) and wakefulness, support a more interactive mode of processing. Competition for access to these brain states, and their associated interactive and disengaged modes of processing, could produce a diverse range of processing individually tailored to each memory. When interactive processing dominates, the benefits of consolidation may be restricted to a single memory system [49,50]; alternatively, the benefits of consolidation may be seen across both memory systems, a feature of disengagement .
The disengagement between memory systems during sleep may be due to changes in functional connectivity. During wakefulness, there is a reciprocal dialogue between the hippocampus and cortical areas; in contrast, during NREM sleep (Box 2), communication appears unidirectional, from the cortex to the hippocampus [57,58]. These changes in connectivity may impair the communication between memory processing areas within the hippocampus and cortex, which may lead to memory system disengagement. Changes in cortical connectivity have also been revealed in recent studies using TMS. A TMS pulse can propagate (a measure of connectivity) less during NREM sleep than during wakefulness ; however, the distance of propagation depends upon the site of stimulation, with TMS applied to areas lying anterior to M1 producing a short-distance pulse and TMS to more posterior areas (e.g., sensorimotor areas) producing a long-distance pulse , similar to that seen during wakefulness. Thus, some brain areas appear to become functionally isolated during NREM, due to diminished connectivity, while other areas may remain as functionally connected as they were during wakefulness.
These heterogeneous changes in functional connectivity during NREM sleep may support reduced connectivity between memory systems, allowing disengagement, while simultaneously supporting enhanced or maintained connectivity within memory systems, allowing the offline processing necessary for memory consolidation. Alternatively, a decrease in functional connectivity may be associated with a specific sleep stage—such as NREM—while other sleep stages support the offline processing within specific memory systems. This alternative implies that when declarative and procedural memories are acquired simultaneously, consolidation will be dependent upon NREM sleep when memory systems are disengaged. In contrast, when memories are acquired in isolation, consolidation will not depend on NREM sleep because it will not require disengagement. Consistent with this prediction are observations that the consolidation of motor skills, when acquired along with declarative knowledge for the skill, is correlated with NREM sleep , whereas when the same motor skill is acquired in isolation, its subsequent consolidation is correlated with REM sleep . Thus, a single sleep stage or the combined action of several sleep stages may be responsible for coordinating both the engagement and disengagement between memory systems.
Evidence that the memory processing benefits of sleep can be replicated over wakefulness through the loss of declarative knowledge (, Figure 3) implies that the loss of declarative knowledge may be critical for memory processing during sleep. Yet the sleep-related memory processing benefits can occur without a permanent loss of declarative knowledge. Rather than a permanent loss, sleep may provide a functional loss of knowledge by making a memory temporarily inaccessible to other systems . Thus, sleep may provide an environment in which it is possible to forget a memory, permanently or temporarily, to facilitate processing of other memories.
The interactive and independent modes of memory processing observed during wakefulness and sleep are complementary because each one compensates for the disadvantages of the other [31,48]. Interactions between memory systems can allow knowledge within one system to inform and guide the attainment of knowledge within another system. However, reciprocal interactions between memory systems are vulnerable to interference, such that consolidation within one system can block consolidation within the other . Memory systems operate independently during sleep, mitigating the problem of interference between the systems. But independence produces its own problem by not allowing the integration of information across memory systems, and this is mitigated by the interactive processing during wakefulness. Thus, the proposed framework may have been selected through evolution to support diverse and complementary modes of memory processing—providing the benefits of integration and independence.
The concepts presented here allow many contemporary observations to be reconciled within a single unified framework (Figure 5). Yet this unique framework extends beyond accounting for observations by also making experimentally testable predictions for future work (Box 6). Direct evidence for a differential organization supporting the offline processing of declarative memories is awaited, and a greater understanding of the relationship between biological events, such as decreases in functional connectivity and the disengagement between memory systems during sleep, is required. Such work will inevitably challenge and perhaps falsify the framework. But the utility of the framework lies within its potential to steer this fledgling and recently rejuvenated field away from the quagmire of disconnected findings and toward more fertile pastures. By so doing, it will help illuminate our understanding of the processing beyond the moment of memory creation, into how memories are consolidated, and so extend our appreciation for how we adapt to this ever changing world.
Figure 5. Distinct Mechanisms Are Engaged To Support the Offline Processing of Motor Skill Memories over Wakefulness and Sleep
One set of mechanisms, engaged over wakefulness, is supported by a circuit that includes the M1. In contrast, over sleep, a different circuit that may include the prefrontal and parietal cortices is engaged to support motor skill consolidation. Distinct mechanisms that are differentially engaged over sleep and wakefulness may also be responsible for the consolidation of perceptual and declarative memories. Overlying this differential organization within memory systems are reciprocal interactions between memory systems. Declarative processing can block procedural consolidation, and the reciprocal relationship also occurs, with procedural processing blocking declarative consolidation. These interactions are present over wakefulness (solid arrows) but not over sleep (outline arrows).
DLPFC, dorsolateral prefrontal cortex; IPL, inferior parietal lobule.doi:10.1371/journal.pbio.1000019.g005
Box 6. From Principles to Predictions
Two important principles lie at the heart of this framework. The first proposes that distinct mechanisms—one operating during wakefulness and the other operating during sleep—are responsible for the continued processing of a memory after its encoding. This implies that different memory components are processed during wakefulness and sleep, and that distinct circuits support memory processing during wakefulness and sleep. These predictions have, in part, been examined for the processing of motor skills [15,18,20,43]. But whether this principle also applies to the processing of perceptual skills and declarative memories has yet to be examined. For example, the primary visual cortex may be responsible for processing perceptual memories during wakefulness, whereas higher visual areas would be responsible for processing these memories during sleep [81–83].
The second principle proposes that memory processing during sleep requires both the engagement of neuroplastic mechanisms as well as the disengagement of interactions between memory systems. This principle can be used to forge a mechanistic link, which is discussed more fully within the main text, rather than just an empirical mapping between memory processing and sleep architecture. Disengagement may not only lead to different aspects of sleep being related to memory processing, but also to distinct neural circuits being responsible for memory processing. Finally, the potential for memory systems to disengage implies that the interaction between memory systems, during wakefulness, is maintained by a functional rather than anatomical process, which raises the possibility that specific altering of neural function may induce disengagement during wakefulness, and so allow the processing benefits of sleep to be reaped while awake. Far from an exhaustive list, these examples and descriptions of the predictions are intended to provide a flavor of the type of hypothesis-driven research that can emerge from this framework.
The comments of three anonymous reviewers, along with extensive editorial comments, and conversations with Daniel Cohen, Albert Galaburda, Chris Miall, Janet Mullington, and Alvaro Pascual-Leone helped to substantially improve this work. Neechi Mosha assisted with some of the figures.
- 1. Cohen NJ, Squire LR (1980) Preserved learning and retention of pattern-analyzing skill in amnesia: Dissociation of knowing how and knowing that. Science 210: 207–210. doi: 10.1126/science.7414331
- 2. Willingham DB (1997) Systems of memory in the human brain. Neuron 18: 5–8. doi: 10.1016/S0896-6273(01)80040-4
- 3. Hikosaka O, Nakahara H, Rand MK, Sakai K, Lu X, et al. (1999) Parallel neural networks for learning sequential procedures. Trends Neurosci 22: 464–471. doi: 10.1016/S0166-2236(99)01439-3
- 4. Habib R, Nyberg L, Tulving E (2003) Hemispheric asymmetries of memory: The HERA model revisited. Trends Cogn Sci 7: 241–245. doi: 10.1016/s1364-6613(03)00110-4
- 5. Neves G, Cooke SF, Bliss TV (2008) Synaptic plasticity, memory and the hippocampus: A neural network approach to causality. Nat Rev Neurosci 9: 65–75. doi: 10.1038/nrn2303
- 6. McGaugh JL (2000) Memory—A century of consolidation. Science 287: 248–251. doi: 10.1126/science.287.5451.248
- 7. Maquet P (2001) The role of sleep in learning and memory. Science 294: 1048–1052. doi: 10.1126/science.1062856
- 8. Walker MP, Stickgold R (2004) Sleep-dependent learning and memory consolidation. Neuron 44: 121–133. doi: 10.1016/j.neuron.2004.08.031
- 9. Robertson EM (2004) Skill learning: Putting procedural consolidation in context. Curr Biol 14: R1061–R1063. doi: 10.1016/j.cub.2004.11.048
- 10. Krakauer JW, Shadmehr R (2006) Consolidation of motor memory. Trends Neurosci 29: 58–64. doi: 10.1016/j.tins.2005.10.003
- 11. Marshall L, Born J (2007) The contribution of sleep to hippocampus-dependent memory consolidation. Trends Cogn Sci 11: 442–450. doi: 10.1016/j.tics.2007.09.001
- 12. Grafton ST, Hazeltine E, Ivry RB (1998) Abstract and effector-specific representations of motor sequences identified with PET. J Neurosci 18: 9420–9428.
- 13. Hikosaka O, Nakamura K, Sakai K, Nakahara H (2002) Central mechanisms of motor skill learning. Curr Opin Neurobiol 12: 217–222. doi: 10.1016/S0959-4388(02)00307-0
- 14. Braun AR, Balkin TJ, Wesenten NJ, Carson RE, Varga M, et al. (1997) Regional cerebral blood flow throughout the sleep-wake cycle. An H2(15)O PET study. Brain 120(Pt 7): 1173–1197. doi: 10.1093/brain/120.7.1173
- 15. Cohen DA, Pascual-Leone A, Press DZ, Robertson EM (2005) Off-line learning of motor skill memory: A double dissociation of goal and movement. Proc Natl Acad Sci U S A. pp. 18237–18241.
- 16. Muellbacher W, Ziemann U, Wissel J, Dang N, Kofler M, et al. (2002) Early consolidation in human primary motor cortex. Nature 415: 640–644. doi: 10.1038/nature712
- 17. Baraduc P, Lang N, Rothwell J, Wolpert D (2004) Consolidation of dynamic motor learning is not disrupted by rTMS of primary motor cortex. Curr Biol 14: 252–256. doi: 10.1016/j.cub.2004.01.033
- 18. Robertson EM, Press DZ, Pascual-Leone A (2005) Off-line learning and the primary motor cortex. J Neurosci 25: 6372–6378. doi: 10.1523/JNEUROSCI.1851-05.2005
- 19. Peigneux P, Orban P, Balteau E, Degueldre C, Luxen A, et al. (2006) Offline persistence of memory-related cerebral activity during active wakefulness. PLoS Biol 4(4): e100. doi:10.1371/journal.pbio.0040100.
- 20. Huber R, Ghilardi MF, Massimini M, Tononi G (2004) Local sleep and learning. Nature 430: 78–81. doi: 10.1038/nature02663
- 21. Cohen DA, Robertson EM (2007) Motor sequence consolidation: Constrained by critical time windows or competing components. Exp Brain Res 177: 440–446. doi: 10.1007/s00221-006-0701-6
- 22. Buzsáki G (2006) Rhythms of the brain. Oxford: Oxford University Press. 464 p.
- 23. Diekelmann S, Born J (2007) One memory, two ways to consolidate. Nat Neurosci 10: 1085–1086. doi: 10.1038/nn0907-1085
- 24. Hoffman KL, Battaglia FP, Harris K, MacLean JN, Marshall L, et al. (2007) The upshot of up states in the neocortex: From slow oscillations to memory formation. J Neurosci 27: 11838–11841. doi:10.1523/JNEUROSCI.3501-07.2007.
- 25. Walker MP, Stickgold R, Alsop D, Gaab N, Schlaug G (2005) Sleep-dependent motor memory plasticity in the human brain. Neuroscience 133: 911–917. doi: 10.1016/j.neuroscience.2005.04.007
- 26. Fischer S, Nitschke MF, Melchert UH, Erdmann C, Born J (2005) Motor memory consolidation in sleep shapes more effective neuronal representations. J Neurosci 25: 11248–11255. doi: 10.1523/JNEUROSCI.1743-05.2005
- 27. Maquet P, Schwartz S, Passingham R, Frith C (2003) Sleep-related consolidation of a visuomotor skill: Brain mechanisms as assessed by functional magnetic resonance imaging. J Neurosci 23: 1432–1440.
- 28. Peigneux P, Laureys S, Fuchs S, Destrebecqz A, Collette F, et al. (2003) Learned material content and acquisition level modulate cerebral reactivation during posttraining rapid-eye-movements sleep. Neuroimage 20: 125–134. doi: 10.1016/S1053-8119(03)00278-7
- 29. Ashe J, Lungu OV, Basford AT, Lu X (2006) Cortical control of motor sequences. Curr Opin Neurobiol 16: 213–221. doi: 10.1016/j.conb.2006.03.008
- 30. Robertson EM, Theoret H, Pascual-Leone A (2003) Studies in cognition: The problems solved and created by transcranial magnetic stimulation. J Cogn Neurosci 15: 948–960. doi: 10.1162/089892903770007344
- 31. Brown RM, Robertson EM (2007) Off-line processing: Reciprocal interactions between declarative and procedural memories. J Neurosci 27: 10468–10475. doi: 10.1523/JNEUROSCI.2799-07.2007
- 32. Plihal W, Born J (1997) Effects of early and late nocturnal sleep on declarative and procedural memory. J Cogn Neurosci 9: 534–547. doi: 10.1162/jocn.19188.8.131.524
- 33. Ellenbogen JM, Hulbert JC, Stickgold R, Dinges DF, Thompson-Schill SL (2006) Interfering with theories of sleep and memory: Sleep, declarative memory, and associative interference. Curr Biol 16: 1290–1294. doi: 10.1016/j.cub.2006.05.024
- 34. Lahl O, Wispel C, Willigens B, Pietrowsky R (2008) An ultra short episode of sleep is sufficient to promote declarative memory performance. J Sleep Res 17: 3–10. doi: 10.1111/j.1365-2869.2008.00622.x
- 35. Hauptmann B, Reinhart E, Brandt SA, Karni A (2005) The predictive value of the leveling off of within session performance for procedural memory consolidation. Brain Res Cogn Brain Res 24: 181–189. doi: 10.1016/j.cogbrainres.2005.01.012
- 36. Drosopoulos S, Schulze C, Fischer S, Born J (2007) Sleep's function in the spontaneous recovery and consolidation of memories. J Exp Psychol Gen 136: 169–183. doi: 10.1037/0096-34184.108.40.206
- 37. Albouy G, Sterpenich V, Balteau E, Vandewalle G, Desseilles M, et al. (2008) Both the hippocampus and striatum are involved in consolidation of motor sequence memory. Neuron 58: 261–272. doi: 10.1016/j.neuron.2008.02.008
- 38. Hauptmann B, Karni A (2002) From primed to learn: The saturation of repetition priming and the induction of long-term memory. Brain Res Cogn Brain Res 13: 313–322. doi: 10.1016/S0926-6410(01)00124-0
- 39. Spencer RM, Sunm M, Ivry RB (2006) Sleep-dependent consolidation of contextual learning. Curr Biol 16: 1001–1005. doi: 10.1016/j.cub.2006.03.094
- 40. Song S, Howard JH Jr, Howard DV (2007) Sleep does not benefit probabilistic motor sequence learning. J Neurosci 27: 12475–12483. doi: 10.1523/JNEUROSCI.2062-07.2007
- 41. Keele S, Ivry RB, Mayr U, Hazeltine E, Heuer H (2004) The cognitive and neural architecture of sequence representation. Psychol Rev 110: 316–339. doi: 10.1037/0033-295X.110.2.316
- 42. Peters KR, Smith V, Smith CT (2007) Changes in sleep architecture following motor learning depend on initial skill level. J Cogn Neurosci 19: 817–829. doi: 10.1162/jocn.2007.19.5.817
- 43. Robertson EM, Cohen DA (2006) Understanding consolidation through the architecture of memories. Neuroscientist 12: 261–271. doi:10.1177/1073858406287935.
- 44. Lieberman MD (2000) Intuition: A social cognitive neuroscience approach. Psychol Bull 126: 109–137. doi: 10.1037/0033-2909.126.1.109
- 45. Robertson EM, Pascual-Leone A, Press DZ (2004) Awareness modifies the skill-learning benefits of sleep. Curr Biol 14: 208–212. doi: 10.1016/j.cub.2004.01.027
- 46. Robertson EM, Pascual-Leone A, Miall R (2004) Current concepts in procedural consolidation. Nat Rev Neurosci 5: 576–582. doi: 10.1038/nrn1426
- 47. Walker MP (2005) A refined model of sleep and the time course of memory formation. Behav Brain Sci 28: 51–64. discussion 64–104. doi: 10.1017/s0140525x05000026
- 48. Brown RM, Robertson EM (2007) Inducing motor skill improvements with a declarative task. Nat Neurosci 10: 148–149. doi: 10.1038/nn1836
- 49. Fischer S, Drosopoulos S, Tsen J, Born J (2006) Implicit learning—Explicit knowing: A role for sleep in memory system interaction. J Cogn Neurosci 18: 311–319. doi: 10.1162/jocn.2006.18.3.311
- 50. Wagner U, Gais S, Haider H, Verleger R, Born J (2004) Sleep inspires insight. Nature 427: 352–355. doi: 10.1038/nature02223
- 51. Ellenbogen JM, Hu PT, Payne JD, Titone D, Walker MP (2007) Human relational memory requires time and sleep. Proc Natl Acad Sci U S A 104: 7723–7728. doi: 10.1073/pnas.0700094104
- 52. Fenn KM, Nusbaum HC, Margoliash D (2003) Consolidation during sleep of perceptual learning of spoken language. Nature 425: 614–616. doi: 10.1038/nature01951
- 53. Fischer S, Hallschmid M, Elsner AL, Born J (2002) Sleep forms memory for finger skills. Proc Natl Acad Sci U S A 99: 11987–11991. doi: 10.1073/pnas.182178199
- 54. Walker MP, Brakefield T, Morgan A, Hobson JA, Stickgold R (2002) Practice with sleep makes perfect: Sleep-dependent motor skill learning. Neuron 35: 205–211. doi: 10.1016/S0896-6273(02)00746-8
- 55. Kuriyama K, Stickgold R, Walker MP (2004) Sleep-dependent learning and motor-skill complexity. Learn Mem 11: 705–713. doi: 10.1101/lm.76304
- 56. Curran T (1997) Higher order associative learning in amnesia: Evidence from the serial reaction time task. J Cogn Neurosci 9: 522–533. doi: 10.1162/jocn.19220.127.116.112
- 57. Isomura Y, Sirota A, Ozen S, Montgomery S, Mizuseki K, et al. (2006) Integration and segregation of activity in entorhinal-hippocampal subregions by neocortical slow oscillations. Neuron 52: 871–882. doi: 10.1016/j.neuron.2006.10.023
- 58. Tononi G, Massimini M, Riedner BA (2006) Sleepy dialogues between cortex and hippocampus: Who talks to whom. Neuron 52: 748–749. doi: 10.1016/j.neuron.2006.11.014
- 59. Massimini M, Ferrarelli F, Huber R, Esser SK, Singh H, et al. (2005) Breakdown of cortical effective connectivity during sleep. Science 309: 2228–2232. doi: 10.1126/science.1117256
- 60. Massimini M, Ferrarelli F, Esser SK, Riedner BA, Huber R, et al. (2007) Triggering sleep slow waves by transcranial magnetic stimulation. Proc Natl Acad Sci U S A 104: 8496–8501. doi: 10.1073/pnas.0702495104
- 61. Crick F, Mitchison G (1983) The function of dream sleep. Nature 304: 111–114. doi: 10.1038/304111a0
- 62. Rechtschaffen A, Kales A (1968) Manual of standardized terminology, techniques and scoring systems for sleep stages of human subjects. Los Angeles: UCLA Brain Information Service. 57 p.
- 63. Schabus M, Dang-Vu TT, Albouy G, Balteau E, Boly M, et al. (2007) Hemodynamic cerebral correlates of sleep spindles during human non-rapid eye movement sleep. Proc Natl Acad Sci U S A 104: 13164–13169. doi: 10.1073/pnas.0703084104
- 64. Llinas R, Ribary U (1993) Coherent 40-Hz oscillation characterizes dream state in humans. Proc Natl Acad Sci U S A 90: 2078–2081. doi: 10.1073/pnas.90.5.2078
- 65. Hobson J, Pace-Schott E (2002) The cognitive neuroscience of sleep: Neuronal systems, consciousness and learning. Nat Rev Neurosci 3: 679–693. doi: 10.1038/nrn915
- 66. Schendan HE, Searl MM, Melrose RJ, Stern CE (2003) An FMRI study of the role of the medial temporal lobe in implicit and explicit sequence learning. Neuron 37: 1013–1025. doi: 10.1016/S0896-6273(03)00123-5
- 67. Robertson EM (2007) The serial reaction time task: Implicit motor skill learning. J Neurosci 27: 10073–10075. doi:10.1523/JNEUROSCI.2747-07.2007.
- 68. Marr D (1971) Simple memory: A theory for archicortex. Philos Trans R Soc Lond B Biol Sci 262: 23–81. doi: 10.1098/rstb.1971.0078
- 69. Pavlides C, Winson J (1989) Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes. J Neurosci 9: 2907–2918.
- 70. Wilson MA, McNaughton BL (1994) Reactivation of hippocampal ensemble memories during sleep. Science 265: 676–679. doi: 10.1126/science.8036517
- 71. Qin YL, McNaughton BL, Skaggs WE, Barnes CA (1997) Memory reprocessing in corticocortical and hippocampocortical neuronal ensembles. Philos Trans R Soc Lond B Biol Sci 352: 1525–1533. doi: 10.1098/rstb.1997.0139
- 72. Euston DR, Tatsuno M, McNaughton BL (2007) Fast-forward playback of recent memory sequences in prefrontal cortex during sleep. Science 318: 1147–1150. doi: 10.1126/science.1148979
- 73. Foster DJ, Wilson MA (2006) Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440: 680–683. doi: 10.1038/nature04587
- 74. Peigneux P, Laureys S, Fuchs S, Collette F, Perrin F, et al. (2004) Are spatial memories strengthened in the human hippocampus during slow wave sleep. Neuron 44: 535–545. doi: 10.1016/j.neuron.2004.10.007
- 75. Gerrard JL, Burke SN, McNaughton BL, Barnes CA (2008) Sequence reactivation in the hippocampus is impaired in aged rats. J Neurosci 28: 7883–7890. doi:10.1523/JNEUROSCI.1265-08.2008.
- 76. Rasch B, Buchel C, Gais S, Born J (2007) Odor cues during slow-wave sleep prompt declarative memory consolidation. Science 315: 1426–1429. doi: 10.1126/science.1138581
- 77. Tononi G, Cirelli C (2003) Sleep and synaptic homeostasis: A hypothesis. Brain Res Bull 62: 143–150. doi: 10.1016/j.brainresbull.2003.09.004
- 78. Tononi G, Cirelli C (2006) Sleep function and synaptic homeostasis. Sleep Med Rev 10: 49–62. doi: 10.1016/j.smrv.2005.05.002
- 79. Huber R, Ghilardi MF, Massimini M, Ferrarelli F, Riedner BA, et al. (2006) Arm immobilization causes cortical plastic changes and locally decreases sleep slow wave activity. Nat Neurosci 9: 1169–1176. doi: 10.1038/nn1758
- 80. De Gennaro L, Fratello F, Marzano C, Moroni F, Curcio G, et al. (2008) Cortical plasticity induced by transcranial magnetic stimulation during wakefulness affects electroencephalogram activity during sleep. PLoS ONE 3(6): e2483. doi:10.1371/journal.pone.0002483.
- 81. Karni A, Tanne D, Rubenstein BS, Askenasy JJ, Sagi D (1994) Dependence on REM sleep of overnight improvement of a perceptual skill. Science 265: 679–682. doi: 10.1126/science.8036518
- 82. Censor N, Karni A, Sagi D (2006) A link between perceptual learning, adaptation and sleep. Vision Res 46: 4071–4074. doi: 10.1016/j.visres.2006.07.022
- 83. Walker MP, Stickgold R, Jolesz FA, Yoo SS (2005) The functional anatomy of sleep-dependent visual skill learning. Cereb Cortex 15: 1666–1675. doi: 10.1093/cercor/bhi043
- 84. Brooks VB (1986) The neural basis of motor control. New York: Oxford University Press. 344 p.
- 85. Verwey W, Wright D (2004) Effector-independent and effector-dependent learning in the discrete sequence production task. Psychol Res 68: 64–70. doi: 10.1007/s00426-003-0144-7
- 86. Verwey W, Clegg B (2005) Effector dependent sequence learning in the serial RT task. Psychol Res 69: 242–251. doi: 10.1007/s00426-004-0181-x