Astrocytes mediate analogous memory in a multi-layer neuron-astrocytic network
Abstract
Modeling the neuronal processes underlying short-term working memory remains the focus of many theoretical studies in neuroscience. Here we propose a mathematical model of spiking neuron network (SNN) demonstrating how a piece of information can be maintained as a robust activity pattern for several seconds then completely disappear if no other stimuli come. Such short-term memory traces are preserved due to the activation of astrocytes accompanying the SNN. The astrocytes exhibit calcium transients at a time scale of seconds. These transients further modulate the efficiency of synaptic transmission and, hence, the firing rate of neighboring neurons at diverse timescales through gliotransmitter release. We show how such transients continuously encode frequencies of neuronal discharges and provide robust short-term storage of analogous information. This kind of short-term memory can keep operative information for seconds, then completely forget it to avoid overlapping with forthcoming patterns. The SNN is inter-connected with the astrocytic layer by local inter-cellular diffusive connections. The astrocytes are activated only when the neighboring neurons fire quite synchronously, e.g. when an information pattern is loaded. For illustration, we took greyscale photos of people’s faces where the grey level encoded the level of applied current stimulating the neurons. The astrocyte feedback modulates (facilitates) synaptic transmission by varying the frequency of neuronal firing. We show how arbitrary patterns can be loaded, then stored for a certain interval of time, and retrieved if the appropriate clue pattern is applied to the input.
keywords:
spiking neural network , astrocyte , neuron-astrocyte interaction , working memory , image recognition
1 Introduction
Understanding principles of brain information processing remains one of the main challenges in neuroscience (Chaudhuri and Fiete, 2016; Benna and Fusi, 2016). In theory, there is a gap between molecular and cellular levels implementation and its functionality at the cognitive level. Scholars proposed a variety of conceptual, mathematical, and computational models of neuronal networks pretending to implement cognitive functions, such as learning and memory (Hopfield, 1982; Mongillo et al., 2008; Goldman, 2009; Zenke et al., 2015; Lobo et al., 2020; Solovyeva et al., 2016; Lobov et al., 2021; Gorban et al., 1997). In system neuroscience, memory is a substantially complicated paradigm involving different types and forms. Working memory represents one of these types (Baddeley, 2012). Like operative memory in computers, it can store several patterns for operative use for several seconds. After that, some patterns can be selected to be further memorized and the others are completely erased. Working memory is believed to be ”encoded” by changes in the strengths of synaptic connections, e.g. synaptic plasticity (Mongillo et al., 2008; Hansel and Mato, 2013; Lundqvist et al., 2018). These changes determine, which particular neuronal clusters or signal transmission pathways encoding the information should be memorized. When an appropriate clue is applied, the information can be retrieved in the form of spatio-temporal neuronal firing pattern reproducing original information. In modeling, the design of an adequate mathematical model that can possess both biological plausibility and processing functionality is still an open question (Fiebig and Lansner, 2016; Mi et al., 2017).
Investigations conducted in the last decade reveal more and more aspects related to the implementation of information functions of the CNS. The list of functions performed by the astrocytic cells keeps getting frequently updated and revised (Perea, 2005; Kimelberg and Nedergaard, 2010; Fields et al., 2013; Rusakov et al., 2014; López-Hidalgo and Schummers, 2014; Vasile et al., 2017). Several studies discuss the role of astrocytes in the perception of sensory stimuli (Lines et al., 2020; Stobart et al., 2018; Reynolds et al., 2019; Chen et al., 2012), spatio-temporal coordination of neural network signaling (Sonoda et al., 2018; Gordleeva et al., 2019; Kanakov et al., 2019), information processing, and cognitive functions (Oliveira et al., 2015; Paukert et al., 2014; Santello et al., 2019). A growing number of arguments are accumulating in favor of the theory of continuity and joint coordinated activity of neuron-astrocyte functional networks (Perea et al., 2014; Kastanenka et al., 2019; Kofuji and Araque, 2021). In the tripartite synapses (Halassa et al., 2007; Perea et al., 2009) the astrocyte serves as the third part modulating the synaptic transmission.
A biologically plausible computational model of working memory implemented by a spiking neuron network (SNN) interacting with a network of astrocytes was first proposed in our recent work (Gordleeva et al., 2021) and later by (DePittà and Brunel, 2021). The astrocytes operate via calcium transients at a much slower time scale of a few seconds by releasing gliotransmitters that modulate synaptic transmission in neurons and, hence, their firing rate. The working memory is associated with item-specific patterns of astrocyte-induced enhancement of synaptic transmission in neuronal networks.
Our work (Gordleeva et al., 2021), as the majority of conceptual and mathematical models of neuronal memory, operates with binary information. But the real-world data are analogous, not binary. The exploitation of binary information patterns in neural networks was the consequence of ”digitizing” neuronal signals which are naturally continuous and possess analogous characteristics, which change gradually, e.g. firing rate, timings, phase. The ”black-and-white” (BW) paradigm can be easily enhanced to ”colored” (CL) in artificial digital systems by simple ”spatial” scaling by increasing the number of bits. The situation is different in the neuronal systems targeting brain-inspired processing when there are no chances for such a scaling. The transition from BW to CL dynamics will require conceptual changes in the models. When recognizing non-binary (grayscale or color) images, stimuli should be converted into signals of spiking neurons. For example, in recent papers (Kulkarni and Rajendran, 2018; Woźniak et al., 2020) sensory neurons are under the influence proportional to the intensity of the corresponding pixels. Other studies have proposed SNNs for grayscale (Lee et al., 2018; Yu et al., 2021) and color (Cao et al., 2014) image recognition. However, such SNNs belong to the class of convolutional networks composed of a hierarchy of stacked convolutional layers. Training of parameters is carried out in order to contrast the boundaries of objects, which are clearly expressed just in binary images. Thus, the circuit processing SNN input signal should contain an algorithm for translating the input image into neural instructions, or the network should have a complex artificial architecture. These factors limit the biological relevance of the models.
Synaptic plasticity represents directed changes of synaptic weights either facilitating or depressing particular connections. In terms of information encoding, such changes are binary, and their main function is the BW representation of the memorized information. The revealed dependence of the level of calcium elevations generated by astrocytes on the neural activity (Bindocci et al., 2017) allows astrocytes to be involved in the regulation of synaptic transmission (Araque et al., 2014). This modulation is gradual and can provide proportional control of the connection efficacy. In other words, analogous information encoding can be possible due to the astrocytes.
In this paper, we employ our bioinspired model of SNN accompanied by astrocytes (Gordleeva et al., 2021) and show how it can reliably store ”colored” information for several seconds. To the best of the authors’ knowledge, this is the first time that a spiking neuron-astrocyte network has been shown to be able to implement a robust analogous memory, which can be used in brain-inspired artificial intelligence frameworks. For illustration, we take greyscale images as the information patterns and encode them into the level of input currents of the neuronal layer. Due to the interaction with the astrocyte layer, the patterns can be further stored in the network and maintained during the characteristic time interval of the astrocyte activation, e.g. several seconds. During this time the patterns can be retrieved if an appropriate image, e.g. close to the original, comes to the input. After that, the pattern completely disappears and the network becomes ready to store another image.
2 Colored memory and image recognition in the neuron-astrocyte network model
The neuron-astrocyte network has two interconnected layers: the SNN and the astrocytic network. The SNN composes of randomly sparsely connected excitatory Izhikevich’s neurons (Izhikevich, 2003) with non-plastic synapses arranged in a two-dimensional layer. This layer is interconnected with the astrocytic layer modeled by Ullah’s model (Ullah et al., 2006) with local inter-cellular diffusive connections. Each astrocyte bidirectionally communicates with ensembles of neurons. Astrocytes are activated by coordinated activity of the neighboring neurons, e.g. when an input is applied to the neuronal layer. Astrocytic calcium activation induces gliotransmitter release, which modulates the synaptic transmission in neuronal ensemble corresponding to the astrocyte. Such astrocyte-induced synaptic regulation results in the formation of spatially distributed clusters of synchronized neurons. The temporal and amplitude characteristics of astrocytic feedback are determined by its calcium dynamics. This biological relevant mechanism of bidirectional coordination between neuronal and astrocytic activities provides loading, storage, and retrieval of information patterns in the proposed model. The neuron-astrocyte network architecture is schematically illustrated in Fig. 1. Detailed description of the model construction and parameter meaning can be found in our previous paper (Gordleeva et al., 2021). Key mathematical details are summarized in A.
We trained the network to memorize grayscale images. The original 8-bit image (Fig. 2a) was converted to the pattern of input current, , (Fig. 2b) and fed to the neuronal layer. Stimulation protocol description can be found in A.5. In response to these signals, the neurons fire at different rates depending on the amplitude of the input current (Fig. 2c). Differences in the activity of neural ensembles lead to a variety of Ca2+ events in astrocytes interacting with it. Fig. 2d shows the Ca2+ pattern formed in the astrocytic layer. Such sample-specific distribution of Ca2+ concentration in the astrocytic layer lasts for several seconds.
We estimate the learning performance of the proposed neuron-astrocyte network model by an image recognition problem. For this purpose, we used four test images: the sample image distorted by 80% Gaussian noise (Fig. 3a), by 40% salt&pepper noise (Fig. 3c), uniform noise (Fig. 3e), and a new image (Fig. 3g). To illustrate the impact of astrocytes in the image classification task performed by neuron-astrocyte network, we compared the system recalls with and without astrocytic modulation of synaptic transmission. Fig. 3 shows that the neuronal layer working on its own can only repeat the input signal without information processing. The results of four tests performed by the full neuron-astrocyte network model are demonstrated in Fig. 4. Fig. 4(a,c,e,g) contain four types of input test images and Fig. 4(b,d,f,h) represent the system recalls shown as the mean neuronal firing rate distributions. The proposed neuron-astrocyte network model can recognize and effectively restore the distorted test image. In the first and second tests, in which the network was fed the noisy matching image, our system significantly reduced additional noise Fig. 4(b,d). Applying noise (Fig. 4e) or nonmatching test image (Fig. 4g) to the neuron-astrocyte network results in a nonspecific (Fig. 4f) or chimera-like (Fig. 4h) output.
To characterize robustness to noise of the proposed neuron-astrocyte network model, we investigated the quality of model retrieval depending on the noise level in the test image. We use two different types of random noise: salt&pepper impulse noise and Gaussian white noise. We examined the ability of our model to remove and reduce noise in an image. In the case of the pulse noise, the noise pixels could be either 1 or 0, which makes them significantly different from image pixels, and the neuron firing rates are significantly different from the neuronal ensemble, respectively. When the noise level is not high, the neuronal correlated activity evokes the astrocyte-mediated feedback which can decrease or increase the firing rates of noise neurons. For Gaussian noise, all pixels of the image change their intensity depending on the noise level. In this case, the astrocyte-induced regulation of synaptic weights restores the general level of activity and the synchronization in the neural ensemble. We measure the PSNR between the recalled pattern (e.g. Fig. 4(b,d)) and the ideal sample image (see section A.6) as conventional quality metric of image processing systems. Please note that the maximum possible recall PSNRmax to the response on the ideal image in the system is 18.295 dB (which is not a very large value) because the resolution of our system has been determined by the radius of the interaction of astrocytes with neurons. The results are well illustrated in Fig. 5 and Table 1. The PSNR in % denotes the PSNR of recalls related to the PSNRmax. We can see that the neuron-astrocyte network can robustly retrieve the memorized image even for a high noise level. The model significantly improved the PSNR for pulse noise for all values within its level and for Gaussian noise for large values of its intensity (Fig. 5). The high level of pulse noise destroys coordinated activity in the neural ensembles which prevents astrocyte-mediated synaptic modulation and, as a result, disturbs the retrieval of formation. Calcium patterns in the astrocytic layer are not frozen and their dynamics is determined by the intracellular biophysical mechanisms. Therefore, the astrocyte-induced feedback and the system recall that depends on it will vary in time. To investigate this, we apply a test image to the system at different time moments corresponding to different distribution schemes of calcium pattern amplitudes in the astrocytic layer. Fig. 6 shows how the PSNR recall depends on the astrocytic calcium dynamics. A larger difference between the amplitudes of calcium impulses in astrocytes leads to an increase in the difference between the activity levels of neural ensembles and thus to the recall bit depth enhancement and the recall quality improvement.






noise level: | 20 % | 40 % | 60 % | 80 % | 100% |
---|---|---|---|---|---|
Gaussian noise: | |||||
test image | |||||
model recall | |||||
model recall % | |||||
salt&pepper noise: | |||||
test image | |||||
model recall | |||||
model recall % |
3 Discussion
We have shown how astrocytes accompanying neuronal synaptic connections can enhance the possibility of the neuronal network to store and retrieve gradual (analogous) information patterns. Greyscale images were used to stimulate our two-layer neuron-astrocyte network. Corresponding synchronous activation of the astrocytic layer allows the system to store images in the form of levels of astrocyte calcium signal during the characteristic duration of calcium transients. Furthermore, different levels of calcium were associated with different strengths of modulation of the synaptic connections in the neuronal layer. Consequently, in the neuronal layer, the images have appeared in the form of activity patterns with different firing rates. During the storage interval, the system maintained the information and could retrieve it if the appropriate clue was shown in the input. We show that the retrieval was quite effective even if a noisy clue pattern was shown.
The role of the astrocytes in brain information processing has been intensively debated in neuroscience in recent years (Kastanenka et al., 2019). By modulating synaptic transmission, they can be involved in many computational functions of the brain circuits (Santello et al., 2019; Kofuji and Araque, 2021). Today, we have a variety of experimental facts indicating a similar functional role of astrocytes and neurons in perception processes, for example in the processing of visual stimuli. Along with metabolic, homeostatic, and other supporting functions (de Hoz et al., 2016), Muller glia cells in the retina provide the delivery of visual information – light, from the anterior surface of the retina to photoreceptors with minimal losses (Franze et al., 2007). Muller cells participate in the structural organization of the retina by creating non-overlapping microdomains that integrate through gap-junctions (Ramírez et al., 1996). This organization allows glial subnets to communicate over long distances (Oberheim et al., 2009). It was shown that astrocytes, like neurons, generate calcium signals in response to visual stimuli, with distinct spatial receptive fields and sharp tuning to a visual stimulus (Schummers et al., 2008; Sonoda et al., 2018). Wherein a significant overlap of the receptive fields of astrocytes and nearby neuronal cells was revealed (Schummers et al., 2008). Interestingly, it was found recently that sensory stimulation evokes astrocytic calcium signals with similar temporal dynamics to neurons (Stobart et al., 2018). At variance with neuronal activations, the astrocyte calcium transients are gradual in amplitude (Semyanov et al., 2020). These features indicate that the astrocytes can supply digitized neuronal computations by an analogous component that can significantly increase the computational power of brain circuits.
The presented result indicates that the spiking neuron-astrocyte network can provide robust analogous information encoding due to the astrocytic modulation of synaptic transmission mechanisms. This is a small but important step in ongoing research on the development of the brain-inspired artificial intelligence. Practically, the performance, for example, in terms, of the accuracy of neuromorphic computing implemented by spiking neuronal networks is still behind modern deep-learning networks in most learning tasks (Shakirov et al., 2018). The main reason for the intensified ongoing research efforts in designing brain-like hardware systems that implement neuronal and synaptic computations through spike-driven communication besides the understanding of brain mechanisms is that it can enable energy-efficient machine intelligence (Roy et al., 2019). It is believed that exploitation of spatio-temporal encoding in SNNs results in a more efficient exchange of information. In this regard, the experimentally and theoretically revealed ability of the astrocytes to evoke the local spatial synchronization in neuronal ensembles due to the activity-dependent short-term synaptic plasticity can become a promising additional feature of training algorithms for SNNs. Another important point that should be stressed is that short-term memory implemented by astrocytes is characterized by one-shot learning and is maintained during the interval of slow astrocytic calcium dynamics. Including the astrocyte-mediated synaptic plasticity in SNN learning algorithms can help to achieve better results than deep learning with the challenge of training on fewer data.
4 Acknowledgments
This research was supported by the RFBR projects No. 19-32-60051, 20-32-70081.
Appendix A Model detalization
A.1 Spiking neuron-astrocyte network model
The neuron-astrocyte network consists of two layers: the spiking neuronal network with dimension () and the astrocytic network. The SNN consists of Izhikevich neurons (Izhikevich, 2003) connected by random excitatory synaptic connections. The astrocytic network is () square lattice with only nearest-neighbor connectivity. The dynamics of the intracellular calcium concentration in each astrocyte is described by the Ullah model (Ullah et al., 2006). A bidirectional neuron-astrocyte interaction was modeled. Each astrocyte interacts with neurons located spatially close to it. A graphical representation of the network topology is shown in Fig. 1. The model was integrated using the order Runge-Kutta method with a time step of 0.1 ms. All parameters used in this computational study are given in Table 1 (neuron-astrocyte network parameters) and our previous paper (Gordleeva et al., 2021). The code is available at https://github.com/altergot/neuro-astro-network-grayscale.
A.2 Neuronal network
The Izhikevich neuron (Izhikevich, 2003) was chosen as a model to describe the dynamics of each neuron in our network due to its biological relevance and computational efficiency. This model is described by the following differential equations (Izhikevich, 2003):
(1) | ||||
with the auxiliary after-spike resetting:
(2) |
where are the neural indices, is the transmembrane potential, is the time in ms. is the input signal. is total synaptic current from all presynaptic neurons , which is calculated as follows (Kazantsev and Asatryan, 2011; Esir et al., 2018):
(3) |
where the parameter is the synaptic weight: , is the weight of the synaptic connection, is the astrocyte-induced modulation of the synaptic weight (see section: ”Bidirectional neuron-astrocyte interaction”). is the synaptic reversal potential for excitatory synapses. is the membrane potential of the presynaptic neuron, is the slope of the synaptic activation function. In this model, we do not take into account synaptic and axonal delays.
The architecture of synaptic connections between neurons is random: for each neuron, the number of output connections is fixed and equal to . Thus, the probabilities of the formation of a local and remote synaptic connection are the same.
First, we tested the functioning of our model with the same weights of synaptic connections between all neurons in the neuron-astrocytic network. Differences in the total synaptic input current resulted in some noise in the firing rate response when the original training image was fed. To reduce this effect, at the beginning of the session, we pre-train synaptic connections depending on the shades of the training image :
(4) |
where is the pixel shade value of the training source image from the interval [0; 255] corresponding to the presynaptic neuron (,), is the pixel shade value of the training source image corresponding to the postsynaptic neuron . Thus, a small difference in the shades of the pixels of the original training image corresponding to the presynaptic and postsynaptic neurons corresponds to a strong synaptic connection between this pair of neurons. The greater the difference in pixel shades, the weaker the synaptic connection between the corresponding neurons.
A.3 Astrocytic network
Astrocytic dynamics is determined by changes in the concentration of two main substances: inositol 1,4,5-triphosphate (IP3) and intracellular calcium (Ca2+). The main astrocytic intracellular calcium store is the endoplasmic reticulum (ER). Ca2+ can be released from the ER through the membrane channels into the cytoplasm, which corresponds to an increase in intracellular calcium concentration. Ca2+ flux from the ER to the cytoplasm, , is a non-linear function of calcium concentration [Ca2+] and is controlled by the IP3 concentration. The rate of this flow is determined by the fraction of channels on the ER membrane that are in the open (non-inactivated) state . The reverse flow of calcium from the cytoplasm to the ER is an active transport that pumps calcium back into the ER and is directed conversely to the concentration gradient.
To describe the dynamics of the intracellular [Ca2+] in each astrocyte (, ) of our network, we used the Ullah model (Ullah et al., 2006), which qualitatively reflects the main features of the calcium dynamics of astrocyte (for more details about this model and the biophysical meaning of all flows and parameters, see (Ullah et al., 2006)). This model consists of the following differential equations:
(5) | ||||
where is the leakage flux from the ER to the cytosol. The fluxes and describe the exchange of calcium with the extracellular space, , ( = 1,…, , = 1,…,) are the astrocyte indices. The parameter [IP] denotes the steady-state concentration of IP3, describes the production of IP3 by phospholipase C (PLC), describes the glutamate-induced IP3 production in response to neural activity. The fluxes are expressed as follows:
(6) | ||||
Astrocytes formed networks by connecting through gap-junctions Cx43 (Yamamoto et al., 1990; Nagy and Rash, 2000; Nimmerjahn et al., 2004). Diffusion currents of IP3 molecules and Ca2+ ions, and , can be expressed as follows:
(7) | ||||
where and describe the Ca2+ and IP3 diffusion rates, respectively. In our model each astrocyte is coupled with only four nearest neighbors. and are the discrete Laplace operators:
(8) | |||||
A.4 Bidirectional neuron-astrocyte interaction
Each astrocyte in the spiking neuron-astrocyte network interacts with a 4 by 4 ensemble of neurons with overlapping in one row. The spiking activity of neurons leads to the release of the neurotransmitter glutamate from the presynaptic terminal into the synaptic gap. The amount of that reached the astrocyte is described by the following equation: (Gordleeva et al., 2012; Pankratova et al., 2019):
(9) |
where is the glutamate clearance constant, is the release efficiency, is the Heaviside step function, and is the membrane potential of a neuron (,). Glutamate contacts metabotropic glutamate receptors (mGluR) on the astrocyte membrane and initiates the production of IP3. The variable in the equation describes glutamate-induced IP3 production and is modeled as:
(10) |
where is the threshold for the total amount of glutamate released by all neurons associated with the astrocyte (,). is total glutamate that reached an astrocyte (,):
(11) |
Higher neuronal activity causes more glutamate to be released. This, in turn, leads to a longer duration and greater amplitude of the elevation. Differences in the elevations initiated by the activity of neural ensembles lead to differences in Ca2+ dynamics of astrocytes corresponding to these neurons through IP3 production. Thus, the larger the amplitude and duration of the elevation, the longer and higher-amplitude calcium event it will cause.
The proposed model of spiking neuron-astrocyte network takes into account the following mechanisms of astrocytic enhancement of excitatory synaptic transmission due to the gliotransmitter action. Astrocytic glutamate-induced (i) potentiation of the synapse through the generation of the slow inward currents (SICs) in the postsynapse (Chen et al., 2012; Fellin et al., 2004); and (ii) mGluR-dependent heterosynaptic facilitation of presynaptic glutamate release (Perea and Araque, 2007; Navarrete and Araque, 2008, 2010). The revealed dependence of the level of calcium elevations generated by astrocytes on neural activity allows astrocytes to gradually regulate synaptic transmission (Araque et al., 2014). For simplicity, the relationship between the astrocyte Ca2+ concentration and synaptic weight of the affected synapses , is described as follows:
(12) |
where is the strength of the astrocyte-induced modulation of the synaptic weight, is the Heaviside step function, is the maximum Ca2+ concentration in astrocytic layer at the specific moment. Feedback from astrocytes to neurons is activated when is greater than , and the total amount of glutamate released by the neurons corresponding to the astrocyte is greater than the threshold: . The duration of synaptic transmission by astrocytes is fixed and equal to according to the experimental data of astrocyte-induced SICs dynamics (Fellin et al., 2004).
A.5 Stimulation protocol
The size of each visual stimulus is equal to the neural network size: × . The original image was quantized in 256 shades (8-bit image: values from 0 to 255) (Fig. 2a). Then, to train the network, for each of the 256 shades, a value was assigned from a range of linearly spaced values from 4 to 8. (Fig. 2b). Each pixel value was used as the amplitude of the input signal from equation (1) for the corresponding neuron (,). Thus, the input signal for a neuron (,) was a rectangular pulse with an amplitude equal to the pixel (,) value and duration .
To illustrate how the network can store and retrieve greyscale patterns, we used four images: the same photo with pixel intensities normalized to the range [4; 9] and with an additional 80 % Gaussian noise (Fig. 3a), the same photo with pixel intensities normalized to the range [4; 9] and with an additional 40 % ”salt and pepper” noise (Fig. 3c), uniform noise with values from the range [4; 9] (Fig. 3e), another photo with pixel intensities normalized to the range [4; 9] (Fig. 3g). Test images were also presented as an input signal to neurons with the duration .
The salt&pepper noise level (in ) is the fraction of noisy pixels. The Gaussian noise level (in ) represents the ratio of standard deviations of the white Gaussian noise and of the whole normalized image.
Parameter | Parameter description | Value |
---|---|---|
neural network grid size | ||
maximum pre-trained weight of synaptic connection without astrocytic influence | 0.025 | |
minimum pre-trained weight of synaptic connection without astrocytic influence | 0.001 | |
synaptic reversal potential for excitatory synapses | 0 mV | |
slope of synaptic activation function | 0.2 mV | |
number of output connections per each neuron | 100 | |
astrocytic network grid size | ||
Ca2+ diffusion rate | 0.05 s-1 | |
IP3 diffusion rate | 0.05 s-1 | |
number of neurons interacting with one astrocyte | 16, | |
glutamate clearance constant | 10 s-1 | |
efficacy of the glutamate release | 600 M s-1 | |
threshold concentration of glutamate for IP3 production | 2 | |
threshold of total glutamate required for the occurrence of astrocytic modulation of synaptic transmission | 3 | |
strength of astrocyte-induced modulation of synaptic weight | 0.1 | |
threshold concentration of Ca2+ for astrocytic modulation of synapse | 0.2 M | |
duration of astrocyte-induced modulation of synapse | 300 ms | |
stimulation duration | 100 ms | |
cue stimulation length | 100 ms |
A.6 Metrics for evaluating retrieval quality
To assess the retrieval quality of the developed neuron-astrocyte network, we used the PSNR method:
(13) | ||||
where = 255 is the maximum possible pixel value. To use this method, we converted all the results obtained (mean neuronal firing rate during testing) into 8-bit greyscale images and compared them with the original image . We calculated the mean firing rate of each neuron during testing as the mean number of spikes in a time window of 500 ms from the beginning of the test image presentation.
References
- Araque et al. (2014) Araque, A., Carmignoto, G., Haydon, P.G., Oliet, S.H., Robitaille, R., Volterra, A., 2014. Gliotransmitters travel in time and space. Neuron 81, 728–739. URL: https://doi.org/10.1016/j.neuron.2014.02.007, doi:10.1016/j.neuron.2014.02.007.
- Baddeley (2012) Baddeley, A., 2012. Working memory: Theories, models, and controversies. Annual Review of Psychology 63, 1–29. URL: https://doi.org/10.1146/annurev-psych-120710-100422, doi:10.1146/annurev-psych-120710-100422.
- Benna and Fusi (2016) Benna, M.K., Fusi, S., 2016. Computational principles of synaptic memory consolidation. Nature Neuroscience 19, 1697–1706. URL: https://doi.org/10.1038/nn.4401, doi:10.1038/nn.4401.
- Bindocci et al. (2017) Bindocci, E., Savtchouk, I., Liaudet, N., Becker, D., Carriero, G., Volterra, A., 2017. Three-dimensional ca2 imaging advances understanding of astrocyte biology. Science 356, eaai8185. URL: https://doi.org/10.1126/science.aai8185, doi:10.1126/science.aai8185.
- Cao et al. (2014) Cao, Y., Chen, Y., Khosla, D., 2014. Spiking deep convolutional neural networks for energy-efficient object recognition. International Journal of Computer Vision 113, 54–66. URL: https://doi.org/10.1007/s11263-014-0788-3, doi:10.1007/s11263-014-0788-3.
- Chaudhuri and Fiete (2016) Chaudhuri, R., Fiete, I., 2016. Computational principles of memory. Nature Neuroscience 19, 394–403. URL: https://doi.org/10.1038/nn.4237, doi:10.1038/nn.4237.
- Chen et al. (2012) Chen, N., Sugihara, H., Sharma, J., Perea, G., Petravicz, J., Le, C., Sur, M., 2012. Nucleus basalis-enabled stimulus-specific plasticity in the visual cortex is mediated by astrocytes. Proceedings of the National Academy of Sciences 109, E2832–E2841. URL: https://doi.org/10.1073/pnas.1206557109, doi:10.1073/pnas.1206557109.
- DePittà and Brunel (2021) DePittà, M., Brunel, N., 2021. Multiple forms of working memory emerge from synapse-astrocyte interactions. bioRxiv URL: https://doi.org/10.1101/2021.03.25.436819, doi:10.1101/2021.03.25.436819.
- Esir et al. (2018) Esir, P.M., Gordleeva, S.Y., Simonov, A.Y., Pisarchik, A.N., Kazantsev, V.B., 2018. Conduction delays can enhance formation of up and down states in spiking neuronal networks. Physical Review E 98. URL: https://doi.org/10.1103/physreve.98.052401, doi:10.1103/physreve.98.052401.
- Fellin et al. (2004) Fellin, T., Pascual, O., Gobbo, S., Pozzan, T., Haydon, P.G., Carmignoto, G., 2004. Neuronal synchrony mediated by astrocytic glutamate through activation of extrasynaptic NMDA receptors. Neuron 43, 729–743. URL: https://doi.org/10.1016/j.neuron.2004.08.011, doi:10.1016/j.neuron.2004.08.011.
- Fiebig and Lansner (2016) Fiebig, F., Lansner, A., 2016. A spiking working memory model based on hebbian short-term potentiation. The Journal of Neuroscience 37, 83–96. URL: https://doi.org/10.1523/jneurosci.1989-16.2016, doi:10.1523/jneurosci.1989-16.2016.
- Fields et al. (2013) Fields, R.D., Araque, A., Johansen-Berg, H., Lim, S.S., Lynch, G., Nave, K.A., Nedergaard, M., Perez, R., Sejnowski, T., Wake, H., 2013. Glial biology in learning and cognition. The Neuroscientist 20, 426–431. URL: https://doi.org/10.1177/1073858413504465, doi:10.1177/1073858413504465.
- Franze et al. (2007) Franze, K., Grosche, J., Skatchkov, S.N., Schinkinger, S., Foja, C., Schild, D., Uckermann, O., Travis, K., Reichenbach, A., Guck, J., 2007. Muller cells are living optical fibers in the vertebrate retina. Proceedings of the National Academy of Sciences 104, 8287–8292. URL: https://doi.org/10.1073/pnas.0611180104, doi:10.1073/pnas.0611180104.
- Goldman (2009) Goldman, M.S., 2009. Memory without feedback in a neural network. Neuron 61, 621–634. URL: https://doi.org/10.1016/j.neuron.2008.12.012, doi:10.1016/j.neuron.2008.12.012.
- Gorban et al. (1997) Gorban, A., Mirkes, Y., Wunsch, D., 1997. High order orthogonal tensor networks: information capacity and reliability, in: Proceedings of International Conference on Neural Networks (ICNN'97), IEEE. pp. 1311–1314. URL: https://doi.org/10.1109/icnn.1997.616224, doi:10.1109/icnn.1997.616224.
- Gordleeva et al. (2019) Gordleeva, S.Y., Ermolaeva, A.V., Kastalskiy, I.A., Kazantsev, V.B., 2019. Astrocyte as spatiotemporal integrating detector of neuronal activity. Frontiers in Physiology 10. URL: https://doi.org/10.3389/fphys.2019.00294, doi:10.3389/fphys.2019.00294.
- Gordleeva et al. (2012) Gordleeva, S.Y., Stasenko, S.V., Semyanov, A.V., Dityatev, A.E., Kazantsev, V.B., 2012. Bi-directional astrocytic regulation of neuronal activity within a network. Frontiers in Computational Neuroscience 6. URL: https://doi.org/10.3389/fncom.2012.00092, doi:10.3389/fncom.2012.00092.
- Gordleeva et al. (2021) Gordleeva, S.Y., Tsybina, Y.A., Krivonosov, M.I., Ivanchenko, M.V., Zaikin, A.A., Kazantsev, V.B., Gorban, A.N., 2021. Modeling working memory in a spiking neuron network accompanied by astrocytes. Frontiers in Cellular Neuroscience 15. URL: https://doi.org/10.3389/fncel.2021.631485, doi:10.3389/fncel.2021.631485.
- Halassa et al. (2007) Halassa, M.M., Fellin, T., Haydon, P.G., 2007. The tripartite synapse: roles for gliotransmission in health and disease. Trends in Molecular Medicine 13, 54–63. URL: https://doi.org/10.1016/j.molmed.2006.12.005, doi:10.1016/j.molmed.2006.12.005.
- Hansel and Mato (2013) Hansel, D., Mato, G., 2013. Short-term plasticity explains irregular persistent activity in working memory tasks. Journal of Neuroscience 33, 133–149. URL: https://doi.org/10.1523/jneurosci.3455-12.2013, doi:10.1523/jneurosci.3455-12.2013.
- Hopfield (1982) Hopfield, J.J., 1982. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences 79, 2554–2558. URL: https://doi.org/10.1073/pnas.79.8.2554, doi:10.1073/pnas.79.8.2554.
- de Hoz et al. (2016) de Hoz, R., Rojas, B., Ramírez, A.I., Salazar, J.J., Gallego, B.I., Triviño, A., Ramírez, J.M., 2016. Retinal macroglial responses in health and disease. BioMed Research International 2016, 1–13. URL: https://doi.org/10.1155/2016/2954721, doi:10.1155/2016/2954721.
- Izhikevich (2003) Izhikevich, E., 2003. Simple model of spiking neurons. IEEE Transactions on Neural Networks 14, 1569–1572. URL: https://doi.org/10.1109/tnn.2003.820440, doi:10.1109/tnn.2003.820440.
- Kanakov et al. (2019) Kanakov, O., Gordleeva, S., Ermolaeva, A., Jalan, S., Zaikin, A., 2019. Astrocyte-induced positive integrated information in neuron-astrocyte ensembles. Physical Review E 99. URL: https://doi.org/10.1103/physreve.99.012418, doi:10.1103/physreve.99.012418.
- Kastanenka et al. (2019) Kastanenka, K.V., Moreno-Bote, R., DePittà, M., Perea, G., Eraso-Pichot, A., Masgrau, R., Poskanzer, K.E., Galea, E., 2019. A roadmap to integrate astrocytes into systems neuroscience. Glia 68, 5–26. URL: https://doi.org/10.1002/glia.23632, doi:10.1002/glia.23632.
- Kazantsev and Asatryan (2011) Kazantsev, V.B., Asatryan, S.Y., 2011. Bistability induces episodic spike communication by inhibitory neurons in neuronal networks. Physical Review E 84. URL: https://doi.org/10.1103/physreve.84.031913, doi:10.1103/physreve.84.031913.
- Kimelberg and Nedergaard (2010) Kimelberg, H.K., Nedergaard, M., 2010. Functions of astrocytes and their potential as therapeutic targets. Neurotherapeutics 7, 338–353. URL: https://doi.org/10.1016/j.nurt.2010.07.006, doi:10.1016/j.nurt.2010.07.006.
- Kofuji and Araque (2021) Kofuji, P., Araque, A., 2021. Astrocytes and behavior. Annual Review of Neuroscience 44. URL: https://doi.org/10.1146/annurev-neuro-101920-112225, doi:10.1146/annurev-neuro-101920-112225.
- Kulkarni and Rajendran (2018) Kulkarni, S.R., Rajendran, B., 2018. Spiking neural networks for handwritten digit recognition—supervised learning and network optimization. Neural Networks 103, 118–127. URL: https://doi.org/10.1016/j.neunet.2018.03.019, doi:10.1016/j.neunet.2018.03.019.
- Lee et al. (2018) Lee, C., Srinivasan, G., Panda, P., Roy, K., 2018. Deep spiking convolutional neural network trained with unsupervised spike-timing-dependent plasticity. IEEE Transactions on Cognitive and Developmental Systems 11, 384–394. URL: https://doi.org/10.1109/tcds.2018.2833071, doi:10.1109/tcds.2018.2833071.
- Lines et al. (2020) Lines, J., Martin, E.D., Kofuji, P., Aguilar, J., Araque, A., 2020. Astrocytes modulate sensory-evoked neuronal network activity. Nature Communications 11. URL: https://doi.org/10.1038/s41467-020-17536-3, doi:10.1038/s41467-020-17536-3.
- Lobo et al. (2020) Lobo, J.L., Ser, J.D., Bifet, A., Kasabov, N., 2020. Spiking neural networks and online learning: An overview and perspectives. Neural Networks 121, 88–100. URL: https://doi.org/10.1016/j.neunet.2019.09.004, doi:10.1016/j.neunet.2019.09.004.
- Lobov et al. (2021) Lobov, S.A., Zharinov, A.I., Makarov, V.A., Kazantsev, V.B., 2021. Spatial memory in a spiking neural network with robot embodiment. Sensors 21, 2678. URL: https://doi.org/10.3390/s21082678, doi:10.3390/s21082678.
- López-Hidalgo and Schummers (2014) López-Hidalgo, M., Schummers, J., 2014. Cortical maps: a role for astrocytes? Current Opinion in Neurobiology 24, 176–189. URL: https://doi.org/10.1016/j.conb.2013.11.001, doi:10.1016/j.conb.2013.11.001.
- Lundqvist et al. (2018) Lundqvist, M., Herman, P., Miller, E.K., 2018. Working memory: Delay activity, yes! persistent activity? maybe not. The Journal of Neuroscience 38, 7013–7019. URL: https://doi.org/10.1523/jneurosci.2485-17.2018, doi:10.1523/jneurosci.2485-17.2018.
- Mi et al. (2017) Mi, Y., Katkov, M., Tsodyks, M., 2017. Synaptic correlates of working memory capacity. Neuron 93, 323–330. URL: https://doi.org/10.1016/j.neuron.2016.12.004, doi:10.1016/j.neuron.2016.12.004.
- Mongillo et al. (2008) Mongillo, G., Barak, O., Tsodyks, M., 2008. Synaptic theory of working memory. Science 319, 1543–1546. URL: https://doi.org/10.1126/science.1150769, doi:10.1126/science.1150769.
- Nagy and Rash (2000) Nagy, J.I., Rash, J.E., 2000. Connexins and gap junctions of astrocytes and oligodendrocytes in the CNS. Brain Research Reviews 32, 29–44. URL: https://doi.org/10.1016/s0165-0173(99)00066-1, doi:10.1016/s0165-0173(99)00066-1.
- Navarrete and Araque (2008) Navarrete, M., Araque, A., 2008. Endocannabinoids mediate neuron-astrocyte communication. Neuron 57, 883–893. URL: https://doi.org/10.1016/j.neuron.2008.01.029, doi:10.1016/j.neuron.2008.01.029.
- Navarrete and Araque (2010) Navarrete, M., Araque, A., 2010. Endocannabinoids potentiate synaptic transmission through stimulation of astrocytes. Neuron 68, 113–126. URL: https://doi.org/10.1016/j.neuron.2010.08.043, doi:10.1016/j.neuron.2010.08.043.
- Nimmerjahn et al. (2004) Nimmerjahn, A., Kirchhoff, F., Kerr, J.N.D., Helmchen, F., 2004. Sulforhodamine 101 as a specific marker of astroglia in the neocortex in vivo. Nature Methods 1, 31–37. URL: https://doi.org/10.1038/nmeth706, doi:10.1038/nmeth706.
- Oberheim et al. (2009) Oberheim, N.A., Takano, T., Han, X., He, W., Lin, J.H.C., Wang, F., Xu, Q., Wyatt, J.D., Pilcher, W., Ojemann, J.G., Ransom, B.R., Goldman, S.A., Nedergaard, M., 2009. Uniquely hominid features of adult human astrocytes. Journal of Neuroscience 29, 3276–3287. URL: https://doi.org/10.1523/jneurosci.4707-08.2009, doi:10.1523/jneurosci.4707-08.2009.
- Oliveira et al. (2015) Oliveira, J.F., Sardinha, V.M., Guerra-Gomes, S., Araque, A., Sousa, N., 2015. Do stars govern our actions? astrocyte involvement in rodent behavior. Trends in Neurosciences 38, 535–549. URL: https://doi.org/10.1016/j.tins.2015.07.006, doi:10.1016/j.tins.2015.07.006.
- Pankratova et al. (2019) Pankratova, E.V., Kalyakulina, A.I., Stasenko, S.V., Gordleeva, S.Y., Lazarevich, I.A., Kazantsev, V.B., 2019. Neuronal synchronization enhanced by neuron–astrocyte interaction. Nonlinear Dynamics 97, 647–662. URL: https://doi.org/10.1007/s11071-019-05004-7, doi:10.1007/s11071-019-05004-7.
- Paukert et al. (2014) Paukert, M., Agarwal, A., Cha, J., Doze, V.A., Kang, J.U., Bergles, D.E., 2014. Norepinephrine controls astroglial responsiveness to local circuit activity. Neuron 82, 1263–1270. URL: https://doi.org/10.1016/j.neuron.2014.04.038, doi:10.1016/j.neuron.2014.04.038.
- Perea (2005) Perea, G., 2005. Properties of synaptically evoked astrocyte calcium signal reveal synaptic information processing by astrocytes. Journal of Neuroscience 25, 2192–2203. URL: https://doi.org/10.1523/jneurosci.3965-04.2005, doi:10.1523/jneurosci.3965-04.2005.
- Perea and Araque (2007) Perea, G., Araque, A., 2007. Astrocytes potentiate transmitter release at single hippocampal synapses. Science 317, 1083–1086. URL: https://doi.org/10.1126/science.1144640, doi:10.1126/science.1144640.
- Perea et al. (2009) Perea, G., Navarrete, M., Araque, A., 2009. Tripartite synapses: astrocytes process and control synaptic information. Trends in Neurosciences 32, 421–431. URL: https://doi.org/10.1016/j.tins.2009.05.001, doi:10.1016/j.tins.2009.05.001.
- Perea et al. (2014) Perea, G., Sur, M., Araque, A., 2014. Neuron-glia networks: integral gear of brain function. Frontiers in Cellular Neuroscience 8. URL: https://doi.org/10.3389/fncel.2014.00378, doi:10.3389/fncel.2014.00378.
- Ramírez et al. (1996) Ramírez, J.M., Triviño, A., Ramírez, A.I., Salazar, J.J., García-Sanchez, J., 1996. Structural specializations of human retinal glial cells. Vision Research 36, 2029–2036. URL: https://doi.org/10.1016/0042-6989(95)00322-3, doi:10.1016/0042-6989(95)00322-3.
- Reynolds et al. (2019) Reynolds, J.P., Zheng, K., Rusakov, D.A., 2019. Multiplexed calcium imaging of single-synapse activity and astroglial responses in the intact brain. Neuroscience Letters 689, 26–32. URL: https://doi.org/10.1016/j.neulet.2018.06.024, doi:10.1016/j.neulet.2018.06.024.
- Roy et al. (2019) Roy, K., Jaiswal, A., Panda, P., 2019. Towards spike-based machine intelligence with neuromorphic computing. Nature 575, 607–617. URL: https://doi.org/10.1038/s41586-019-1677-2, doi:10.1038/s41586-019-1677-2.
- Rusakov et al. (2014) Rusakov, D.A., Bard, L., Stewart, M.G., Henneberger, C., 2014. Diversity of astroglial functions alludes to subcellular specialisation. Trends in Neurosciences 37, 228–242. URL: https://doi.org/10.1016/j.tins.2014.02.008, doi:10.1016/j.tins.2014.02.008.
- Santello et al. (2019) Santello, M., Toni, N., Volterra, A., 2019. Astrocyte function from information processing to cognition and cognitive impairment. Nature Neuroscience 22, 154–166. URL: https://doi.org/10.1038/s41593-018-0325-8, doi:10.1038/s41593-018-0325-8.
- Schummers et al. (2008) Schummers, J., Yu, H., Sur, M., 2008. Tuned responses of astrocytes and their influence on hemodynamic signals in the visual cortex. Science 320, 1638–1643. URL: https://doi.org/10.1126/science.1156120, doi:10.1126/science.1156120.
- Semyanov et al. (2020) Semyanov, A., Henneberger, C., Agarwal, A., 2020. Making sense of astrocytic calcium signals — from acquisition to interpretation. Nature Reviews Neuroscience 21, 551–564. URL: https://doi.org/10.1038/s41583-020-0361-8, doi:10.1038/s41583-020-0361-8.
- Shakirov et al. (2018) Shakirov, V.V., Solovyeva, K.P., Dunin-Barkowski, W.L., 2018. Review of state-of-the-art in deep learning artificial intelligence. Optical Memory and Neural Networks 27, 65–80. URL: https://doi.org/10.3103/s1060992x18020066, doi:10.3103/s1060992x18020066.
- Solovyeva et al. (2016) Solovyeva, K.P., Karandashev, I.M., Zhavoronkov, A., Dunin-Barkowski, W.L., 2016. Models of innate neural attractors and their applications for neural information processing. Frontiers in Systems Neuroscience 9. URL: https://doi.org/10.3389/fnsys.2015.00178, doi:10.3389/fnsys.2015.00178.
- Sonoda et al. (2018) Sonoda, K., Matsui, T., Bito, H., Ohki, K., 2018. Astrocytes in the mouse visual cortex reliably respond to visual stimulation. Biochemical and Biophysical Research Communications 505, 1216–1222. URL: https://doi.org/10.1016/j.bbrc.2018.10.027, doi:10.1016/j.bbrc.2018.10.027.
- Stobart et al. (2018) Stobart, J.L., Ferrari, K.D., Barrett, M.J., Glück, C., Stobart, M.J., Zuend, M., Weber, B., 2018. Cortical circuit activity evokes rapid astrocyte calcium signals on a similar timescale to neurons. Neuron 98, 726–735.e4. URL: https://doi.org/10.1016/j.neuron.2018.03.050, doi:10.1016/j.neuron.2018.03.050.
- Ullah et al. (2006) Ullah, G., Jung, P., Cornell-Bell, A., 2006. Anti-phase calcium oscillations in astrocytes via inositol (1, 4, 5)-trisphosphate regeneration. Cell Calcium 39, 197–208. URL: https://doi.org/10.1016/j.ceca.2005.10.009, doi:10.1016/j.ceca.2005.10.009.
- Vasile et al. (2017) Vasile, F., Dossi, E., Rouach, N., 2017. Human astrocytes: structure and functions in the healthy brain. Brain Structure and Function 222, 2017–2029. URL: https://doi.org/10.1007/s00429-017-1383-5, doi:10.1007/s00429-017-1383-5.
- Woźniak et al. (2020) Woźniak, S., Pantazi, A., Bohnstingl, T., Eleftheriou, E., 2020. Deep learning incorporating biologically inspired neural dynamics and in-memory computing. Nature Machine Intelligence 2, 325–336. URL: https://doi.org/10.1038/s42256-020-0187-0, doi:10.1038/s42256-020-0187-0.
- Yamamoto et al. (1990) Yamamoto, T., Ochalski, A., Hertzberg, E.L., Nagy, J.I., 1990. On the organization of astrocytic gap junctions in rat brain as suggested by LM and EM immunohistochemistry of connexin43 expression. The Journal of Comparative Neurology 302, 853–883. URL: https://doi.org/10.1002/cne.903020414, doi:10.1002/cne.903020414.
- Yu et al. (2021) Yu, Q., Song, S., Ma, C., Wei, J., Chen, S., Tan, K.C., 2021. Temporal encoding and multispike learning framework for efficient recognition of visual patterns. IEEE Transactions on Neural Networks and Learning Systems , 1–13URL: https://doi.org/10.1109/tnnls.2021.3052804, doi:10.1109/tnnls.2021.3052804.
- Zenke et al. (2015) Zenke, F., Agnes, E.J., Gerstner, W., 2015. Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks. Nature Communications 6. URL: https://doi.org/10.1038/ncomms7922, doi:10.1038/ncomms7922.