HOME    |    BROWSE    |    SEARCH    |    SUBSCRIPTION   |    SUBMISSION    |    REGISTRATION

Quick Search:
Author: Title/Abstract: Vol./No: Page:
PTP Online Top > Volume 78 (1987) > Number 1
| Next Article >

Prog. Theor. Phys. Vol. 78 No. 1 (1987) pp. 51-71

[ Full Text PDF : FREE ACCESS (1362K) ]

Memory Dynamics in Asynchronous Neural Networks

Ichiro Tsuda, Edger Koerner and Hiroshi Shimizu*

Bioholonics Research Project, Research Development Corporation of Japan, Koishikawa 4-14-24, Tokyo 112
*Faculty of Pharmaceutical Sciences, Department of Biophysics, University of Tokyo, Tokyo 113

(Received November 19, 1986)

Abstract:

A model which can perform learning, formation of memory without teacher for successive memory recalls is presented. The philosophical background of the study is summarized. The investigated network consists of two sets both composed of asynchronously firing model neurons. One set of neurons is responsible for the field effect, and the other is introduced as an input/output module. The field effect is given in the form of the system's self-response. It is shown that positive and negative global feedbacks by the field effect play an essential role in the successive recall of stored patterns. The possibility that these proposed mechanisms are implemented in the brain is discussed. We obtained a quasi-deterministic law on the level of a macrovariable concerning a random successive recall of memory representations by taking a Lorenz-plot of this macrovariable. We show that this macroscopic order is deterministic chaos steming from collapse of tori and this type of chaos can be an effective gadget for memory traces.


URL : http://ptp.ipap.jp/link?PTP/78/51/
DOI : 10.1143/PTP.78.51

[ Full Text PDF : FREE ACCESS (1362K) ] Citation:

References:

  1. J. C. Eccles, The Understanding of the Brain (New York, McGraw-Hill, 1977), 2nd ed.
  2. J. C. Eccles, Neuroscience 6 (1981), 1839.
  3. J. Szentagothai, Proc. R. Soc. London B201 (1978), 219; Rev. Physiol. Biochem. Pharmacol. 98 (1983), 11; Brain Research 95 (1975), 475.
    E. G. Jones, J. Comp. Neur. 160 (1975), 205.
  4. D. Marr, J. Physiol. 202 (1969), 437.
  5. I. Tsuda, Prog. Theor. Phys. Suppl. No. 78 (1984), 241[PTP].
  6. H. Shimizu, Y. Yamaguchi, I. Tsuda and M. Yano, in Complex Systems–Operational Approaches in Neurobiology, Physics and Computers, ed. H. Haken (Springer-Verlag, 1985), p. 225.
    H. Shimizu and Y. Yamaguchi, Tokyo University, Dept. of Pharmaceutical Sciences, Preprint.
  7. E. Koerner, I. Tsuda and H. Shimizu, submitted to Cognitive Sciences (1986).
    E. Korner and H. Shimizu, Abstracts of International Conference on Theoretical Biology (1985), p. 64.
  8. J. C. Eccles, The Human Mystery (Springer-Verlag, 1978).
    Y. Miyashita, private communication.
  9. D. Marr, Vision (Freeman, 1982).
  10. F. C. Crick and G. Mitchison, Nature 304 (1983), 111[CrossRef].
  11. J. J. Hopfield, D. I. Feinstein and R. G. Palmer, Nature 304 (1983), 158[CrossRef].
  12. H. Sompolinsky and I. Kanter, Phys. Rev. Lett. 57 (1986), 2861[APS].
    J. Maddox, Nature 325 (1987), 11[CrossRef].
  13. H. Haken, in Complex Systems–Operational Approaches, ed. H. Haken (Springer-Verlag, 1985), p. 1.
  14. J. J. Hopfield, Proc. Natl. Acad. Sci. 79 (1982), 2554.
  15. G. Toulouse, S. Dehaene and J. P. Changeux, Proc. Natl. Acad. Sci. 83 (1986), 1695.
  16. Brain Theory, ed. G. Palm and A. Aertsen (Springer-Verlag, 1986).
  17. Parallel Distributed Processing (PDP)–Explorations in the Microstructures of Cognition, ed. J. L. McClelland, D. E. Rumelhart, and the PDP research group (MIT Press, 1986), vols. 1 & 2.
    T. Hogg and B. A. Huberman, Proc. Natl. Acad. Sci. 81 (1984), 6871.
  18. J. J. Hopfield and D. W. Tank, Biol. Cybern. 52 (1985), 141.
    D. W. Tank and J. J. Hopfield, IEEE Transactions on Circuits and Systems CAS-33 (1986), 533.
  19. I. Tsuda and H. Shimizu, in Complex Systems–Operational Approaches, ed. H. Haken (Springer-Verlag, 1985), p. 240.
  20. K. Steinbuch, IEEE Trans. EC-12 (1963), 846.
  21. S. Amari, IEEE Trans. C-21 (1972), 1197.
    T. Kohonen, Content–Addressable Memories (Springer-Verlag, 1980); Self-Organization and Associative Memory (Springer-Verlag, 1984).
  22. K. Nakano and J. Nagumo, Advance Papers of the Conference, 2nd Int. Joint Conf. Artificial Intelligence (The British Computer Society, London, 1971).
    K. Fukushima, Kybernetik 12 (1973), 58.
    Y. Hirai, IEEE Trans. on SMC SMC-13 (1983), 851.
    And many other papers cited in Kohonen's book.
  23. W. Kinzel, in Complex Systems–Operational Approaches in Neurobiology, Physics and Computers, ed. H. Haken (Springer-Verlag, 1985), p.107.
    W. Kinzel, Justus-Liebig Univ., Dept. of Theoretical Physics, Preprint.
  24. T. Hogg and B. A. Huberman, Phys. Rev. A32 (1985), 2338[APS].
  25. S. Shinomoto, Prog. Theor. Phys. 75 (1986), 1313[PTP]; Kyoto Univ., Dept. of Physics, Preprint.
  26. T. Ikegami and M. Suzuki, Prog. Theor. Phys. 78 (1987), 38[PTP].
  27. Competition and Cooperation in Neural Nets, Lecture Notes Biomath., ed. S. Amari and M. A. Arbib (Springer-Verlag, 1982), vol. 45.
  28. I. Tsuda, E. Koerner and H. Shimizu, in preparation.
  29. M. Mezard, G. Parisi, N. Sourlas, G. Toulouse and M. Virasoro, Phys. Rev. Lett. 52 (1984), 1156[APS]; J. of Phys. 45 (1984), 843.
  30. R. Rammal, G. Toulouse and M. A. Virasoro, Rev. Mod. Phys. 58 (1986), 765[APS].
  31. G. E. Hinton, Parallel Models of Associative Memory, ed. G. E. Hinton, J. A. Anderson (Erlbaum, Hillsdale, N.I, 1981), p. 161.
    G. E. Hinton and T. J. Sejnowski, PDP, ed. J. L. McClelland, D. E. Rumelhart and the PDP research group (MIT Press, 1986), vol. 1 p. 282.
  32. D. E. Rumelhart, Introduction to Human Information Processing (John-Wiley, 1977).
  33. For example,
    D. Marr, J. Physiol. 202 (1969), 437; Proc. Roy Soc. London B176 (1970), 161.
    M. Ito, M. Sakurai and P. Tongroach, J. Physiol. 324 (1982), 113.
    N. Tsukahara, in Neuronal Plasticity, ed. C. W. Cotman (Raven Press, 1978), p. 113; Ann. Rev. Neurosci. 4 (1981), 351.
    S. Amari, Biol. Cybern. 26 (1977), 175.
  34. D. Marr, Philos. Trans. R. Soc. London B262 (1971), 23.
  35. For example,
    Y. Sano, Gumma Symposium on Endocrinology 20 (1983), 137.
  36. N. Isshiki, Y. Noguchi, H. Tanaka and H. Shimizu (Bioholonics reports, unpublished).
  37. D. H. Hubel and T. N. Wiesel, J. Physiol. 160 (1962), 106.
  38. H. Haken, Synergetics–An Introduction (Springer-Verlag, 1979), 3rd edition; Advanced Synergetics (Springer-Verlag, 1983).
  39. F. Crick, Trends Neurosci. 5 (1982), 44.
    M. Kawato, T. Hamaguchi, F. Murakami and N. Tsukahara, Biol. Cybern. 50 (1984), 447.
    M. Kawato and N. Tsukahara, Biophys. J. 46 (1984), 155.
  40. D. O. Hebb, Organization of Behaviour (John Wiley and Sons, 1949).
  41. C. von der Malsburg, Ber. Bunsenges. Phys. Chem. 89 (1985), 703; in Brain Theory, ed. G. Palm and A. Aertsen (Springer-Verlag, 1986), p. 161.
  42. S. J. Shenker, Physica 5D (1982), 405[Elsevier].
  43. K. Kaneko, Prog. Theor. Phys. 72 (1984), 1089[PTP]; Collapse of Tori and Genesis of Chaos in Dissipative Systems (World Scientific, Singapole, 1985).
  44. M. Sano and Y. Sawada, in Turbulence and Chaotic Phenomena in Fluids, ed. T. Tatsumi (Elsevier Science Publishers, 1984), p. 167; in Chaos and Statistical Method, ed. Y. Kuramoto (Springer, 1983).
  45. S. Amari, IEEE Transactions on Systems, Man and Cybernetics 2 (1972), 643.
  46. H. R. Wilson and J. D. Cowan, Biophys. J. 12 (1972), 1.
  47. J. S. Nicolis and I. Tsuda, Bull. Math. Biol. 47 (1985), 343.

Citing Article(s) :

  1. Journal of the Physical Society of Japan 59 (1990) pp. 1529-1532 :
    Chaotic Image Retrieval in Markovian Asymmetric Neural Networks with Sign-Constrained Synaptic Couplings
    Masatoshi Shiino and Tomoki Fukai
  2. Journal of the Physical Society of Japan 65 (1996) pp. 1859-1867 :
    A Parameter Controlled Chaos Neural Network
    Masahiro Nakagawa
  3. Journal of the Physical Society of Japan 71 (2002) pp. 2316-2325 :
    Statistical Properties of Chaos Associative Memory
    Masahiro Nakagawa
  4. Journal of the Physical Society of Japan 75 (2006) 044001 (9 pages) :
    Chaotic Behavior for Asymmetrically Diluted Hopfield Neural Network with a Non-Monotonic Transfer Function
    Katsuki Katayama and Tsuyoshi Horiguchi
  5. Journal of the Physical Society of Japan 79 (2010) 084002 (9 pages) :
    Instabilities in Associative Memory Model with Synaptic Depression and Switching Phenomena among Attractors
    Yosuke Otsubo, Kenji Nagata, Masafumi Oizumi, and Masato Okada
  6. Progress of Theoretical Physics Vol. 82 No. 2 (1989) pp. 254-274 :
    On the Parallel Between Zipf's Law and 1/f Processes in Chaotic Systems Possessing Coexisting Attractors
    John S. Nicolis and Ichiro Tsuda
  7. Progress of Theoretical Physics Vol. 88 No. 5 (1992) pp. 845-855 :
    Chaotic Wandering and Search in a Cycle-Memory Neural Network
    Shigetoshi Nara and Peter Davis
  8. Progress of Theoretical Physics Supplement No. 173 (2008) pp. 99-108 :
    A Mathematical Model for the Hippocampus: Towards the Understanding of Episodic Memory and Imagination
    Ichiro Tsuda, Yutaka Yamaguti, Shigeru Kuroda, Yasuhiro Fukushima and Minoru Tsukada

[PTP HOME] [BROWSE] [SEARCH] [SUBSCRIPTION] [SUBMISSION] [REGISTRATION]

Copyright © Progress of Theoretical Physics 2013 All rights reserved.