Publishing house Radiotekhnika

"Publishing house Radiotekhnika":
scientific and technical literature.
Books and journals of publishing houses: IPRZHR, RS-PRESS, SCIENCE-PRESS

Тел.: +7 (495) 625-9241


New capabilitiesin geometric processing of symbolic information in intellectual systems


A.A. Eidlin - Post-graduate Student, Department “Kibernetika”, National Research Nuclear University MEPhI (Moscow)
A.V. Samsonovich - Ph.D. (Eng.), Professor, Department “Kibernetika”, National Research Nuclear University MEPhI (Moscow)

Modern development of computational methods of information processing leads to the emergence of new approaches that use the principles of geometry and topology applied to symbolic information. In recent years, new methods of text processing based on vector spaces became popular, among which are semantic maps. A semantic map is understood here as a mapping from a set of symbolic representations characterized by a certain meanings (they are called here “chunks”: e.g., words or word senses) to locations in an abstract metric space that captures certain semantic aspects of representations. Examples of semantic maps include the “strong” maps based on dissimilarity metrics, such as those resulting from the latent semantic analysis (LSA), Topics, latent Dirichlet allocation (LDA), hyperspace analogy of language (HAL), Eigenwords, and related techniques, as well as “weak” maps, such as feature spaces and affective spaces, including Circumplex, EPA and PAD models, and maps derived from lexical graphs, with coordinates representing definite semantic features or contrasts, e.g., Sentic map or Antomap. To build a meaningful multi-dimensional semantic map, one needs to take into account requirements imposed by the metric of dissimilarity, that limit possibilities of geometric representation of the relationships between chunks, and vice versa. Therefore, one needs to define a measure of semantic dissimilarity for any two chunks that can be interpreted as distance with a direction.The next question refers to the notion of semantic space that provides an infrastructure for the map. In cognitive psychology and linguistics, there were many limited attempts to make the idea of semantic space mathematically precise. The state of the art in linguistics related to the semantic space idea is represented by LSA and its variations. Here, in contrast, we assume that it is possible to map any given set of chunks to points in a universal semantic space endowed with a metric that captures semantic relations among chunks. These relationsmay include dissimilarity and antonymy. The conflict between the former and the latter notions can be resolved in favor of either a strong or a weak semantic map. In the latter case, a map may tend to pull all synonyms together and all antonyms apart. The question of their unification remains open. A proposal to build a universal semantic cognitive map capable of accommodating all possible human knowledge implies a huge program for many generations to come. This work makes a small step toward the goal, showing how geometric representations of antonymy and synonymy, holonymy and hypernymycan be used toderive practically useful inferences. The authors are grateful to Dr. Galina V. Rybina, a Professor atthe National Research Nuclear University “MEPhI”, Moscow, Russian Federation, for her stimulating support and discussions. ThisworkwassupportedbytheRSFGrant # 15-11-30014.

  1. Samsonovich A.V., Ascoli G.A. Universal dimensions of meaning derived from semantic relations among words and senses: Mereological completeness vs. ontological generality. Computation 2014, 2 (3): 61-82.
  2. Samsonovich A.V., Ascoli G.A. Augmenting weak semantic cognitive maps with an ‘abstractness’ dimension. Computational Intelligence and Neuroscience 308176: 1-10. DOI: 10.1155/2013/308176.
  3. Samsonovic A.V., Ascoli G.A. Principal Semantic Components of Language and the Measurement of Meaning. PLoS ONE 5 (6): e10921.1-e10921.17.
  4. Tversky A., Gati I. Similarity, separability, and the triangle inequality // Psychol Rev. 1982. V. 89. P. 123–154.
  5. Russell J.A. A circumplex model of affect // J PersSocPsychol 1980. V.39. P.1161–1178.
  6. Osgood C.E., Suci G., Tannenbaum P. The Measurement of Meaning. University of Illinois Press: Urbana, IL, 1957.
  7. Gardenfors P. Conceptual Spaces: The Geometry of Thought. MIT Press: Cambridge. MA. 2004.
  8. Landauer; Healy, A., Ed. American Psychological Association: Washington. DC. 2004. P 237–249.
  9. Griffiths T.L., Steyvers M. A probabilistic approach to semantic representation // In: Proceedings of the 24th Annual Conference of the Cognitive Science Society; Gray, W.D.; Schunn, C.D., Eds.; Lawrence Erlbaum Associates: Hillsdale. NJ. 2002. P. 381–386.
  10. Steyvers M., Shiffrin R.M., Nelson D.L. Word association spaces for predicting semantic similarity effects in episodic memory. In: Experimental Cognitive Psychology and Its Applications: Festschrift in Honor of Lyle Bourne, Walter Kintsch, and Thomas.
  11. Samsonovich A.V., Goldin R.F., Ascoli G.A.Toward a semantic general theory of everything. Complexity. 2010. № 15(4). P. 12–18.
  12. Schwab D., Lafourcade M., Prince V. Antonymy and Conceptual Vectors // In: Proceedings COLING 2002: The 19th International Conference on Computational Linguistics.; 2002.
  13. Hu X., Cai Z., Wiemer-Hastings P., Graesser A.C., McNamara D.S. Strengths, limitations, and extensions of LSA // In: Handbook of Latent Semantic Analysis; T.K. Landauer, D.S. McNamara, S. Dennis, W. Kintsch (Eds.). Lawrence Erlbaum Associates: Mahwah. NJ, 2007. P. 401–425.
  14. Katz J. Semantic Theory. Harper & Row: New York. 1972.
  15. Landauer T.K., Dumais S.T. A solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge // Psychological Rev. 1997. V. 104. P. 211–240.
  16. Cambria E., Hussain A. Sentic Computing: Techniques, Tools, and Applications. Dordrecht, Netherlands: Springer. 2012.
June 24, 2020
May 29, 2020

© Издательство «РАДИОТЕХНИКА», 2004-2017            Тел.: (495) 625-9241                   Designed by [SWAP]Studio