Score: 0

Discrete approach to machine learning

Published: July 19, 2025 | arXiv ID: 2508.00869v1

By: Dmitriy Kashitsyn, Dmitriy Shabanov

Potential Business Impact:

Helps computers understand languages like brains do.

The article explores an encoding and structural information processing approach using sparse bit vectors and fixed-length linear vectors. The following are presented: a discrete method of speculative stochastic dimensionality reduction of multidimensional code and linear spaces with linear asymptotic complexity; a geometric method for obtaining discrete embeddings of an organised code space that reflect the internal structure of a given modality. The structure and properties of a code space are investigated using three modalities as examples: morphology of Russian and English languages, and immunohistochemical markers. Parallels are drawn between the resulting map of the code space layout and so-called pinwheels appearing on the mammalian neocortex. A cautious assumption is made about similarities between neocortex organisation and processes happening in our models.

Page Count
57 pages

Category
Computer Science:
Machine Learning (CS)