The Logical Expressiveness of Temporal GNNs via Two-Dimensional Product Logics
By: Marco Sälzer, Przemysław Andrzej Wałęga, Martin Lange
Potential Business Impact:
Teaches computers to understand changing information over time.
In recent years, the expressive power of various neural architectures -- including graph neural networks (GNNs), transformers, and recurrent neural networks -- has been characterised using tools from logic and formal language theory. As the capabilities of basic architectures are becoming well understood, increasing attention is turning to models that combine multiple architectural paradigms. Among them particularly important, and challenging to analyse, are temporal extensions of GNNs, which integrate both spatial (graph-structure) and temporal (evolution over time) dimensions. In this paper, we initiate the study of logical characterisation of temporal GNNs by connecting them to two-dimensional product logics. We show that the expressive power of temporal GNNs depends on how graph and temporal components are combined. In particular, temporal GNNs that apply static GNNs recursively over time can capture all properties definable in the product logic of (past) propositional temporal logic PTL and the modal logic K. In contrast, architectures such as graph-and-time TGNNs and global TGNNs can only express restricted fragments of this logic, where the interaction between temporal and spatial operators is syntactically constrained. These results yield the first logical characterisations of temporal GNNs and establish new relative expressiveness results for temporal GNNs.
Similar Papers
Aggregate-Combine-Readout GNNs Are More Expressive Than Logic C2
Artificial Intelligence
Makes computers understand complex data patterns better.
The Correspondence Between Bounded Graph Neural Networks and Fragments of First-Order Logic
Artificial Intelligence
Lets computers understand complex connections better.
Extracting Interpretable Logic Rules from Graph Neural Networks
Machine Learning (CS)
Finds hidden rules in data for new discoveries.