Generative Sequential Recommendation via Hierarchical Behavior Modeling
By: Zhefan Wang , Guokai Yan , Jinbei Yu and more
Potential Business Impact:
Helps online stores show you better ads.
Recommender systems in multi-behavior domains, such as advertising and e-commerce, aim to guide users toward high-value but inherently sparse conversions. Leveraging auxiliary behaviors (e.g., clicks, likes, shares) is therefore essential. Recent progress on generative recommendations has brought new possibilities for multi-behavior sequential recommendation. However, existing generative approaches face two significant challenges: 1) Inadequate Sequence Modeling: capture the complex, cross-level dependencies within user behavior sequences, and 2) Lack of Suitable Datasets: publicly available multi-behavior recommendation datasets are almost exclusively derived from e-commerce platforms, limiting the validation of feasibility in other domains, while also lacking sufficient side information for semantic ID generation. To address these issues, we propose a novel generative framework, GAMER (Generative Augmentation and Multi-lEvel behavior modeling for Recommendation), built upon a decoder-only backbone. GAMER introduces a cross-level interaction layer to capture hierarchical dependencies among behaviors and a sequential augmentation strategy that enhances robustness in training. To further advance this direction, we collect and release ShortVideoAD, a large-scale multi-behavior dataset from a mainstream short-video platform, which differs fundamentally from existing e-commerce datasets and provides pretrained semantic IDs for research on generative methods. Extensive experiments show that GAMER consistently outperforms both discriminative and generative baselines across multiple metrics.
Similar Papers
Generative Chain of Behavior for User Trajectory Prediction
Information Retrieval
Predicts what you'll want to see next.
Hierarchical Graph Information Bottleneck for Multi-Behavior Recommendation
Information Retrieval
Helps online stores show you better things.
Towards Multi-Behavior Multi-Task Recommendation via Behavior-informed Graph Embedding Learning
Information Retrieval
Recommends items better by learning from all user actions.