On Splitting Lightweight Semantic Image Segmentation for Wireless Communications
By: Ebrahim Abu-Helalah, Jordi Serra, Jordi Perez-Romero
Potential Business Impact:
Splits picture tasks to send less data.
Semantic communication represents a promising technique towards reducing communication costs, especially when dealing with image segmentation, but it still lacks a balance between computational efficiency and bandwidth requirements while maintaining high image segmentation accuracy, particularly in resource-limited environments and changing channel conditions. On the other hand, the more complex and larger semantic image segmentation models become, the more stressed the devices are when processing data. This paper proposes a novel approach to implementing semantic communication based on splitting the semantic image segmentation process between a resource constrained transmitter and the receiver. This allows saving bandwidth by reducing the transmitted data while maintaining the accuracy of the semantic image segmentation. Additionally, it reduces the computational requirements at the resource constrained transmitter compared to doing all the semantic image segmentation in the transmitter. The proposed approach is evaluated by means of simulation-based experiments in terms of different metrics such as computational resource usage, required bit rate and segmentation accuracy. The results when comparing the proposal with the full semantic image segmentation in the transmitter show that up to 72% of the bit rate was reduced in the transmission process. In addition, the computational load of the transmitter is reduced by more than 19%. This reflects the interest of this technique for its application in communication systems, particularly in the upcoming 6G systems.
Similar Papers
Resource Allocation for the Training of Image Semantic Communication Networks
Social and Information Networks
Makes phones send pictures using less power.
Deep Semantic Inference over the Air: An Efficient Task-Oriented Communication System
Information Theory
Makes wireless devices smarter, faster, and use less power.
Semantic Communication based on Generative AI: A New Approach to Image Compression and Edge Optimization
CV and Pattern Recognition
Makes phones send pictures faster and smarter.