Dr. Wen Tong

Title: Token Communications

Abstract: The foundation for the AI revolution is based on the LLM technology, in addition to the text-centric Generative-AI, the LLM enables the AI-Reasoning capability to automate the work flow for all business, it enables the Agentic-AI for the intent-centric autonomous applications, with the rise of Agentic Internet, Agent-to-Agent communications will eventually become the dominant networking technology.

Since the LLM-GPT Based Agent is computing intensive, and in particular, the LLM requires massive parallel SIMD/SIMT computing with specific constraints, such as stringent synchronization for token-by-token prediction, this leads to the new communications challenges, we call this Token Communications.

In this talk, we present two principles of the Token Communication design, first, the on-time-in-order transmission protocol to maximize the computing and communication efficiency, second, attention derivative token, rather than the plain text token to ensure the privacy. We also present the scaling-law in terms of the Token Communication with the perspective of the scaling law for LLM.

Bio: Wen Tong is the CTO, Huawei Wireless, he is the chief scientist for Huawei 5G/6G. He is a Huawei Fellow and an IEEE Fellow. Prior to joining Huawei in 2009, Dr. Tong was the Nortel Fellow and head of the Network Technology Labs at Nortel. He joined the Wireless Technology Labs at Bell Northern Research in 1995 in Canada. For the past three decades, he had pioneered fundamental technologies from 1G to 6G wireless and WiFi. His current research focus is AI-Wireless. He is a Fellow of Canadian Academy of Engineering, and a Fellow Royal Society of Canada.