The enormous size of large language models (LLMs) has amplified hardware-related challenges such as the procurement of large numbers of GPUs and the massive energy demands of data centers. This session will explore the trend toward compact LLMs, particularly among Chinese enterprises, as well as the evolving AI semiconductor landscape. From these perspectives, we will discuss the future directions of software implementation.