According to CoinMeta, ByteDance is discussing training a large language model with over 5 trillion parameters, in an attempt to catch up with leading competitors both domestically and internationally by expanding the scale of the model. If the plan is implemented, this model will surpass Alibaba’s 2.4 trillion parameters and MoZhiDanMian’s 2.8 trillion parameters, becoming the largest model known in China in terms of parameter size. Currently, the project is still in the early stages of discussion, and it is not yet determined whether the model will actually be trained and released. The new model project is led by Xiang Liang, the person in charge of Seed Foundation, in collaboration with Shen Ke, who is responsible for the pre-training data of large language models.