According to CoinMeta, Microsoft: We now possess a pre-trained foundational model with a scale of 3 trillion parameters, which is at the leading level in the industry and has been entirely developed internally by us. The results of subsequent training will be released soon, so stay tuned!