Tencent released open weights for its Hy4 preview model
Tencent released Hy4 preview on August 28. Its model card lists 770 billion total parameters, with 49 billion active for each token. The card also lists a context window above one million tokens. Tencent published the weights under the Apache 2.0 license. The company described the model as a tool for coding, office work, research, and financial analysis.
Tencent supplied the architecture and performance claims. Independent evaluations are not available yet. A preview release can change before a stable version. A context window above one million tokens also does not prove the model can handle a long task reliably.
Read article →