This warning message indicates that when initializing the BertModel using the weights from the model checkpoint at "./model_hub/chinese-bert-wwm/", some of the weights were not used. Specifically, the weights with the names "cls.predictions.bias", "cls.predictions.decoder.weight", "cls.predictions.transform.dense.bias", "cls.seq_relationship.weight", "cls.seq_relationship.bias", "cls.predictions.transform.LayerNorm.weight", "cls.predictions.transform.dense.weight", and "cls.predictions.transform.LayerNorm.bias" were not used.

This is not necessarily a cause for concern, as some of these weights may not be relevant for the specific task you are using the model for. However, if you are experiencing performance issues or unexpected results, you may want to investigate whether any of these unused weights could be contributing to the problem.

Some weights of the model checkpoint at model_hubchinese-bert-wwm were not used when initializing BertModel clspredictionsbias clspredictionsdecoderweight clspredictionstransformdensebias clsseq_relat

原文地址: https://www.cveoy.top/t/topic/bumy 著作权归作者所有。请勿转载和采集!

免费AI点我,无需注册和登录