Some weights of the model checkpoint at model_hubchinese-bert-wwm were not used when initializing BertModel clspredictionsbias clspredictionsdecoderweight clspredictionstransformdensebias clsseq_relat
This warning message indicates that when initializing the BertModel using the weights from the model checkpoint at "./model_hub/chinese-bert-wwm/", some of the weights were not used. Specifically, the weights with the names "cls.predictions.bias", "cls.predictions.decoder.weight", "cls.predictions.transform.dense.bias", "cls.seq_relationship.weight", "cls.seq_relationship.bias", "cls.predictions.transform.LayerNorm.weight", "cls.predictions.transform.dense.weight", and "cls.predictions.transform.LayerNorm.bias" were not used.
This is not necessarily a cause for concern, as some of these weights may not be relevant for the specific task you are using the model for. However, if you are experiencing performance issues or unexpected results, you may want to investigate whether any of these unused weights could be contributing to the problem.
原文地址: https://www.cveoy.top/t/topic/bumy 著作权归作者所有。请勿转载和采集!