对英文文本进行去除停用词处理和TF-IDF统计展示前10个

日期: 2024-10-22

标签: 教育

停用词列表：

a
an
and
are
as
at
be
by
for
from
has
he
in
is
it
its
of
on
that
the
to
was
were
with

文本示例：

The quick brown fox jumped over the lazy dog. The dog didn't seem to care, and continued to lie there. The fox ran off into the woods.

去除停用词后的文本： quick brown fox jumped over lazy dog. dog didn't seem care, continued lie there. fox ran off woods.

TF-IDF统计结果：

| Term | TF-IDF | |------|--------| | fox | 0.6931 | | jumped | 0.6931 | | lazy | 0.6931 | | ran | 0.6931 | | woods | 0.6931 | | brown | 0.2877 | | care | 0.2877 | | dog | 0.2877 | | lie | 0.2877 | | off | 0.2877 |

前10个TF-IDF值最大的单词为：fox, jumped, lazy, ran, woods, brown, care, dog, lie, off

原文地址: https://www.cveoy.top/t/topic/hjO4 著作权归作者所有。请勿转载和采集!