个人网站：ipengtao.com
N-gram是自然语言处理中常用的技术，它可以用于文本生成、语言模型训练等任务。本文将介绍什么是n-gram，如何在Python中实现n-gram文本生成，并提供丰富的示例代码来帮助大家更好地理解和应用这一技术。
什么是N-gram？
N-gram是自然语言处理中的一种文本建模技术，用于对文本数据进行分析和生成。它是一种基于n个连续词语或字符的序列模型，其中n表示n-gram的大小。通常，n的取值为1、2、3等。
N-gram模型通过分析文本中不同n-gram的出现频率，可以用于文本分类、文本生成、语言模型等任务。
实现N-gram文本生成
下面将演示如何在Python中实现N-gram文本生成。将使用一个简单的示例来说明这一过程。
1 准备文本数据
首先，需要准备一些文本数据，这将作为训练数据。这里使用了莎士比亚的一些文本作为示例数据，可以使用自己的文本数据。
text = """
To be or not to be, that is the question;
Whether 'tis nobler in the mind to suffer
The slings and arrows of outrageous fortune,
Or to take arms against a sea of troubles
And by opposing end them. To die—to sleep,
No more; and by a sleep to say we end
The heart-ache and the thousand natural shocks
That flesh is heir to, 'tis a consummation
Devoutly to be wish'd. To die, to sleep;
To sleep, perchance to dream—ay, there's the rub,
For in that sleep of death what dreams may come,
When we have shuffled off this mortal coil,
Must give us pause—there's the respect
That makes calamity of so long life;
The oppressor's wrong, the proud man's contumely,
The pangs of despis'd love, the law's delay,
The insolence of office, and the spurns
That patient merit of the unworthy takes,
When he himself might his quietus make
With a bare bodkin? Who would these fardels bear,
To grunt and sweat under a weary life,
But that the dread of something after death—
The undiscover'd country, from whose bourn
No traveller returns—puzzles the will,
And makes us rather bear those ills we have
Than fly to others that we know not of?
Thus conscience does make cowards of us all;
And thus the native hue of resolution
Is sicklied o'er with the pale cast of thought,
And enterprises of great pith and moment
With this regard their currents turn awry,
And lose the name of action.
"""
# 去掉换行符，并将文本转换为小写
text = text.replace('\n', ' ').lower(