Actions

CHARNN text generator

From Algolit

Revision as of 15:28, 25 October 2017 by Gijs (talk | contribs) (Created page with "The CharRNN text generator produces text using the CharRNN model. It is a recurrrent neural that reads a text character per character. In the training phase the model analyzes...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

The CharRNN text generator produces text using the CharRNN model. It is a recurrrent neural that reads a text character per character. In the training phase the model analyzes which characters occur after each other and learns the chances of the next character based on the previous character it has seen. The model has a memory that varies in size, in the learning process it can forget certain information it has seen as the network is constructed using Long Short Term Memory modules.

One of the first things the model learns is that words are separated by spaces and sentences are separated by a period, a space, followed by an uppercase. Although it might seem the model has learned a text is constructed out of multiple words and sentences it learned that after a certain amount of characters chances are high a space will occur and after more characters chances grow there'll be a period, a space and an uppercase character.

The generator interface is trained on various data-sets and can be tried out.