Generative AI for everyone

Loading course content...

Recognizing Token Boundaries

Question 1 of 4

According to the lesson, which of these is the best description of a 'token'?

A piece of text, which could be a whole word or just part of a word.

A complete word, exactly as a human reads it.

A single letter of the alphabet.

A grammatically correct and properly spelled word.