|
Answer» Tokens- Sequence of characters that have a COLLECTIVE meaning. Patterns- There is a set of STRINGS in the input for which the same TOKEN is produced as output. This set of strings is described by a rule called a pattern associated with the token Lexeme- A sequence of characters in the source PROGRAM that is MATCHED by the pattern for a token. Tokens- Sequence of characters that have a collective meaning. Patterns- There is a set of strings in the input for which the same token is produced as output. This set of strings is described by a rule called a pattern associated with the token Lexeme- A sequence of characters in the source program that is matched by the pattern for a token.
|