1.

The process of forming tokens from an input stream of characters is called __________(a) Liberalisation(b) Characterisation(c) Tokenization(d) None of the mentionedThis question was addressed to me during a job interview.This is a very interesting question from Lexical Analyser in division Finite Automata and Regular Expression of Compiler

Answer»

The correct option is (c) TOKENIZATION

The best explanation: The PROCESS of forming tokens from an input stream of CHARACTERS is called tokenization.



Discussion

No Comment Found

Related InterviewSolutions