SKETCH OF HOW RESEARCH MIGHT CONTINUE AND RESULTS BE PRESENTED - PREVIEW ONLY

Tokenisation

The preprocessor works on one or more streams of characters to produce a single stream of tokens, which becomes the working representation of what the compiler is to translate.

Interpretation of an input stream has a hierarchy:

• trigraphs
• line splices
• comments

Some general classes of token:

• identifiers
• character constants
• string constants