Python/libs/pygments-lexer-pseudocode2: pygments_lexer_pseudocode2/algpseudocode.py annotate

annotate pygments_lexer_pseudocode2/algpseudocode.py @ 111:d6f3a1d1bedd

Some more keywords (\FROM, \TO, \IN)

author	Franz Glasner <fzglas.hg@dom66.de>
date	Tue, 05 May 2026 17:37:58 +0200
parents	49e5aa89095f
children	ec8767cc5493

rev	line source
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1 # -- coding: utf-8 --
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2 # :-
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	3 # SPDX-FileCopyrightText: © 2026 Franz Glasner
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	4 # SPDX-License-Identifier: MIT
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	5 # :-
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	6 r"""A pseudocode lexer along the lines of CTAN's algpseudocode or
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	7 algpseudocodex.
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	8
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	9 """
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	10
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	11 __all__ = ["AlgPseudocodeLexer",
39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	12 "AlgPseudocodeLexer_DE", "AlgPseudocodeLexer_FR"]
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	13
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	14
89 7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	15 import logging
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	16 import re
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	17
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	18 import pygments.util
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	19 from pygments.lexer import bygroups, include, words
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	20 from pygments.token import (Comment, Generic, Keyword, Name, Operator,
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	21 Punctuation, Text, Whitespace)
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	22
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	23 #
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	24 # Relative imports do not work with pygments.lexers.load_lexer_from_file()
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	25 # in all of our supported Python releases.
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	26 #
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	27 from pygments_lexer_pseudocode2.bases import LexBase
85 ae5e741d2a9b Optimize op_explicit_tokentype(): use a pref-computed reversed pygments.token.STANDARD_TYPES Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	28 from pygments_lexer_pseudocode2.utils import REVERSED_STANDARD_TYPES
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	29 from pygments_lexer_pseudocode2 import uniprops
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	30
89 7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	31 #
7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	32 # As in the local imports: use an explicit name because __name__ is
7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	33 # __builtins__
7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	34 #
7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	35 _logger = logging.getLogger("pygments_lexer_pseudocode2.algpseudocode")
7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	36
7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	37
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	38 class AlgPseudocodeLexer(LexBase):
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	39
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	40 """A pseudocode lexer along the lines of CTAN's algpseudocode or
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	41 algpseudocodex.
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	42
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	43 Some ideas (e.g. strings) are borrowed from Pygment's Python lexer.
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	44
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	45 """
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	46
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	47 name = "AlgPseudocode"
39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	48 aliases = ["algpseudocode", "algpseudo"]
39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	49 filenames = [".algpseudo", ".algpseudocode"]
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	50 mimetypes = []
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	51 flags = re.MULTILINE
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	52
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	53 LANG = "en"
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	54 TRANSLATIONS = {
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	55 "PROG": "PROGRAM",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	56 "PROGRAM": "PROGRAM",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	57 "ALGO": "ALGORITHM",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	58 "ALGORITHM": "ALGORITHM",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	59 "PROC": "PROCEDURE",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	60 "PROCEDURE": "PROCEDURE",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	61 "FUNC": "FUNCTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	62 "FUNCTION": "FUNCTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	63 "FN": "FUNCTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	64 "CLASS": "CLASS",
99 857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	65 "INPUT": "Input:",
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	66 "INPUTS": "Inputs:",
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	67 "OUTPUT": "Output:",
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	68 "OUTPUTS": "Outputs:",
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	69 "RETURNS": "Returns:",
106 f6b46a379aba The "\ENSURE" command Franz Glasner <fzglas.hg@dom66.de> parents: 105 diff changeset	70 "ENSURE": "Ensure:",
61 392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	71 "IS": "IS",
82 36a0ef76a6d7 Implement "\WITH" Franz Glasner <fzglas.hg@dom66.de> parents: 81 diff changeset	72 "WITH": "WITH",
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	73 "IF": "IF",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	74 "THEN": "THEN",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	75 "ELSE": "ELSE",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	76 "ELSEIF": "ELSE IF",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	77 "ELSIF": "ELSE IF",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	78 "ELIF": "ELSE IF",
111 d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	79 "DO": "DO", # in WHILE ... DO
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	80 "WHILE": "WHILE",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	81 "FOR": "FOR",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	82 "FORALL": "FOR ALL",
111 d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	83 "FROM": "FROM",
d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	84 "TO": "TO",
d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	85 "IN": "IN", # as in FOR ... IN
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	86 "STEP": "STEP",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	87 "LOOP": "LOOP",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	88 "REPEAT": "REPEAT",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	89 "UNTIL": "UNTIL",
104 ffe6ea2cf69b Allow "\RETURN" and "\RETURNS" commands. Franz Glasner <fzglas.hg@dom66.de> parents: 103 diff changeset	90 "RETURN": "RETURN",
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	91 "BEGIN": "BEGIN",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	92 "END": "END", # not in END_TRANSLATIONS
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	93 }
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	94 END_TRANSLATIONS = {
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	95 "PROG": "END OF PROGRAM",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	96 "PROGRAM": "END OF PROGRAM",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	97 "ALGO": "END OF ALGORITHM",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	98 "ALGORITHM": "END OF ALGORITHM",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	99 "PROC": "END OF PROCEDURE",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	100 "PROCEDURE": "END OF PROCEDURE",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	101 "FUNC": "END OF FUNCTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	102 "FUNCTION": "END OF FUNCTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	103 "FN": "END OF FUNCTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	104 "CLASS": "END OF CLASS",
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	105 "IF": "END IF",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	106 "WHILE": "END WHILE",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	107 "FOR": "END FOR",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	108 "FORALL": "END FOR ALL",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	109 "LOOP": "END LOOP",
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	110 }
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	111 DEFAULT_END_PREFIX = "END OF "
58 be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	112 SYMBOL_REMARK = "▷" # U+25B7: Unicode 1.0 (Geometric Shapes)
be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	113 # SYMBOL_REMARK = "▻" # U+25BB: Unicode 1.0 (Geometric Shapes)
be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	114 SYMBOL_BLOCK = "◆" # U+25C6: Unicode 1.0 (Geometric Shapes)
be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	115 # SYMBOL_BLOCK = "┃" # U+2503: Unicode 1.0 (Bow Drawing)
be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	116 # SYMBOL_BLOCK = "●" # U+25CF: Unicode 1.0 (Geometric Shapes)
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	117 SYMBOL_TEXTSTATEMENT = "▪" # U+25AA: Unicode 1.0 (Geometric Shapes)
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	118 # SYMBOL_TEXTSTATEMENT = "■" # U+25A0: Unicode 1.0 (Geometric Shapes)
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	119 SYMBOLS = {
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	120 # Group REMARK
58 be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	121 "REMARK": SYMBOL_REMARK,
be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	122 "REM": SYMBOL_REMARK,
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	123 # Group STATEMENT
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	124 "STATEMENT": SYMBOL_BLOCK,
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	125 "STATE": SYMBOL_BLOCK,
58 be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	126 "BLOCK": SYMBOL_BLOCK,
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	127 # Group TEXTSTATEMENT
58 be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	128 "TEXTSTATEMENT": SYMBOL_TEXTSTATEMENT,
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	129 "TEXTSTATE": SYMBOL_TEXTSTATEMENT,
58 be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	130 "TSTATEMENT": SYMBOL_TEXTSTATEMENT,
be065e5c8042 Prepare symbols for a statement which defaults to token type "Text". Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	131 "TSTATE": SYMBOL_TEXTSTATEMENT,
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	132 "TEXTBLOCK": SYMBOL_TEXTSTATEMENT,
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	133 "TBLOCK": SYMBOL_TEXTSTATEMENT,
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	134 "<-": "←",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	135 "->": "→",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	136 "=>": "⇒",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	137 "<=": "≤",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	138 ">=": "≥",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	139 "<>": "≠",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	140 "!=": "≠",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	141 ":=": "∶=", # "≔" not recognizable
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	142 "=:": "=∶", # "≕", not recognizable
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	143 "<=>": "⇔",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	144 "<->": "↔",
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	145 "?=": "≟",
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	146 }
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	147
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	148 def op_translate(toktype):
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	149
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	150 def _op_translate(lexer, match, ctx=None):
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	151 kw = match.group().upper()
38 69522d4cafac Remove another unneeded local variable Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	152 yield match.start(), toktype, lexer.TRANSLATIONS.get(kw, kw)
83 cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	153 if ctx:
cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	154 ctx.pos = match.end()
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	155
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	156 return _op_translate
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	157
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	158 def op_opt_end_translate(toktype):
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	159
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	160 def _op_end_translate(lexer, match, ctx=None):
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	161 if not lexer.no_end:
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	162 kw = match.group().upper()
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	163 yield (match.start(),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	164 toktype,
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	165 lexer.END_TRANSLATIONS.get(
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	166 kw,
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	167 lexer.DEFAULT_END_PREFIX + kw))
83 cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	168 if ctx:
cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	169 ctx.pos = match.end()
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	170
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	171 return _op_end_translate
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	172
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	173 def op_opt_ignore(toktype):
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	174
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	175 def _op_opt_ignore(lexer, match, ctx=None):
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	176 if not lexer.no_end:
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	177 yield match.start(), toktype, match.group()
83 cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	178 if ctx:
cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	179 ctx.pos = match.end()
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	180
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	181 return _op_opt_ignore
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	182
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	183 def op_opt_ignore_or_fixed(toktype, value):
206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	184 """Yield a fixed given token type and value or -- if the lexer's
206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	185 `no_end` setting evals to ``True`` nothing.
65 3f4223a79d2b Normalize whitespace handling for entity names Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	186
3f4223a79d2b Normalize whitespace handling for entity names Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	187 """
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	188
206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	189 def _op_opt_ignore_or_fixed(lexer, match, ctx=None):
206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	190 if not lexer.no_end:
206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	191 yield match.start(), toktype, value
83 cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	192 if ctx:
cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	193 ctx.pos = match.end()
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	194
206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	195 return _op_opt_ignore_or_fixed
65 3f4223a79d2b Normalize whitespace handling for entity names Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	196
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	197 def op_symbol(toktype):
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	198
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	199 def _op_symbol(lexer, match, ctx=None):
64 05c53e431c88 Simplify case-handling for "BLOCK" and "REMARK" Franz Glasner <fzglas.hg@dom66.de> parents: 62 diff changeset	200 kw = match.group().upper()
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	201 yield match.start(), toktype, lexer.SYMBOLS.get(kw, kw)
83 cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	202 if ctx:
cd79d2c76347 If a Pygments callback gets a "Context" it must set the new position explicitely. Franz Glasner <fzglas.hg@dom66.de> parents: 82 diff changeset	203 ctx.pos = match.end()
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	204
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	205 return _op_symbol
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	206
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	207 def op_explicit_tokentype(lexer, match, ctx=None):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	208 needed_css = match.group("type")
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	209 toktype = REVERSED_STANDARD_TYPES.get(needed_css, None)
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	210 if toktype is None:
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	211 # Be more error friendly
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	212 toktype = Generic.Error
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	213 val = match.group()
89 7414eed7b275 Introduce logging for unhandled explicit token types Franz Glasner <fzglas.hg@dom66.de> parents: 87 diff changeset	214 _logger.warning("Unhandled explicit token type: %s", val)
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	215 else:
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	216 val = match.group("character")
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	217 yield match.start(), toktype, val
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	218 if ctx:
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	219 ctx.pos = match.end()
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	220
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	221 tokens = {
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	222 "root": [
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	223 (r"\n", Whitespace),
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	224 (r"/\*", Comment.Multiline, "multiline-nested-comment"),
100 7cfad325d3bb Allow also `#' to start single-line comments Franz Glasner <fzglas.hg@dom66.de> parents: 99 diff changeset	225 (r"(//\|#).*$", Comment.Single),
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	226 include("remark"),
90 2af4684c8e78 Restrict whitespace before required and optional arguments. Franz Glasner <fzglas.hg@dom66.de> parents: 89 diff changeset	227 (r"(?i)\\(block\|state(?:ment)?)[ \t]*(\{)",
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	228 bygroups(op_symbol(Text), LexBase.op_fixed(Whitespace, " ")),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	229 "block-expr"),
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	230 (r"(?i)\\("
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	231 r"(?:textstate(?:ment)?)"
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	232 r"\|(?:tstate(?:ment)?)"
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	233 r"\|(?:textblock)"
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	234 r"\|(?:tblock)"
90 2af4684c8e78 Restrict whitespace before required and optional arguments. Franz Glasner <fzglas.hg@dom66.de> parents: 89 diff changeset	235 r")[ \t]*(\{)",
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	236 bygroups(op_symbol(Text), LexBase.op_fixed(Whitespace, " ")),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	237 "text-statement"),
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	238 (r"(?i)\\("
99 857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	239 r"(?:input(?:s)?)"
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	240 r"\|(?:output(?:s)?)"
108 6cebd3e7bc97 Also allow \REM within a \TEXT{} Franz Glasner <fzglas.hg@dom66.de> parents: 106 diff changeset	241 r"\|(?:ensure)"
104 ffe6ea2cf69b Allow "\RETURN" and "\RETURNS" commands. Franz Glasner <fzglas.hg@dom66.de> parents: 103 diff changeset	242 r"\|(?:returns)"
99 857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	243 r")[ \t]*(\{)",
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	244 bygroups(op_translate(Keyword),
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	245 LexBase.op_fixed(Whitespace, " ")),
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	246 "text-statement"),
857df2064831 \INPUT, \INPUTS, \OUTPUT, \OUTPUTS, \RETURN and \RETURNS as new commands (keywords) Franz Glasner <fzglas.hg@dom66.de> parents: 98 diff changeset	247 (r"(?i)\\("
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	248 r"(?:if)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	249 r"\|(?:then)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	250 r"\|(?:else)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	251 r"\|(?:el(?:s(?:e)?)?if)"
111 d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	252 r"\|(?:do)" # as in WHILE ... DO not DO ... UNTIL
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	253 r"\|(?:while)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	254 r"\|(?:forall)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	255 r"\|(?:for)"
111 d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	256 r"\|(?:from)"
d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	257 r"\|(?:to)"
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	258 r"\|(?:step)"
111 d6f3a1d1bedd Some more keywords (\FROM, \TO, \IN) Franz Glasner <fzglas.hg@dom66.de> parents: 109 diff changeset	259 r"\|(?:in)"
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	260 r"\|(?:loop)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	261 r"\|(?:repeat)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	262 r"\|(?:until)"
104 ffe6ea2cf69b Allow "\RETURN" and "\RETURNS" commands. Franz Glasner <fzglas.hg@dom66.de> parents: 103 diff changeset	263 r"\|(?:return)"
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	264 r")\b",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	265 bygroups(op_translate(Keyword))),
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	266 (r"\\\n", Text),
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	267 (r"(?i)\\("
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	268 r"(?:prog(?:ram)?)"
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	269 r"\|(?:algo(?:rithm)?)"
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	270 r"\|(?:proc(?:edure)?)"
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	271 r"\|(?:func(?:tion)?\|(?:fn))"
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	272 r"\|(?:class)"
90 2af4684c8e78 Restrict whitespace before required and optional arguments. Franz Glasner <fzglas.hg@dom66.de> parents: 89 diff changeset	273 r")[ \t]*(\{)",
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	274 bygroups(op_translate(Keyword),
206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	275 LexBase.op_fixed(Whitespace, " ")),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	276 "entity-name"),
94 dc17b778a52b Refactor \END variants Franz Glasner <fzglas.hg@dom66.de> parents: 93 diff changeset	277 # ENDxxx keywords with optional entity name in two parts:
dc17b778a52b Refactor \END variants Franz Glasner <fzglas.hg@dom66.de> parents: 93 diff changeset	278 # 1. with name
dc17b778a52b Refactor \END variants Franz Glasner <fzglas.hg@dom66.de> parents: 93 diff changeset	279 (r"(?i)\\end(?:[_\-]\|(?:[ \t]+))?("
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	280 r"(?:prog(?:ram)?)"
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	281 r"\|(?:algo(?:rithm)?)"
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	282 r"\|(?:proc(?:edure)?)"
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	283 r"\|(?:func(?:tion)?)"
96 98cd0787f62f FIX: FN alias for function Franz Glasner <fzglas.hg@dom66.de> parents: 94 diff changeset	284 r"\|(?:fn)"
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	285 r"\|(?:class)"
94 dc17b778a52b Refactor \END variants Franz Glasner <fzglas.hg@dom66.de> parents: 93 diff changeset	286 r")(?:[_\-]\|(?:[\t ]+))?(\{)",
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	287 bygroups(op_opt_end_translate(Keyword),
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	288 op_opt_ignore_or_fixed(Whitespace, " ")),
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	289 "entity-name-end"),
94 dc17b778a52b Refactor \END variants Franz Glasner <fzglas.hg@dom66.de> parents: 93 diff changeset	290 # 2. without name
dc17b778a52b Refactor \END variants Franz Glasner <fzglas.hg@dom66.de> parents: 93 diff changeset	291 # 3. AND keywords that do not allow a param (e.g. endif)
dc17b778a52b Refactor \END variants Franz Glasner <fzglas.hg@dom66.de> parents: 93 diff changeset	292 (r"(?i)\\end(?:[_\-]\|(?:[ \t]+))?("
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	293 r"(?:prog(?:ram)?)"
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	294 r"\|(?:algo(?:rithm)?)"
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	295 r"\|(?:proc(?:edure)?)"
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	296 r"\|(?:func(?:tion)?)"
96 98cd0787f62f FIX: FN alias for function Franz Glasner <fzglas.hg@dom66.de> parents: 94 diff changeset	297 r"\|(?:fn)"
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	298 r"\|(?:class)"
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	299 r"\|(?:if)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	300 r"\|(?:while)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	301 r"\|(?:for)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	302 r"\|(?:forall)"
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	303 r"\|(?:loop)"
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	304 r")\b",
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	305 bygroups(op_opt_end_translate(Keyword))),
97 dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	306 #
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	307 # A single begin or end that is never suppressed because
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	308 # it is supposed to be paired with begin
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	309 #
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	310 (r"(?i)\\(begin\|end)\b",
dd4eb937485c A couple of new keywords Franz Glasner <fzglas.hg@dom66.de> parents: 96 diff changeset	311 bygroups(op_translate(Keyword))),
61 392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	312 # Keywords
392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	313 (r"(?i)\\("
392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	314 r"(?:is)"
82 36a0ef76a6d7 Implement "\WITH" Franz Glasner <fzglas.hg@dom66.de> parents: 81 diff changeset	315 r"\|(?:with)"
61 392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	316 r")\b",
392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	317 bygroups(op_translate(Keyword))),
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	318 include("expr"),
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	319 include("unicode-separators"),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	320 include("unicode-other"),
91 feb41c8d72d2 Instead of "\s+" use "[^\S\n]+" because a \n is not wanted really in this match. Franz Glasner <fzglas.hg@dom66.de> parents: 90 diff changeset	321 (r"[^\S\n]+", Text),
98 c1f93e109798 More tolerance for errors: yield more Generic.Error tokens Franz Glasner <fzglas.hg@dom66.de> parents: 97 diff changeset	322 (r".", Generic.Error), # tolerance for errors
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	323 ],
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	324 "remark": [
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	325 (r"(?i)\\(remark\|rem)\b(.*)$",
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	326 bygroups(op_symbol(Comment.Single), Comment.Single)),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	327 ],
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	328 "entity-name": [ # may be multiline
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	329 (r"[^\\}]+", Name.Entity),
77 1a5e192aa950 Move popping states consistently more to the begin Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	330 (r"\}", LexBase.op_ignore, "#pop"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	331 (r"\\\}", LexBase.op_fixed(Name.Entity, "}")),
76 27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	332 (r"\\\\", LexBase.op_fixed(Name.Entity, "\\")),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	333 (r"\\", LexBase.op_fixed(Name.Entity, "\\")),
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	334 ],
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	335 "entity-name-end": [ # may be multiline -- suppressed if no_end
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 61 diff changeset	336 (r"[^\\}]+", op_opt_ignore(Name.Entity)),
77 1a5e192aa950 Move popping states consistently more to the begin Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	337 (r"\}", LexBase.op_ignore, "#pop"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	338 (r"\\\}", op_opt_ignore_or_fixed(Name.Entity, "}")),
76 27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	339 (r"\\\\", op_opt_ignore_or_fixed(Name.Entity, "\\")),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	340 (r"\\", op_opt_ignore_or_fixed(Name.Entity, "\\")),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	341 ],
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	342 "expr": [
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	343 include("math-symbols"), # must be before punctuation
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	344 include("ascii-punctuation"),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	345 include("unicode-punctuation"),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	346 include("escaped-string-start"),
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	347 include("py-strings"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	348 include("py-numbers"),
90 2af4684c8e78 Restrict whitespace before required and optional arguments. Franz Glasner <fzglas.hg@dom66.de> parents: 89 diff changeset	349 (r"(?i)\\text[ \t]*\{", LexBase.op_ignore, "text-in-expr"),
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	350 include("explicit-tokentype"),
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	351 include("remark"),
81 6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	352 include("keyword-constants"),
93 84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	353 include("word-operators"),
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	354 include("math-builtins"),
52 5bfa9113d3c4 First tests with "py-name": names from the Python lexer Franz Glasner <fzglas.hg@dom66.de> parents: 41 diff changeset	355 include("py-name"),
70 5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 65 diff changeset	356 ],
80 f487f0d322a5 Move "expr-in-braces" up to "expr". Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	357 "expr-in-braces": [
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	358 include("math-symbols"), # must be before punctuation
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	359 include("ascii-punctuation-in-braces"),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	360 include("unicode-punctuation"),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	361 include("escaped-string-start"),
80 f487f0d322a5 Move "expr-in-braces" up to "expr". Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	362 include("py-strings"),
f487f0d322a5 Move "expr-in-braces" up to "expr". Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	363 include("py-numbers"),
90 2af4684c8e78 Restrict whitespace before required and optional arguments. Franz Glasner <fzglas.hg@dom66.de> parents: 89 diff changeset	364 (r"(?i)\\text[ \t]*\{", LexBase.op_ignore, "text-in-expr"),
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	365 include("explicit-tokentype"),
80 f487f0d322a5 Move "expr-in-braces" up to "expr". Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	366 include("remark"),
81 6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	367 include("keyword-constants"),
93 84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	368 include("word-operators"),
80 f487f0d322a5 Move "expr-in-braces" up to "expr". Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	369 include("math-builtins"),
f487f0d322a5 Move "expr-in-braces" up to "expr". Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	370 include("py-name"),
f487f0d322a5 Move "expr-in-braces" up to "expr". Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	371 ],
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	372 "block-expr": [ # somewhat similar to "root"
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	373 (r"\}", LexBase.op_ignore, "#pop"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	374 (r"\n", Whitespace),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	375 include("expr-in-braces"),
76 27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	376 (r"\\\\", LexBase.op_fixed(Text, "\\")),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	377 (r"\\", LexBase.op_fixed(Text, "\\")),
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	378 include("unicode-separators"),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	379 include("unicode-other"),
91 feb41c8d72d2 Instead of "\s+" use "[^\S\n]+" because a \n is not wanted really in this match. Franz Glasner <fzglas.hg@dom66.de> parents: 90 diff changeset	380 (r"[^\S\n]+", Text),
98 c1f93e109798 More tolerance for errors: yield more Generic.Error tokens Franz Glasner <fzglas.hg@dom66.de> parents: 97 diff changeset	381 (r".", Generic.Error), # tolerance for errors
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	382 ],
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	383 "text-statement": [ # like block but default to text-mode
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	384 (r"[^\\}\n]+", Text),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	385 (r"\}", LexBase.op_ignore, "#pop"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	386 (r"\n", Whitespace),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	387 (r"\\\}", LexBase.op_fixed(Text, "}")),
90 2af4684c8e78 Restrict whitespace before required and optional arguments. Franz Glasner <fzglas.hg@dom66.de> parents: 89 diff changeset	388 (r"(?i)\\expr(?:ession)?[ \t]*\{",
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	389 LexBase.op_ignore,
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	390 "block-expr"),
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	391 include("explicit-tokentype"),
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	392 include("remark"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	393 (r"\\\\", LexBase.op_fixed(Text, "\\")),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	394 (r"\\", LexBase.op_fixed(Text, "\\")),
98 c1f93e109798 More tolerance for errors: yield more Generic.Error tokens Franz Glasner <fzglas.hg@dom66.de> parents: 97 diff changeset	395 (r".", Generic.Error), # tolerance for errors
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	396 ],
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	397 "text-in-expr": [
77 1a5e192aa950 Move popping states consistently more to the begin Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	398 (r"[^\\}\n]+", Text),
1a5e192aa950 Move popping states consistently more to the begin Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	399 (r"\}", LexBase.op_ignore, "#pop"),
1a5e192aa950 Move popping states consistently more to the begin Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	400 (r"\n", Whitespace),
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	401 (r"\\\}", LexBase.op_fixed(Text, "}")),
92 3f37832c405d FIX: Wrong state for \TEXT command Franz Glasner <fzglas.hg@dom66.de> parents: 91 diff changeset	402 (r"(?i)\\expr(?:ession)?[ \t]*\{",
3f37832c405d FIX: Wrong state for \TEXT command Franz Glasner <fzglas.hg@dom66.de> parents: 91 diff changeset	403 LexBase.op_ignore,
3f37832c405d FIX: Wrong state for \TEXT command Franz Glasner <fzglas.hg@dom66.de> parents: 91 diff changeset	404 "block-expr"),
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	405 include("explicit-tokentype"),
108 6cebd3e7bc97 Also allow \REM within a \TEXT{} Franz Glasner <fzglas.hg@dom66.de> parents: 106 diff changeset	406 include("remark"),
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 77 diff changeset	407 (r"\\\\", LexBase.op_fixed(Text, "\\")),
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	408 (r"\\", LexBase.op_fixed(Text, "\\")),
98 c1f93e109798 More tolerance for errors: yield more Generic.Error tokens Franz Glasner <fzglas.hg@dom66.de> parents: 97 diff changeset	409 (r".", Generic.Error), # tolerance for errors
70 5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 65 diff changeset	410 ],
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	411 "math-builtins": [
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	412 (words(("sqrt", "pow", "cos", "sin", "tan", "arcos", "arcsin",
102 d8368294413a "min" and "max" as automatic mathematical operators Franz Glasner <fzglas.hg@dom66.de> parents: 100 diff changeset	413 "arctan", "arctan2", "mod", "exp", "ln", "log",
d8368294413a "min" and "max" as automatic mathematical operators Franz Glasner <fzglas.hg@dom66.de> parents: 100 diff changeset	414 "min", "max"),
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	415 prefix=r"(?<!\.)",
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	416 suffix=r"\b"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	417 Name.Builtin),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	418 ],
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	419 "math-symbols": [
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	420 (r"<=>\|<->\|<-\|->\|=>\|<=\|>=\|<>\|!=\|:=\|=:\|\?=", op_symbol(Operator)),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	421 (r"[!&<>=+\-*/%\|~]", Operator), # ASCII
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	422 (u"[%s]" % (uniprops.Sm,), Operator), # other Unicode
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	423 ],
93 84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	424 "word-operators": [
84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	425 (words(("IN", "In", "in",
84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	426 "IS", "Is", "is",
84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	427 "AND", "And", "and",
84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	428 "OR", "Or", "or",
84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	429 "XOR", "Xor", "xor",
84c0f761c836 Renamed "text-operators" to "word-operators" and allow more case-variants Franz Glasner <fzglas.hg@dom66.de> parents: 92 diff changeset	430 "NOT", "Not", "not"),
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	431 prefix=r"(?<!\.)",
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	432 suffix=r"\b"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	433 Operator.Word),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	434 ],
81 6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	435 "keyword-constants": [
6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	436 (words(("True", "TRUE", "true", "False", "FALSE", "false",
103 af97692501ea FIX: Typo: "non" -> "none" Franz Glasner <fzglas.hg@dom66.de> parents: 102 diff changeset	437 "None", "NONE", "none", "Nil", "NIL", "nil",
81 6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	438 "Null", "NULL", "null",
6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	439 "Empty", "EMPTY", "empty"),
6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	440 prefix=r"(?<!\.)",
6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	441 suffix=r"\b"),
6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	442 Keyword.Constant),
6d8b813fb296 Keyword constants like "True", "False", "Nil", "None", "Null" and "Empty" Franz Glasner <fzglas.hg@dom66.de> parents: 80 diff changeset	443 ],
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	444 "ascii-punctuation": [
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	445 (r"[{}:(),;[\]?@]", Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	446 ],
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	447 "ascii-punctuation-in-braces": [
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	448 #
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	449 # Like "punctuation" but needs an escaped curly brace for } because
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	450 # a single closing curly brace pops the current state here.
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	451 #
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	452 (r"\\\}", LexBase.op_fixed(Punctuation, "}")),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	453 (r"[{:(),;[\]?@]", Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	454 ],
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	455 "unicode-separators": [
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	456 (u"[%s]" % (uniprops.Zl,), Whitespace),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	457 (u"[%s]" % (uniprops.Zp,), Whitespace),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	458 (u"[%s]" % (uniprops.Zs,), Whitespace),
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	459 ],
105 cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	460 "unicode-punctuation": [
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	461 (u"[%s]" % (uniprops.Pc,), Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	462 (u"[%s]" % (uniprops.Pd,), Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	463 (u"[%s]" % (uniprops.Ps,), Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	464 (u"[%s]" % (uniprops.Pe,), Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	465 (u"[%s]" % (uniprops.Pi,), Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	466 (u"[%s]" % (uniprops.Pf,), Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	467 (u"[%s]" % (uniprops.Po,), Punctuation),
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	468 ],
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	469 "unicode-other": [
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	470 (u"[%s]" % (uniprops.Sc,), Text), # Currency
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	471 (u"[%s]" % (uniprops.So,), Text), # Other symbols
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	472 ],
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	473 "escaped-string-start": [
cec52d83869a Handle much more characters from the Unicode codeset in expressions. Franz Glasner <fzglas.hg@dom66.de> parents: 104 diff changeset	474 (r"""\\(['"])""", bygroups(Punctuation)),
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	475 ],
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	476 "explicit-tokentype": [
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	477 # All these REs are CASE-SENSITIVE!
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	478
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	479 # Multiple characters possible, but no escaping!
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	480 (r"\\ttx\-(?P<type>[a-zA-Z0-9_-]+?)(?P<sep>[/:\|=*+!\$~])"
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	481 r"(?P<character>(.\|\n)+?)(?P=sep)",
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	482 op_explicit_tokentype),
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	483 (r"\\ttx\-(?P<type>[a-zA-Z0-9_-]+?)\{(?P<character>[^}]+?)\}",
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	484 op_explicit_tokentype),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	485 (r"\\ttx\-(?P<type>[a-zA-Z0-9_-]+?)$(?P<character>[^)]+?)$",
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	486 op_explicit_tokentype),
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	487 (r"\\ttx\-(?P<type>[a-zA-Z0-9_-]+?)<(?P<character>[^>]+?)>",
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	488 op_explicit_tokentype),
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	489 (r"\\ttx\-(?P<type>[a-zA-Z0-9_-]+?)\[(?P<character>[^\]]+?)\]",
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	490 op_explicit_tokentype),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	491
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	492 # Every character is possible: no escaping needed!
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 85 diff changeset	493 (r"\\tt-(?P<type>[^/]+?)/(?P<character>(?:.\|\n))",
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	494 op_explicit_tokentype),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 83 diff changeset	495 ],
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	496 }
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	497
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	498 def __init__(self, **options):
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	499 val = pygments.util.get_bool_opt(options, "no_end", default=False)
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	500 self.no_end = val
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	501 LexBase.__init__(self, **options)
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	502
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	503
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	504 class AlgPseudocodeLexer_DE(AlgPseudocodeLexer):
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	505
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	506 name = "AlgPseudocodeDE"
39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	507 aliases = ["algpseudocode-de", "algpseudo-de"]
39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	508 filenames = [".algpseudo-de", ".algpseudocode-de"]
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	509
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	510 LANG = "de"
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	511 TRANSLATIONS = AlgPseudocodeLexer.TRANSLATIONS.copy()
41 4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	512 TRANSLATIONS.update({
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	513 "PROG": "PROGRAMM",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	514 "PROGRAM": "PROGRAMM",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	515 "ALGO": "ALGORITHMUS",
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 38 diff changeset	516 "ALGORITHM": "ALGORITHMUS",
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	517 "PROC": "PROZEDUR",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	518 "PROCEDURE": "PROZEDUR",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	519 "FUNC": "FUNKTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	520 "FUNCTION": "FUNKTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	521 "FN": "FUNKTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	522 "CLASS": "KLASSE",
61 392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	523 "IS": "IST",
82 36a0ef76a6d7 Implement "\WITH" Franz Glasner <fzglas.hg@dom66.de> parents: 81 diff changeset	524 "WITH": "MIT",
41 4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	525 })
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	526 END_TRANSLATIONS = AlgPseudocodeLexer.END_TRANSLATIONS.copy()
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	527 END_TRANSLATIONS.update({
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	528 "PROG": "ENDE DES PROGRAMMS",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	529 "PROGRAM": "ENDE VON PROGRAMMS",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	530 "ALGO": "ENDE DES ALGORITHMUS",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	531 "ALGORITHM": "ENDE DES ALGORITHMUS",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	532 "PROC": "ENDE DER PROZEDUR",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	533 "PROCEDURE": "ENDE DER PROZEDUR",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	534 "FUNC": "ENDE DER FUNKTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	535 "FUNCTION": "ENDE DER FUNKTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	536 "FN": "ENDE DER FUNKTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	537 "CLASS": "ENDE DER KLASSE",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	538 })
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	539 DEFAULT_END_PREFIX = "ENDE VON "
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	540
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	541
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	542 class AlgPseudocodeLexer_FR(AlgPseudocodeLexer):
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	543
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	544 name = "AlgPseudocodeFR"
39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	545 aliases = ["algpseudocode-fr", "algpseudo-fr"]
39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	546 filenames = [".algpseudo-fr", ".algpseudocode-fr"]
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	547
109 49e5aa89095f FIX: LANG for the french lexer Franz Glasner <fzglas.hg@dom66.de> parents: 108 diff changeset	548 LANG = "fr"
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 52 diff changeset	549 TRANSLATIONS = AlgPseudocodeLexer.TRANSLATIONS.copy()
41 4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	550 TRANSLATIONS.update({
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	551 "PROG": "PROGRAMME",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	552 "PROGRAM": "PROGRAMME",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	553 "ALGO": "ALGORITHME",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	554 "ALGORITHM": "ALGORITHME",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	555 "PROC": "PROCÉDURE",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	556 "PROCEDURE": "PROCÉDURE",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	557 "FUNC": "FONCTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	558 "FUNCTION": "FOUNCTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	559 "FN": "FONCTION",
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	560 "CLASS": "CLASSE",
61 392745b66969 The "\IS" keyword expansion Franz Glasner <fzglas.hg@dom66.de> parents: 58 diff changeset	561 "IS": "EST",
82 36a0ef76a6d7 Implement "\WITH" Franz Glasner <fzglas.hg@dom66.de> parents: 81 diff changeset	562 "WITH": "AVEC",
41 4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	563 })
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	564 END_TRANSLATIONS = AlgPseudocodeLexer.END_TRANSLATIONS.copy()
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	565 END_TRANSLATIONS.update({
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	566 "PROG": "FIN DE PROGRAMME",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	567 "PROGRAM": "FIN DE PROGRAMME",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	568 "ALGO": "FIN D'ALGORITHME",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	569 "ALGORITHM": "FIN D'ALGORITHME",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	570 "PROC": "FIN DE PROCÉDURE",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	571 "PROCEDURE": "FIN DE PROCÉDURE",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	572 "FUNC": "FIN DE FONCTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	573 "FUNCTION": "FIN DE FOUNCTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	574 "FN": "FIN DE FONCTION",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	575 "CLASS": "FIN DE CLASSE",
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	576 })
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	577 DEFAULT_END_PREFIX = "FIN DE "

Mercurial > hgrepos > Python > libs > pygments-lexer-pseudocode2

annotate pygments_lexer_pseudocode2/algpseudocode.py @ 111:d6f3a1d1bedd