Python/libs/pygments-lexer-pseudocode2: tests/test

annotate tests/test_algpseudo.py @ 87:d8ca835c74ea

FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Need to restrict the tokentype group because otherwise it would match too much if some sort of braces are mixed on a single line.

author	Franz Glasner <fzglas.hg@dom66.de>
date	Sat, 02 May 2026 10:07:59 +0200
parents	3ac1c4502ad0
children	3f37832c405d

rev	line source
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1 # -- coding: utf-8 --
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2 # :-
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	3 # SPDX-FileCopyrightText: © 2026 Franz Glasner
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	4 # SPDX-License-Identifier: MIT
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	5 # :-
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	6
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 43 diff changeset	7 from _tsetup import ALGLEXERFILENAME, ALGLEXERCLASS
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	8
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	9 import sys
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	10 import unittest
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	11
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	12 import pygments
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	13 import pygments.lexers
66 9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	14 import pygments.formatters
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	15
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	16 import _testhelper
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	17
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	18
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	19 class TestSnippets(unittest.TestCase, _testhelper.TokenAssertHelper):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	20
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	21 def setUp(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	22 self.lexer = pygments.lexers.load_lexer_from_file(
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 43 diff changeset	23 ALGLEXERFILENAME, ALGLEXERCLASS)
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	24
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	25 def test_lf(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	26 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	27 [("Text.Whitespace", "\n")],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	28 pygments.lex("\n", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	29
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	30 def test_protected_lf(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	31 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	32 [("Text", "\\\n")],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	33 pygments.lex("\\\n", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	34
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	35 def test_number_int(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	36 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	37 [("Number.Integer", "10"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	38 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	39 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	40 pygments.lex("10", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	41
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	42 def test_number_float_1(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	43 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	44 [("Number.Float", "3.1415926"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	45 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	46 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	47 pygments.lex("3.1415926", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	48
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	49 def test_number_float_2(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	50 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	51 [("Number.Float", "3.14e-12"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	52 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	53 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	54 pygments.lex("3.14e-12", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	55
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	56 def test_string_s_1(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	57 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	58 [("String.Single", "'"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	59 ("String.Single", "HU"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	60 ("String.Single", '"'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	61 ("String.Single", "HE HA"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	62 ("String.Escape", "\\'"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	63 ("String.Single", "HO"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	64 ("String.Single", "'"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	65 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	66 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	67 pygments.lex("""'HU"HE HA\\'HO'""", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	68
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	69 def test_string_s_2(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	70 self.assertTokenStreamEqual(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	71 [("String.Single", "'"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	72 ("String.Single", "HUHU"),
43 bbef0ac6cfcf FIX: Proper string parsing: explicitely error out when single-line strings contain a linefeed Franz Glasner <fzglas.hg@dom66.de> parents: 41 diff changeset	73 ("Error", "\n"),
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	74 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	75 pygments.lex("'HUHU\nHEHE'", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	76
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	77 def test_string_ts_1(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	78 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	79 [("String.Single", "'''"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	80 ("String.Single", "HUHU HEHE"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	81 ("String.Single", "'''"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	82 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	83 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	84 pygments.lex("'''HUHU HEHE'''", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	85
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	86 def test_string_ts_2(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	87 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	88 [("String.Single", "'''"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	89 ("String.Single", "HI"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	90 ("String.Single", "'"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	91 ("String.Single", "HU"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	92 ("String.Single", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	93 ("String.Single", "HE"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	94 ("String.Single", '"'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	95 ("String.Single", "HA"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	96 ("String.Single", "'''"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	97 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	98 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	99 pygments.lex("""'''HI'HU\nHE"HA'''""", self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	100
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	101 def test_string_d_1(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	102 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	103 [("String.Double", '"'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	104 ("String.Double", 'HU'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	105 ("String.Double", "'"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	106 ("String.Double", 'HE HA'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	107 ("String.Escape", '\\"'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	108 ("String.Double", 'HO'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	109 ("String.Double", '"'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	110 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	111 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	112 pygments.lex('''"HU'HE HA\\"HO"''', self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	113
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	114 def test_string_d_2(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	115 self.assertTokenStreamEqual(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	116 [("String.Double", '"'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	117 ("String.Double", "HUHU"),
43 bbef0ac6cfcf FIX: Proper string parsing: explicitely error out when single-line strings contain a linefeed Franz Glasner <fzglas.hg@dom66.de> parents: 41 diff changeset	118 ("Error", "\n"),
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	119 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	120 pygments.lex('"HUHU\nHEHE"', self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	121
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	122 def test_string_td_1(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	123 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	124 [("String.Double", '"""'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	125 ("String.Double", 'HUHU HAHA'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	126 ("String.Double", '"""'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	127 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	128 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	129 pygments.lex('"""HUHU HAHA"""', self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	130
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	131 def test_string_td_2(self):
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	132 self.assertTokenStreamEqualComplete(
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	133 [("String.Double", '"""'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	134 ("String.Double", 'HU'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	135 ("String.Double", '"'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	136 ("String.Double", "HO"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	137 ("String.Double", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	138 ("String.Double", "HE"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	139 ("String.Double", "'"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	140 ("String.Double", "HA"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	141 ("String.Double", '"""'),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	142 ("Text.Whitespace", "\n"),
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	143 ],
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	144 pygments.lex('''"""HU"HO\nHE'HA"""''', self.lexer))
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	145
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	146 def test_proc(self):
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	147 self.assertTokenStreamEqualComplete(
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	148 [("Keyword", "PROCEDURE"),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	149 ("Text.Whitespace", " "),
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	150 ("Name.Entity", "the name"),
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	151 ("Text.Whitespace", "\n"),
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	152 ],
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	153 pygments.lex("\\PROC {the name}", self.lexer))
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	154
79 c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	155 def test_proc_with_escape_in_name(self):
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	156 self.assertTokenStreamEqualComplete(
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	157 [("Keyword", "PROCEDURE"),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	158 ("Text.Whitespace", " "),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	159 ("Name.Entity", "t"),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	160 ("Name.Entity", "\\"),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	161 ("Name.Entity", "he "),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	162 ("Name.Entity", "\\"),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	163 ("Name.Entity", "}"),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	164 ("Name.Entity", "name"),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	165 ("Text.Whitespace", "\n"),
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	166 ],
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	167 pygments.lex(r"\PROC {t\he \\\}name}", self.lexer))
c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	168
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	169 def test_endproc(self):
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	170 self.assertTokenStreamEqualComplete(
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	171 [("Keyword", "END OF PROCEDURE"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	172 ("Text.Whitespace", "\n"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	173 ],
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	174 pygments.lex("\\END-PROCEDURE", self.lexer))
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	175
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	176 def test_endproc_with_entityname(self):
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	177 self.assertTokenStreamEqualComplete(
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	178 [("Keyword", "END OF PROCEDURE"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	179 ("Text.Whitespace", " "),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	180 ("Name.Entity", "the procedure name"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	181 ("Text.Whitespace", "\n"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	182 ],
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	183 pygments.lex("\\ENDPROCEDURE {the procedure name}", self.lexer))
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	184
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	185 def test_proc_de(self):
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	186 lexer = pygments.lexers.load_lexer_from_file(
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 43 diff changeset	187 ALGLEXERFILENAME, "AlgPseudocodeLexer_DE")
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	188 self.assertTokenStreamEqualComplete(
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	189 [("Keyword", "PROZEDUR"),
69 b3dd247b27a5 FIX: Add forgotten tests for the new normalized highlighting Franz Glasner <fzglas.hg@dom66.de> parents: 66 diff changeset	190 ("Text.Whitespace", " "),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	191 ("Name.Entity", " also {nichtxs"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	192 ("Name.Entity", "}"),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	193 ("Name.Entity", " hier"),
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	194 ("Text.Whitespace", "\n"),
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	195 ],
79 c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	196 pygments.lex(r"\PROC { also {nichtxs\} hier}", lexer))
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	197
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	198 def test_function_1(self):
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	199 self.assertTokenStreamEqualComplete(
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	200 [("Keyword", "FUNCTION"),
69 b3dd247b27a5 FIX: Add forgotten tests for the new normalized highlighting Franz Glasner <fzglas.hg@dom66.de> parents: 66 diff changeset	201 ("Text.Whitespace", " "),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	202 ("Name.Entity", "1"),
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	203 ("Text.Whitespace", "\n"),
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	204 ],
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	205 pygments.lex("\\FUNC{1}", self.lexer))
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	206
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	207 def test_function_2(self):
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	208 self.assertTokenStreamEqualComplete(
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	209 [("Keyword", "FUNCTION"),
69 b3dd247b27a5 FIX: Add forgotten tests for the new normalized highlighting Franz Glasner <fzglas.hg@dom66.de> parents: 66 diff changeset	210 ("Text.Whitespace", " "),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	211 ("Name.Entity", "line 1\nline 2\n"),
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	212 ("Text.Whitespace", "\n"),
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	213 ],
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	214 pygments.lex("\\FUNCTION{line 1\nline 2\n}", self.lexer))
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	215
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	216 def test_function_3(self):
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	217 self.assertTokenStreamEqualComplete(
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	218 [("Keyword", "FUNCTION"),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	219 ("Text.Whitespace", " "),
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	220 ("Name.Entity", "\\"),
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	221 ("Name.Entity", "n"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	222 ("Name.Entity", "}"),
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	223 ("Text.Whitespace", "\n"),
d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	224 ],
79 c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	225 pygments.lex(r"\FN {\n\}}", self.lexer))
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	226
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	227 def test_class(self):
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	228 self.assertTokenStreamEqualComplete(
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	229 [("Keyword", "CLASS"),
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	230 ("Text.Whitespace", " "),
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	231 ("Name.Entity", "\\"),
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	232 ("Name.Entity", "n"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	233 ("Name.Entity", "}"),
40 df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	234 ("Text.Whitespace", "\n"),
df08226a6984 Names for some entities (program, algorithm, function, procedure, class). Franz Glasner <fzglas.hg@dom66.de> parents: 39 diff changeset	235 ],
79 c14e5fd4d193 More tests with escape characters Franz Glasner <fzglas.hg@dom66.de> parents: 78 diff changeset	236 pygments.lex(r"\CLASS {\n\}}", self.lexer))
35 d9a3551a1038 Basics of translating some keywords Franz Glasner <fzglas.hg@dom66.de> parents: 34 diff changeset	237
41 4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	238 def test_class_fr(self):
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	239 lexer = pygments.lexers.load_lexer_from_file(
53 39151225fb84 Rename the new pseudocode implementation to AlgPseudocode. Franz Glasner <fzglas.hg@dom66.de> parents: 43 diff changeset	240 ALGLEXERFILENAME, "AlgPseudocodeLexer_FR")
41 4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	241 self.assertTokenStreamEqualComplete(
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	242 [("Keyword", "CLASSE"),
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	243 ("Text.Whitespace", " "),
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	244 ("Name.Entity", "\\"),
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	245 ("Name.Entity", "n"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	246 ("Name.Entity", "}"),
41 4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	247 ("Text.Whitespace", "\n"),
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	248 ],
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	249 pygments.lex("\\CLASS {\\n\\}}", lexer))
4ccf9a8d0bf2 For the german and french PseudocodeLexer: Use en translations as fallback. Franz Glasner <fzglas.hg@dom66.de> parents: 40 diff changeset	250
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	251 def test_class_de_with_noend_option(self):
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	252 lexer = pygments.lexers.load_lexer_from_file(
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	253 ALGLEXERFILENAME, "AlgPseudocodeLexer_DE", no_end="True")
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	254 self.assertTokenStreamEqualComplete(
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	255 [("Keyword", "KLASSE"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	256 ("Text.Whitespace", " "),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	257 ("Name.Entity", "\\"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	258 ("Name.Entity", "n"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	259 ("Name.Entity", "}"),
57 e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	260 ("Text.Whitespace", "\n"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	261 ("Text.Whitespace", "\n"),
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	262 ],
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	263 pygments.lex("\\CLASS {\\n\\}}\n\\ENDCLASS", lexer))
e8f4af9e20a8 Some "ENDxxx" commands Franz Glasner <fzglas.hg@dom66.de> parents: 53 diff changeset	264
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	265 def test_class_de_with_noend_option_and_name(self):
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	266 lexer = pygments.lexers.load_lexer_from_file(
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	267 ALGLEXERFILENAME, "AlgPseudocodeLexer_DE", no_end="True")
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	268 self.assertTokenStreamEqualComplete(
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	269 [("Keyword", "KLASSE"),
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	270 ("Text.Whitespace", " "),
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	271 ("Name.Entity", "\\"),
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	272 ("Name.Entity", "n"),
74 c1357674622d Remove an escaping backslash where appropriate Franz Glasner <fzglas.hg@dom66.de> parents: 72 diff changeset	273 ("Name.Entity", "}"),
62 7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	274 ("Text.Whitespace", "\n"),
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	275 ("Text.Whitespace", "\n"),
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	276 ],
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	277 pygments.lex("\\CLASS {\\n\\}}\n\\ENDCLASS {end class}", lexer))
7153e945a3d6 Implement ignoring of \ENDxxx including its optional name parts Franz Glasner <fzglas.hg@dom66.de> parents: 57 diff changeset	278
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	279 def test_remark_1(self):
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	280 self.assertTokenStreamEqualComplete(
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	281 [("Comment.Single", "▷"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	282 ("Comment.Single", " the remark"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	283 ("Text.Whitespace", "\n"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	284 ],
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	285 pygments.lex("\\REMARK the remark\n", self.lexer))
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	286
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	287 def test_remark_2(self):
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	288 self.assertTokenStreamEqualComplete(
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	289 [("Comment.Single", "▷"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	290 ("Comment.Single", " the remark 1"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	291 ("Text.Whitespace", "\n"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	292 ("Comment.Single", "▷"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	293 ("Comment.Single", " the remark 2"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	294 ("Text.Whitespace", "\n"),
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	295 ],
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	296 pygments.lex(
64 05c53e431c88 Simplify case-handling for "BLOCK" and "REMARK" Franz Glasner <fzglas.hg@dom66.de> parents: 62 diff changeset	297 """\\remArk the remark 1
39 a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	298 \\Rem the remark 2
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	299 """, self.lexer))
a3151d837258 Some basic keywords for programs, algorithms, procedures and functions; also comments (single and multiline) and "remarks" Franz Glasner <fzglas.hg@dom66.de> parents: 35 diff changeset	300
70 5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	301 def test_expr_and_text(self):
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	302 self.assertTokenStreamEqualComplete(
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	303 [("Name.Entity", "a"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	304 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	305 ("Text", "multiplied by"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	306 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	307 ("Name.Entity", "b"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	308 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	309 ("Text", "is"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	310 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	311 ("Number.Integer", "0"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	312 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	313 ("Text", "mod"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	314 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	315 ("Name.Entity", "p"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	316 ("Text.Whitespace", "\n"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	317 ],
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	318 pygments.lex(
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	319 r"""a \TEXT{multiplied by} b \text{is} 0 \text{mod} p""",
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	320 self.lexer))
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	321
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	322 def test_expr_and_text_with_escaped_characters(self):
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	323 self.assertTokenStreamEqualComplete(
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	324 [("Name.Entity", "a"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	325 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	326 ("Text", "multiplied by {escaped"),
72 206017a08ed7 Refactor: Make the "op_space()" and related methods more flexible and allow a given fixed token type and value Franz Glasner <fzglas.hg@dom66.de> parents: 70 diff changeset	327 ("Text", "}"),
70 5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	328 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	329 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	330 ("Name.Entity", "b"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	331 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	332 ("Text", "is "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	333 ("Text", "\\"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	334 ("Text", " not"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	335 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	336 ("Number.Integer", "0"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	337 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	338 ("Text", "mod"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	339 ("Text", " "),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	340 ("Name.Entity", "p"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	341 ("Text.Whitespace", "\n"),
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	342 ],
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	343 pygments.lex(
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	344 r"""a \TEXT{multiplied by {escaped\} } b \text{is \ not} 0"""
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	345 r" \text{mod} p""",
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	346 self.lexer))
5517b0be67f0 Basic "\TEXT" escape for expressions Franz Glasner <fzglas.hg@dom66.de> parents: 69 diff changeset	347
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	348 def test_punctuation(self):
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	349 self.assertTokenStreamEqualComplete(
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	350 [("Punctuation", "{"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	351 ("Punctuation", "}"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	352 ("Punctuation", ":"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	353 ("Punctuation", "("),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	354 ("Punctuation", ")"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	355 ("Punctuation", ","),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	356 ("Punctuation", ";"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	357 ("Punctuation", "["),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	358 ("Punctuation", "]"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	359 ("Text.Whitespace", "\n"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	360 ],
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	361 pygments.lex(r"{}:(),;[]", self.lexer))
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	362
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	363 def test_block_empty(self):
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	364 self.assertTokenStreamEqualComplete(
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	365 [("Text", "◆"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	366 ("Text.Whitespace", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	367 ("Text.Whitespace", "\n"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	368 ],
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	369 pygments.lex(r"\block{}", self.lexer))
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	370
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	371 def test_block_with_text(self):
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	372 self.assertTokenStreamEqualComplete(
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	373 [("Text", "◆"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	374 ("Text.Whitespace", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	375 ("Text", "a b c"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	376 ("Text.Whitespace", "\n"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	377 ],
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	378 pygments.lex(r"\block{\text{a b c}}", self.lexer))
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	379
76 27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	380 def test_block_with_escaped_text(self):
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	381 self.assertTokenStreamEqualComplete(
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	382 [("Text", "◆"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	383 ("Text.Whitespace", " "),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	384 ("Text", "\\"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	385 ("Name.Entity", "text"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	386 ("Punctuation", "{"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	387 ("Name.Entity", "a"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	388 ("Text", " "),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	389 ("Name.Entity", "b"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	390 ("Text", " "),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	391 ("Name.Entity", "c"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	392 ("Punctuation", "}"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	393 ("Text.Whitespace", "\n"),
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	394 ],
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	395 pygments.lex(r"\block{\\text{a b c\}}", self.lexer))
27e12387154d FIX: Handle escape character more thoroughly: also explicitely handle "\\" Franz Glasner <fzglas.hg@dom66.de> parents: 75 diff changeset	396
75 711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	397 def test_block(self):
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	398 self.assertTokenStreamEqualComplete(
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	399 [("Text", "◆"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	400 ("Text.Whitespace", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	401 ("Name.Entity", "a"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	402 ("Text", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	403 ("Number.Float", "1.2"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	404 ("Text", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	405 ("Punctuation", "{"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	406 ("Name.Entity", "x"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	407 ("Text", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	408 ("Operator.Word", "in"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	409 ("Text", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	410 ("Name.Entity", "X"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	411 ("Punctuation", "}"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	412 ("Text", " "),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	413 ("Name.Entity", "c"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	414 ("Text.Whitespace", "\n"),
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	415 ],
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	416 pygments.lex(r"\state{a 1.2 {x in X\} c}", self.lexer))
711f8d19e27a New implementation of "STATEMENT" (also aliased to "STATE" and "BLOCK"). Franz Glasner <fzglas.hg@dom66.de> parents: 74 diff changeset	417
78 abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	418 def test_tstate_empty(self):
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	419 self.assertTokenStreamEqualComplete(
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	420 [("Text", "▪"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	421 ("Text.Whitespace", " "),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	422 ("Text.Whitespace", "\n"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	423 ],
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	424 pygments.lex(r"\tstate{}", self.lexer))
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	425
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	426 def test_tstate_with_expr(self):
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	427 self.assertTokenStreamEqualComplete(
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	428 [("Text", "▪"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	429 ("Text.Whitespace", " "),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	430 ("Text", "a 1.2 "),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	431 ("Name.Entity", "x"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	432 ("Text", " "),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	433 ("Operator.Word", "in"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	434 ("Text", " "),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	435 ("Name.Entity", "X"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	436 ("Punctuation", "}"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	437 ("Text", " c"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	438 ("Text.Whitespace", "\n"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	439 ],
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	440 pygments.lex(r"\tstate{a 1.2 \expr{x in X\}} c}", self.lexer))
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	441
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	442 def test_tstate_with_escaped_expr(self):
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	443 self.assertTokenStreamEqualComplete(
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	444 [("Text", "▪"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	445 ("Text.Whitespace", " "),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	446 ("Text", "a 1.2 "),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	447 ("Text", "\\"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	448 ("Text", "expr{x in X"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	449 ("Text", "}"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	450 ("Text", " c"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	451 ("Text.Whitespace", "\n"),
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	452 ],
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	453 pygments.lex(r"\tstate{a 1.2 \\expr{x in X\} c}", self.lexer))
abb2e8c65d0f Implement "TEXTSTATEMENT" Franz Glasner <fzglas.hg@dom66.de> parents: 76 diff changeset	454
84 3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	455 def test_explicit_extended_single_tokentype_1(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	456 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	457 [("Operator", "%"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	458 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	459 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	460 pygments.lex(r"\ttx-o:%:", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	461
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	462 def test_explicit_extended_single_tokentype_2(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	463 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	464 [("Operator", "{"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	465 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	466 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	467 pygments.lex(r"\ttx-o{{}", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	468
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	469 def test_explicit_extended_single_tokentype_3(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	470 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	471 [("Operator", "<"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	472 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	473 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	474 pygments.lex(r"\ttx-o<<>", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	475
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	476 def test_explicit_extended_single_tokentype_4(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	477 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	478 [("Operator", "("),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	479 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	480 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	481 pygments.lex(r"\ttx-o(()", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	482
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	483 def test_explicit_extended_multi_tokentype_1(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	484 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	485 [("Operator", "xxx in A"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	486 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	487 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	488 pygments.lex(r"\ttx-o/xxx in A/", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	489
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	490 def test_explicit_extended_multi_tokentype_2(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	491 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	492 [("Operator", "xxx in B"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	493 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	494 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	495 pygments.lex(r"\ttx-o{xxx in B}", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	496
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	497 def test_explicit_extended_multi_tokentype_3(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	498 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	499 [("Operator", "xxx in C"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	500 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	501 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	502 pygments.lex(r"\ttx-o<xxx in C>", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	503
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	504 def test_explicit_extended_multi_tokentype_4(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	505 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	506 [("Operator", "xxx in D"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	507 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	508 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	509 pygments.lex(r"\ttx-o(xxx in D)", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	510
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	511 def test_explicit_tokentype_simple_1(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	512 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	513 [("Operator", "}"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	514 ("Operator", "/"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	515 ("Text.Whitespace", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	516 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	517 pygments.lex(r"\tt-o/}\tt-o//", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	518
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	519 def test_explicit_tokentype_simple_2(self):
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	520 self.assertTokenStreamEqualComplete(
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	521 [("Operator", "\n"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	522 ("Operator", "/"),
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	523 ("Text", " \n"), # because of r"\s+", Text for expressions
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	524 ],
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	525 pygments.lex("\\tt-o/\n\\tt-o// ", self.lexer))
3ac1c4502ad0 Implement "\tt-XXX" and "ttx-XXX" for explicit token types. Franz Glasner <fzglas.hg@dom66.de> parents: 79 diff changeset	526
87 d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	527 @unittest.skipIf(sys.version_info[0] <= 2, "Unicode issue on Python 2")
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	528 def test_explicit_tokentype_with_remark(self):
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	529 self.assertTokenStreamEqualComplete(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	530 [("Operator", "∈ ∌"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	531 ("Text", " "),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	532 ("Comment.Single", "▷"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	533 ("Comment.Single", " ∈ ∌ as (ordinary) operators"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	534 ("Text.Whitespace", "\n"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	535 ],
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	536 pygments.lex(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	537 r"""\ttx-o<∈ ∌> \rem ∈ ∌ as (ordinary) operators""",
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	538 self.lexer))
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	539
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	540 def test_explicit_tokentype_with_remark_2(self):
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	541 self.assertTokenStreamEqualComplete(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	542 [("Operator", "new_operator"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	543 ("Text", " "),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	544 ("Comment.Single", "▷"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	545 ("Comment.Single", " a (synthesized) operator"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	546 ("Text.Whitespace", "\n"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	547 ],
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	548 pygments.lex(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	549 r"""\ttx-o<new_operator> \rem a (synthesized) operator""",
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	550 self.lexer))
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	551
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	552 @unittest.skipIf(sys.version_info[0] <= 2, "Unicode issue on Python 2")
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	553 def test_explicit_tokentype_with_possibly_conflicting_parens(self):
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	554 self.assertTokenStreamEqualComplete(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	555 [("Name.Function", "∈_∌"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	556 ("Punctuation", "("),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	557 ("Name.Entity", "p1"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	558 ("Punctuation", ","),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	559 ("Text", " "),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	560 ("Name.Entity", "p2"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	561 ("Punctuation", ")"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	562 ("Text.Whitespace", "\n"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	563 ],
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	564 pygments.lex(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	565 r"""\ttx-nf<∈_∌>(p1, p2)""",
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	566 self.lexer))
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	567
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	568 def test_explicit_tokentype_with_possibly_conflicting_parens_2(self):
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	569 self.assertTokenStreamEqualComplete(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	570 [("Name.Decorator", "a_Decorator"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	571 ("Punctuation", "("),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	572 ("Name.Entity", "p1"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	573 ("Punctuation", ","),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	574 ("Text", " "),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	575 ("Name.Entity", "p2"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	576 ("Punctuation", ")"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	577 ("Text", " "),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	578 ("Comment.Single", "▷"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	579 ("Comment.Single", " (Python) decorator"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	580 ("Text.Whitespace", "\n"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	581 ],
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	582 pygments.lex(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	583 r"""\ttx-nd<a_Decorator>(p1, p2) \rem (Python) decorator""",
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	584 self.lexer))
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	585
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	586 def test_explicit_tokentype_with_possibly_conflicting_parens_3(self):
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	587 self.assertTokenStreamEqualComplete(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	588 [("Name.Decorator", "a_Decorator"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	589 ("Punctuation", "("),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	590 ("Name.Entity", "p1"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	591 ("Punctuation", ","),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	592 ("Text", " "),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	593 ("Name.Entity", "p2"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	594 ("Punctuation", ")"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	595 ("Text", " "),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	596 ("Comment.Single", "▷"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	597 ("Comment.Single", " (Python) annotation"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	598 ("Text.Whitespace", "\n"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	599 ],
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	600 pygments.lex(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	601 r"""\ttx-nd[a_Decorator](p1, p2) \rem (Python) annotation""",
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	602 self.lexer))
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	603
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	604 def test_explicit_tokentype_error(self):
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	605 self.assertTokenStreamEqualComplete(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	606 [("Generic.Error", r"""\ttx-non-existing[a_Decorator]"""),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	607 ("Text.Whitespace", "\n"),
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	608 ],
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	609 pygments.lex(
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	610 r"""\ttx-non-existing[a_Decorator]""",
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	611 self.lexer))
d8ca835c74ea FIX: Erroneous parsing of \tt-XXX and \ttx-XXX: Franz Glasner <fzglas.hg@dom66.de> parents: 84 diff changeset	612
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	613
66 9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	614 class PygmentizeCompletely(unittest.TestCase):
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	615
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	616 def setUp(self):
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	617 self.lexer = pygments.lexers.load_lexer_from_file(
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	618 ALGLEXERFILENAME, ALGLEXERCLASS)
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	619
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	620 def test_pygmentize_html(self):
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	621 html_formatter = pygments.formatters.get_formatter_by_name("html")
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	622 highlighted = pygments.highlight(
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	623 '"""FOO"""',
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	624 self.lexer,
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	625 html_formatter,
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	626 outfile=None)
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	627 self.assertTrue(highlighted.startswith("""<div class="highlight">"""))
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	628
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	629 def test_pygmentize_latex(self):
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	630 latex_formatter = pygments.formatters.get_formatter_by_name("latex")
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	631 highlighted = pygments.highlight(
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	632 '"""FOO"""',
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	633 self.lexer,
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	634 latex_formatter,
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	635 outfile=None)
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	636 self.assertTrue(highlighted.startswith(r"""\begin{Verbatim}"""))
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	637
9ba1584d4b4a Also add a test that completely highlights a document with Pygments Franz Glasner <fzglas.hg@dom66.de> parents: 64 diff changeset	638
34 1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	639 if __name__ == "__main__":
1f741934205e Begin a new Pseudocode lexer using numbers and strings from Python Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	640 unittest.main()

Mercurial > hgrepos > Python > libs > pygments-lexer-pseudocode2

annotate tests/test_algpseudo.py @ 87:d8ca835c74ea