Home
last modified time | relevance | path

Searched refs:tokenize (Results 1 – 10 of 10) sorted by relevance

/PHP-Parser/test/PhpParser/
H A DLexerTest.php23 $lexer->tokenize($code, $errorHandler);
52 $lexer->tokenize("<?php readonly /*");
60 $tokens = $lexer->tokenize($code);
117 $this->assertEquals($expectedTokens, $lexer->tokenize($code));
H A DParserTestAbstract.php208 public function tokenize(string $code, ?ErrorHandler $errorHandler = null): array { function in PhpParser\\InvalidTokenLexer
/PHP-Parser/test/PhpParser/Lexer/
H A DEmulativeTest.php29 ], $lexer->tokenize($code));
43 ], $lexer->tokenize($code));
58 ], $lexer->tokenize($code));
74 ], $lexer->tokenize($code));
89 ], $lexer->tokenize($code));
137 $this->assertSameTokens($expectedTokens, $lexer->tokenize('<?php ' . $code));
153 ], $lexer->tokenize($fullCode));
162 $lexer->tokenize('<?php ' . $code . "\0", $errorHandler);
435 $this->assertSameTokens($expectedTokens, $lexer->tokenize('<?php ' . $code));
/PHP-Parser/lib/PhpParser/
H A DLexer.php24 public function tokenize(string $code, ?ErrorHandler $errorHandler = null): array { function in PhpParser\\Lexer
31 $tokens = @Token::tokenize($code);
H A DParserAbstract.php184 $this->tokens = $this->lexer->tokenize($code, $this->errorHandler);
/PHP-Parser/lib/PhpParser/Lexer/
H A DEmulative.php64 public function tokenize(string $code, ?ErrorHandler $errorHandler = null): array { function in PhpParser\\Lexer\\Emulative
71 return parent::tokenize($code, $errorHandler);
84 $tokens = parent::tokenize($code, $collector);
/PHP-Parser/lib/PhpParser/Internal/
H A DTokenPolyfill.php124 public static function tokenize(string $code, int $flags = 0): array { function in PhpParser\\Internal\\TokenPolyfill
/PHP-Parser/doc/component/
H A DLexer.markdown40 The `Lexer::tokenize()` method returns an array of `PhpParser\Token`s. The most important parts of …
59 Unlike PHP's own `PhpToken::tokenize()` output, the token array is terminated by a sentinel token w…
/PHP-Parser/
H A DUPGRADE-5.0.md493 The lexer API is reduced to a single `Lexer::tokenize()` method, which returns an array of tokens. …
H A DCHANGELOG.md140 there is a single method `tokenize()` returning the tokens.

Completed in 51 milliseconds