tokenizer

PHP Source code tokenizer

andrei Andrei Zmievski andrei@php.net lead The tokenizer functions provide an interface to the PHP tokenizer embedded in the Zend Engine. Using these functions you may write your own PHP source analyzing or modification tools without having to deal with the language specification at the lexical level. PHP beta 5.0.0rc1 2004-03-19 package.xml added to support installation using pear installer