[PHP-BUG] Bug #78604 [NEW]: token_get_all() does not properly tokenize FOO

[tan...@php.net]

From: tandre
Operating system: 
PHP version:  7.4.0RC2
Package:  Testing related
Bug Type: Bug
Bug description:token_get_all() does not properly tokenize FOO var_export(token_get_all('FOO 
  array (
0 => 313,
1 => 'FOO 1,
  ),
)
php > echo PHP_VERSION;
7.4.0-dev


Expected result:

Outputs two tokens, one for FOO, and one for https://bugs.php.net/bug.php?id=78604&edit=1
-- 
Fix committed:https://bugs.php.net/fix.php?id=78604&r=fixed
Fixed in release: 
https://bugs.php.net/fix.php?id=78604&r=alreadyfixed
Need backtrace:   
https://bugs.php.net/fix.php?id=78604&r=needtrace
Need Reproduce Script:
https://bugs.php.net/fix.php?id=78604&r=needscript
Try newer version:
https://bugs.php.net/fix.php?id=78604&r=oldversion
Not developer issue:  
https://bugs.php.net/fix.php?id=78604&r=support
Expected behavior:
https://bugs.php.net/fix.php?id=78604&r=notwrong
Not enough info:  
https://bugs.php.net/fix.php?id=78604&r=notenoughinfo
Submitted twice:  
https://bugs.php.net/fix.php?id=78604&r=submittedtwice
register_globals: 
https://bugs.php.net/fix.php?id=78604&r=globals
PHP version support discontinued: 
https://bugs.php.net/fix.php?id=78604&r=phptooold
Daylight Savings: https://bugs.php.net/fix.php?id=78604&r=dst
IIS Stability:https://bugs.php.net/fix.php?id=78604&r=isapi
Install GNU Sed:  https://bugs.php.net/fix.php?id=78604&r=gnused
Floating point limitations:   https://bugs.php.net/fix.php?id=78604&r=float
No Zend Extensions:   https://bugs.php.net/fix.php?id=78604&r=nozend
MySQL Configuration Error:
https://bugs.php.net/fix.php?id=78604&r=mysqlcfg

Bug #78604 [Com]: token_get_all() does not properly tokenize FOO

[tan...@php.net]

Edit report at https://bugs.php.net/bug.php?id=78604&edit=1

 ID: 78604
 Comment by:     tan...@php.net
 Reported by:    tan...@php.net
 Summary:token_get_all() does not properly tokenize FOO eval('?>FOO var_export(token_get_all('FOO 
  array (
0 => 313,
1 => 'FOO 1,
  ),
)
php > echo PHP_VERSION;
7.4.0-dev


Expected result:

Outputs two tokens, one for FOO, and one for https://bugs.php.net/bug.php?id=78604&edit=1