[luatex] \write16 (or 128) loosing tokens after null character

[jfbu]

Le 19 nov. 2015 à 23:44, jfbu <jfbu at free.fr> a écrit :

> Hi,
> 
> this might be the same issue than one with \scantokens
> which was discussed some time ago on this list (lost the reference)

this was 

http://tug.org/pipermail/luatex/2015-March/005138.html
[luatex] behavior of \write in LuaTeX differs from the one of	PdfTeX/XeTeX 

which referenced some other threads, 

I tried also running pdftex with -8bit switch which 
was mentioned by Hans in the previous thread and this gives

This is pdfTeX, Version 3.14159265-2.6-1.40.16 (TeX Live 2015) (preloaded format=pdftex 2015.10.14)  20 NOV 2015 09:50
entering extended mode
 restricted \write18 enabled.
 %&-line parsing enabled.
**testlualog.tex
(./testlualog.tex macro:->\romannumeral `  foo bar foo bar foo bar
macro:->\romannumeral `  foo bar foo bar foo bar
 )

 (contains two null characters)

The log with luatex is:

This is LuaTeX, Version beta-0.80.0 (TeX Live 2015) (rev 5238)  (format=luatex 2015.10.14)  20 NOV 2015 09:53
 restricted \write18 enabled.
**\input testlualog.tex
(./testlualog.tex macro:->\romannumeral `  foo bar foo bar foo bar
macro:->\romannumeral `
)

only one null character in \message output

in \write output the null character is not there
(and the other things are gone)
best,

Jean-François
PS: sorry for the typo in the thread title

> 
> \catcode0 12
> 
> \def\x {\romannumeral`^^@ foo bar foo bar foo bar}
> 
> \catcode0 9
> 
> \message{\meaning\x}
> 
> \immediate\write128{\meaning\x}
> 
> \bye
>