[luatex] LuaTeX versus ConTeXT Mk IV oddness

Joseph Wright (CHE) Joseph.Wright at uea.ac.uk
Mon Aug 4 16:20:54 CEST 2014

Hello all,

Not sure which list to raise this one on, but hopefully there will be
enough people knowledgeable here to help!

Trying to read some UTF-8 data, I find that a few chars seem to give
unexpected results with ConTeXt MkIV comped to plain LuaTeX using the
same engine version:

     \test և\stop

on my system gives

This is LuaTeX, Version beta-0.79.1 (TeX Live 2014/W32TeX) (rev 4971)
 restricted \write18 enabled.
> և:.
\test #1#2\stop ^^@-\showtokens {#1:#2}

l.3 \test և\stop


with "luatex" but

mtx-context     | warning: synctex is enabled
mtx-context     | run 1: luatex
--no-parse-first-line --synctex=1 --c:currentrun=1
--c:fulljobname="./test.tex" --c:input="./test.tex" --c:kindofrun=1
--c:maxnofruns=8 --c:synctex "cont-yes.mkiv"
This is LuaTeX, Version beta-0.79.1 (TeX Live 2014/W32TeX) (rev 4971)
 \write18 enabled.
open source     > 1 > 1 >

ConTeXt  ver: 2014.05.21 22:04 MKIV beta  fmt: 2014.7.1  int:

system          > 'cont-new.mkiv' loaded
open source     > 2 > 2 >
close source    > 2 > 2 >
system          > files > jobname 'test', input './test', result 'test'
fonts           > latin modern fonts are not preloaded
languages       > language 'en' is active
open source     > 2 > 3 >
> ե:ւ

tex error       > error on line 3 in file
//ueahome3/stfsci2/c227/data/NTProfile/Desktop/test/test.tex: ?

\test #1#2\stop ^^@-\showtokens {#1:#2}

l.3 \test եւ\stop

1     \ifdefined\normalshowtokens\let\showtokens\normalshowtokens\fi
2     \def\test#1#2\stop{\showtokens{#1:#2}}
3 >>  \test և\stop


using ConTeXT.

As you can see, the engines are the same and indeed I'm running exactly
the same file (encoded UTF-8). The issue here is not just that the
results are different but that I get a different number of tokens: in
the real situation that's a big issue. I've not tracked down all of the
codepoints this problem applies to, but there seem to be several, so
it's not just this char.

Any clues one what is up?
Joseph Wright

More information about the luatex mailing list