[tex-k] implementation of \scantokens

[Taco Hoekwater]

Hendri Adriaens wrote:
> Hi Heiko,
> 
> thanks for your idea. I copied an idea by Morten (he had trouble with
> e-mail) below. But the main issue stays. I would expect \scantokens to
> not cause this kind of trouble.

Hi Hendri,

AFAIK, \scantokens behaves *exactly* how Peter Breitenlohner
intended, including the EOF and the impossibility to insert
newlines in the re-scanned text. And since Peter equals e-TeX,
I guess \scantokens is immutable. Hans Hagen and I have
considered creating a separate primitive that "does what we
want" instead of "mimics a one-line file", but somehow we
never get around to actually writing the code.

Greetings,
Taco