[tlbuild] New ICU tests fail on aarch64-linux (on Debian 10)

[Johannes Hielscher]

Hi builders, Mojca, Takuji,

Confirmed here (aarch64-linux, also on Debian 10). The error is caused
by the brand new icu_rules tests, that Takuji has appended mere seven
hours ago to
/trunk/Build/source/texk/upmendex/tests/upmendex.test
http://tug.org/svn/texlive?view=revision&revision=60308

Mojca, do I see it correctly that you have just launched an Debian on
aarch64-linux buildbot client in the build farm, and just hit one hour
after Takuji has pushed an update for the upmendex test? That's proper
timing /-:

There was that weird bug back in March that was hidden in unexpected
behaviour of upmendex output. Karl and Nelson found out on 2021-05-09
that it became visible due to platform dependence of integer sign
treatment within the upmendex code.

Without having inspected the current situation further, the new error
doesn't look as exotic -- at least happens in a well-defined situation,
that gives a somewhat clear entry point for conventional debugging --
U_INVALID_FORMAT_ERROR is ICU's way to complain about “Data format is
not what is expected.”

Takuji, you are obviously the first person to ask for the further
proceeding. Given that you didn't modify source code at all in -r60308,
my guess would be that the troublesome code has come with the 0.58
release (TL -r60191) two weeks ago?
You wouldn't have committed the new tests if it not even ran on your
machine. Let us know if you need assistance with an environment in
which the bug occurs.

Best,
Johannes


Am Mon, 23 Aug 2021 18:58:11 +0200
schrieb Mojca Miklavec <mojca.miklavec.lists at gmail.com>:

> Hi,
> 
> I'm sorry, it seems a bit more complex than that.
> 
> It semi-randomly fails on half of the builders, without any obvious
> failure pattern.
> (It works on 64-bit Solaris, fails on 32-bit Solaris, works on 32-bit
> Debian 9, fails on 64-bit Debian 9, fails on 32-bit Debian 8, works on
> aarch64 running Ubuntu, fails on aarch64 running Debian 10, works on
> 64 bit macOS Intel, fails on Arm64 macOS, etc.)
> 
> Mojca
> 
> On Mon, 23 Aug 2021 at 18:09, Mojca Miklavec
> <mojca.miklavec.lists at gmail.com> wrote:
> >
> > Hi,
> >
> > These tests seem to be failing on Arm:
> >
> > http://tug.org/svn/texlive?view=revision&revision=60308
> >
> >
> > ./upmendex -s $srcdir/tests/pprec2.ist $srcdir/tests/pprecA.idx \
> > -o pprecA-2.ind1 -t pprecA-2.ilg \
> > && diff $srcdir/tests/pprecA-2.ind pprecA-2.ind1 || exit 1
> > + ./upmendex -s ../../../texk/upmendex/tests/pprec2.ist
> > ../../../texk/upmendex/tests/pprecA.idx -o pprecA-2.ind1 -t
> > pprecA-2.ilg
> > This is upmendex version 0.58 [ICU 68.2] (TeX Live 2022/dev).
> > Scanning style file ../../../texk/upmendex/tests/pprec2.ist....done.
> > Scanning input file ../../../texk/upmendex/tests/pprecA.idx....done
> > (9 entries accepted, 0 rejected).
> > 9 entries accepted, 0 rejected.
> > Sorting index....done(0 comparisons).
> > Sorting pages....done(28 comparisons).
> > Making index file....done.
> > 0 warnings, written in pprecA-2.ilg.
> > Output written in pprecA-2.ind1.
> > + diff ../../../texk/upmendex/tests/pprecA-2.ind pprecA-2.ind1
> > # test for icu_rules
> > ./upmendex -s $srcdir/tests/uni.ist -s $srcdir/tests/rule1.ist
> > $srcdir/tests/rule.idx \
> > -o rule1.ind1 -t rule1.ilg \
> > && diff $srcdir/tests/rule.ind rule1.ind1 || exit 1
> > + ./upmendex -s ../../../texk/upmendex/tests/uni.ist -s
> > ../../../texk/upmendex/tests/rule1.ist
> > ../../../texk/upmendex/tests/rule.idx -o rule1.ind1 -t rule1.ilg
> > This is upmendex version 0.58 [ICU 68.2] (TeX Live 2022/dev).
> > Scanning style file ../../../texk/upmendex/tests/uni.ist....done.
> > Scanning style file ../../../texk/upmendex/tests/rule1.ist....done.
> > Scanning input file ../../../texk/upmendex/tests/rule.idx....done
> > (12 entries accepted, 1 rejected).
> > 12 entries accepted, 1 rejected.
> > Sorting index.
> > [ICU] Collator creation failed.: U_INVALID_FORMAT_ERROR
> > + exit 1
> > FAIL tests/upmendex.test (exit status: 1)
> >
> > https://build.contextgarden.net/#/builders/114/builds/2
> >
> > Mojca