[tlbuild] xindy-new on FreeBSD: problems with iconv (missing ISO-IR-111) and recode

[Nikola Lečić]

Hello,

There are two (independent) conversion problems with xindy-new
alphabets on FreeBSD.

First, with libiconv implementation of iconv() which lacks support for
ISO-IR-111 -- iconv (GNU libiconv 1.13) -- xindy-new building fails
when creating belarusian/isoir111.pl.

On Linux, at least in Debian family, ISO-IR-111 support is provided
through eglibc. The work on native bsdiconv -- which would solve this
problem -- is ongoing, but I am uncertain when it will be finished.

Secondly, compiling xindy-new --with-recode fails because resultant
recoded files miss some characters compared to correct versions created
by iconv. Here are two examples of how recode damage the contents.

sed -e 's/@u{\([^}]*\)}//g;' </root/TeXLive-Devel/trunk/Build/source/utils/xindy-new/xindy/make-rules/alphabets/croatian/utf8.pl.in | \
	recode UTF-8..CP1250 >croatian/cp1250.pl

passes, but croatian/cp1250.pl is incomplete:
-------------------------------- >8 -----------------------------------
# diff croatian/cp1250.pl.iconv croatian/cp1250.pl.recode
54c54
< ['K',    ['k','K'] ],
---
> ['K'] ],
100c100
<                    [], # ty (hungarian)
---
>                    [], y (hungarian)
-------------------------------- >8 -----------------------------------

Similarly,
-------------------------------- >8 -----------------------------------
# diff czech/cp1250.pl.iconv czech/cp1250.pl.recode
51c51
<                    [], # i with diaeresis (gypsy/northrussian)
---
>     [], # i with diaeresis (gypsy/northrussian)
96c96
<                    [], # z (estonian)
---
>                (estonian)
-------------------------------- >8 -----------------------------------

This does not happen with recode on Linux. So, before debugging this
further, I would like to ask if something similar happens on non-Linux
systems other than FreeBSD.

Regards,
-- 
Nikola Lečić = Никола Лечић
fingerprint : FEF3 66AF C90E EDC3 D878  7CDC 956D F4AB A377 1C9B
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 314 bytes
Desc: not available
URL: <http://tug.org/pipermail/tlbuild/attachments/20100102/00281960/attachment.bin>