<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
I am registered to the group, but at the moment I do not have with
me my coordinates.<br>
<br>
Mojca Miklavec suggested that I forward to the group the message
that follows. Here are her words:<br>
<br>
<pre wrap="">First of all, I believe that it would be very helpful if Claudio would
send the initial long email (from 22nd of July) to the tex-hyphen
mailing list and it would be great if the discussion continued there.
It would be very helpful to have the discussion archived online. Could
this be done?
<big><tt>Very gladly I am forwarding the</tt></big> message, ad on my side I try to continue the discussion on this mailing list.
Meawhile it is worth noting that I am trying to do what I did with monotonic Greek in order to extend to LGR encoding the polytonic Grek version. If I succeed, I continue with the ancient Greek variety. But of course Dimitrios Filippou has to supervise the pattern files, and Günter Milde has to suoervise the update to the babel-greek source version of the greek.ldf file.
Claudio Beccari
</pre>
<br>
<div class="moz-forward-container"><br>
<br>
-------- Original Message --------
<table class="moz-email-headers-table" border="0" cellpadding="0"
cellspacing="0">
<tbody>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Subject:
</th>
<td>Re: missing hyphen points in monotonic greek</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Date: </th>
<td>Tue, 22 Jul 2014 22:54:21 +0200</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">From: </th>
<td>Claudio Beccari <a class="moz-txt-link-rfc2396E" href="mailto:claudio.beccari@gmail.com"><claudio.beccari@gmail.com></a></td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">To: </th>
<td>Guenter Milde <a class="moz-txt-link-rfc2396E" href="mailto:milde@users.sf.net"><milde@users.sf.net></a></td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">CC: </th>
<td>Dimitrios Filippou <a class="moz-txt-link-rfc2396E" href="mailto:Dimitrios.Filippou@gmail.com"><Dimitrios.Filippou@gmail.com></a>,
Mojca Miklavec <a class="moz-txt-link-rfc2396E" href="mailto:mojca.miklavec.lists@gmail.com"><mojca.miklavec.lists@gmail.com></a></td>
</tr>
</tbody>
</table>
<br>
<br>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
Dear friends,<br>
I deleted the other messages about this thread, but this message
is the first positive result in order to have correct hyphenation
also when the LICR precomposed accented Greek characters are
entered in the input file.<br>
<br>
Let's recall the actual situation:<br>
<br>
The babel/polyglossia side of the Greek hyphenation contains three
loaders and 6 pattern files; three with unicode greek characters
and the corresponding three ASCII encoded ones. Every triplet
contains the patterns for modern monotonic greek, modern polytonic
greek and ancient polytonic greek.<br>
<br>
The ones with unicode characters are used in the creation of
formats for Unicode aware engines, such as xetex and luatex, and
others.<br>
<br>
The ASCII encoded pattern files are used for creating formats for
8-bit aware engines (such as pdftex and the like) but they miss
some important functionality; they contain patterns that are
strictly ASCII and work with accented characters only when they
arrive at the hyphenation algorithm as un-ligated ligatures, that
will be ligated after the hyphenation process thanks to a feature
of the font tfm files of the CBfonts, and of the other fonts with
LGR encoding. Remember that I created those CBfonts when Unicode
did not exist and most western users dealing with ancient greek
had available only old keyboards that used to work with an
encoding similar, but not equal, to the ISO 8859-1 (ISO Latin).
Even today in this part of the world, in spite of more modern
operating systems and programs, that use Unicode characters, the
Latin transliteration is very helpful for anyone who does not run
a Greek PC.<br>
<br>
This "original sin" of my Greek fonts is that did work pretty well
with the ligature mechanism; I had uploaded to CTAN (in the first
times of existence of my fonts) a grhyph.tex file; at that time I
created it to be hopefully useful for the three incarnations of
Greek. The first greek.ldf file just loaded it as <b>THE</b> only
babel Greek language (at that time xetex and luatex did not
exist); the only provision that Apostolos created was the use of
the polutonikogreek language, that eventually gave rise to an
attribute, that in turn can now be used as a modifier. With the
advent of xetex and xelatex, Apostolos abandoned babel and
pdflatex, and concentrated his activity on the best adaptation of
the new engine to the benefit of the Greek users.<br>
<br>
Meanwhile the Greek users decided that my patterns did an
acceptable job, but even if hyphenation errors were very few, my
patterns missed a lot of possible break points, in the effort of
being equally (in)sufficient for the three Greek incarnations.<br>
<br>
The actual 6 Greek patten files are the result of a synthesis
performed by Dimitrios, but although they are loaded in the
various format files, the babel-greek.ldf, opposite to the
gloss-greek.ldf, does not use them, but uses only those for
polytonic Greek.<br>
<br>
<br>
Gunter added a lot of good parts to the initial scheme of
greek.ldf, and to the transofrmation of characters in a general
way, the LICR method, so as to let the users keep using the
transliteration or enter the greek text with greek glyphs; the
last edition of the greek.ldf file works also when babel is used
with xelatex and lualatex, but he did not enter in the problem of
changing hyphenation as it is done with polyglossia.<br>
<br>
In order to have things working correctly two actions were
considered necessary.<br>
1) To let babel-greek.ldf use suitable attribute/modifiers in
order to change the infix words, but also in order to change
hyphenation schemes.<br>
2) To modify the ASCII pattern files in order to take into account
non only the ligatures but also the direct input of the
precomposed LGR encoded accented characters.<br>
<br>
Now I have done this draft work, contained in the attached zip
file.<br>
<br>
1a) I have added to the babel-greek.ldf the ancient
attribute/modifier.<br>
1b) I have added the necessary mechanism to change hyphenation
language, so as to accomodate to the default language (monotonic)
and the two variants: polytonic and ancient.<br>
1c) I have added the lower case codes for all the characters for
code points 127 < codepoint < 256.<br>
1d) I have modified the documentation test to explain what I
thought in the necessity a sort of explanation for the user.<br>
1e) the \ProvideLanguage statement has been updated so that it is
easy to distinguish it from previous versions.<br>
<br>
Remember it is just the patch that Günter was asking for; it is
pretty complete, but I tested it only with the default language
(monotonic). It must be completed.<br>
<br>
2a) I created the grmhyph6.tex pattern file for monotonic Greek
that in my opinion should substitute the grmhyph5.tex file; but I
changed name in order to avoid confusion.<br>
2b) The patterns containing ligatures and some other patterns with
single vowels, have been duplicated and in the duplicated version,
the ligature has been changed with the double caret hexadecimal
code point of the character of the precomposed character. For ease
of interpretation not only the file starts with some comment lines
where the double caret hexadecimal code points are spelt out in
plain TeXnical English/Greek but there is also a PDF file
containing the table of all LGR encoded Greek glyphs.<br>
<br>
3a) I have set up a small testing file in order to test the
correctness of the hyphenation patterns at least in a short
sentence with my little package testhyphens.sty (the little
package with which I discovered that things were not running as
they should have done with the actual situation, and that
triggered the start of this thread).<br>
3b) The output of the test file is also included, so you see that
hyphnation of monotonic Greek is now working also with the initial
input of Unicode Greek text, in spite of using pdflatex.<br>
<br>
This set of tentative files is just a starting point, from which
you caan take off to finish the job.<br>
<br>
If you want to test what I did, you have to install the new
pattern file grmhyph6.tex either by changing its name to
grmhyph5.tex and replacing the original grmhyph5.tex; rebuilding
the pdflatex format file, and then running the
TestTesthyphensInGreek.tex file; you obviously may modify
according to what you want to do. I discourage this procedure,
while I encourage the one of creating a language-local.dat file in
the texmf-local/ tree, according with what is described in the
tlmgr documentation when the command <b>tlmgr generate</b> is
looked up (not easy and error prone procedure if you have never
done these things before, but it is within a normal user range, it
does not require a "wizard" certification to do it). This implies
the creation also of a loadhyph-el-monoton6.tex loader of the
grmhyph6.tex file. Read carefully the documentations because the
difficult point is to save the various files in the proper
subdirectories of the texmf-local TeX tree. Then you have to
create a new format pdflatex.fmt file, with the instruments of
your distribution; you have to do it as a
superuser/administrator/root and by means of the fmtutil-sys
executable (read the documetation, if it is the first time you use
it).<br>
<br>
Conclusion: adding the double caret point codes of the second half
page of the LGR encoded CBgreek fonts solves the problems I
initially sreported. The approach is working and can be extended
to the other two ASCII encoded ligature encoded Greek pattern
hyphenation files.<br>
<br>
What remains to be done:<br>
<br>
1) Revise the babel-greek.dtx and pdf files in order to correct
what is just inserted but it has not been tested.<br>
<br>
2) Revise the other two ASCII encoded hyphenation pattern files
(for polytonic and ancient greek) in order to add the double caret
hexadecimal codes of the precomposed glyphs of the LGR encoded
fonts.<br>
<br>
3) revise the system wide distribution of pattern files and
possibly upgrage the loadhyph....tex file according to the actual
names of the new files.<br>
<br>
I see some work for the three of you. <span class="moz-smiley-s3"><span>
;-) </span></span><br>
<br>
Günter has to revise the babel-greek,dtd, and greek.ldf files.<br>
<br>
Dimitrios has to add the missing double caret hexadecimal codes
for the precomposed characters; Dimitrios, if ou know any
scripting laguage sufficently intelligent to do the work, you need
just the time that it takes to write the script and testing it.<br>
<br>
Mojca, when the above actions are completed you probably have to
see if anything has to be "retouched" in order to render it
compliant with the actual mechanism thst is used to create format
files for 8-bit aware typesetting engines.<br>
<br>
The path is opened; now is up to you.<br>
<br>
Thank you for reading the message until this end <span
class="moz-smiley-s1"><span> :-) </span></span><br>
<br>
Claudio<br>
<br>
<br>
<br>
</div>
<br>
</body>
</html>