!!!Meeting setup * Date: 12.11.2007 * Time: 09.30 Norw. time * Place: Internet * Tools: SubEthaEdit, iChat/Skype !!!Agenda # Opening, agenda review # Reviewing the task list from last week # Documentation - divvun.no # Corpus gathering # Corpus infrastructure # Infrastructure # Linguistics # name lexicon infrastructure # Spellers # Other issues # Summary, task lists # Closing !!!1. Opening, agenda review, participants Opened at 09:44. Present: __Børre, Ilona, Risten, Sjur, Thomas, Tomi, Trond__ Absent: __Per-Eric__ Agenda accepted as is. !!!2. Updated task status since last meeting !!Børre * move __Steinar's__ error markup in the xml files to (a copy of) the original ** not done * follow-up support for the sami languages in OpenOffice.org ** not done * fix Unicode bug in Hunspell conversion java code ** haven't found any solution * fix [bug 550|http://giellatekno.uit.no/bugzilla/show_bug.cgi?id=550] ** not done * install Leopard on the G5 and the Xserve ** Done * move giellatekno.uit.no (including Bugzilla) and www.divvun.no to the G5. ** bugzilla is not available yet, haven't been able to compile the necessary perl module for database access. * add paradigm testing ** not done * fix Windows CD installation bug ** not done * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Ilona * lexicalise {{smj}} missing words ** In letter s * add {{smj}} proper nouns ** done, but without me. * other {{smj}} tasks, ask __Thomas__ ** Not asked. !!Maaren * lexicalise actio compounds !!Per-Eric * lexicalise words from the Olavi missing list * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Risten * finish the design/text for the CD and the cover ** not finish * set up CD-printing printer ** Leif Åge has ordered a new printer * try to burn a CD at SD ** done !!Saara * add new XSL/XML headers for proofing test docs * Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not) * add nested error markup to xml conversion * add hunspell testing support ** done !!Sjur * work on the XML name editor/risten.no integration ** nope * set up risten.no on the G5 again ** still no work * test new and nested error markup ** not yet * get command line hyphenator for automated testing of the hyph-lexicons ** recieved a first version, it contains the hyphenation bug, but it lets us set up the hyphenation test bench * add hyphenation testing ** not yet * add hunspell testing ** done * add paradigm testing ** almost done * fix [bug 550|http://giellatekno.uit.no/bugzilla/show_bug.cgi?id=550] ** no * fix hyphenation of derivations, inflections ** done * follow-up support for the sami languages in OpenOffice.org ** done - it looks promising at the moment, but the OOo deadline for getting into OOo 2.4 is this week - otherwise we have to wait until version 3:( * fix Windows CD installation bug ** not yet * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Thomas * {{sme->smj}} lexicon conversion to build bilingual lexicon resources ** not this week * add {{smj}} proper nouns ** added * check for bad hyphenation ** not this week * look at test cases still not behaving properly ** worked a lot * fix hyphenation of derivations, inflections ** done * {{sme->smj}} name conversion ** done * [fix bugs!|http://giellatekno.uit.no/bugzilla] ** worked !!Tomi * Hunspell lexicon conversion ** not done * {{sme->smj}} lexicon conversion to build bilingual lexicon resources ** not done * fix Unicode bug in Hunspell conversion java code ** done * fix hyphenation of derivations, inflections ** done * [fix bugs!|http://giellatekno.uit.no/bugzilla] ** fixing !!Trond * {{sme->smj}} lexicon conversion to build bilingual lexicon resources ** Progress, progress * fix hyphenation of derivations, inflections ** Meeting held, the linguistic side seems ok, but awaiting speller testing to see whether we are there. * {{sme->smj}} name conversion ** Done. * telephone meeting with __Sjur__ and the faroese group re faroese speller ** Still not been able to get hold of the two of them at the same time. * [fix bugs!|http://giellatekno.uit.no/bugzilla]. ** Nothing done here. !!!3. Documentation Nothing new. __TODO:__ * fix [bug 550|http://giellatekno.uit.no/bugzilla/show_bug.cgi?id=550] (__Børre, Sjur__) !!!4. Corpus infrastructure Nothing. !!!5. Infrastructure [http://giellatekno.uit.no] and [http://www.divvun.no] are now hosted on the G5. Bugzilla is not yet up and running again. {{{ ssh www.divvun.no = G5 ssh giellatekno.uit.no = G5 ssh 129.242.220.111 = xserve }}} Jabber support = iChat server: * encrypted chats * permanent chat rooms * stored and forwarded messages * archive of chats, indexed and searchable Addresses of the format: {{{ sjur@divvun.no trond@giellatekno.uit.no }}} __TODO:__ * add Jabber account in iChat (__all__) !!!6. Linguistics !!North Sámi We solved(?) the hypheantion problem, but got instead a circularity problem. Meeting 12:30 Norw. time Tuesday to fix the circularity problem after the hyphenation fix. __TODO:__ * fix hyphenation of derivations (__Thomas, Tomi, Sjur, Trond__) ** done, but not tested * fix circularity issue (__Sjur, Tomi, Trond__) !!Lule Sámi Name conversion improvements last week. __TODO:__ * lexicalise words from the Olavi missing list, but check against the pdf original where in doubt (__Per-Eric__) ** __Ilona__ is working on the last letter in the alphabet, we're almost finished:) * {{sme->smj}} lexicon conversion to build bilingual lexicon resources, and increase {{smj}} coverage (__Trond, Thomas, Svenne__) ** some additions coming in there as well, but not until we have checked every new word manually * {{sme->smj}} name conversion (__Trond, Thomas__) ** done * add proper nouns (__Thomas, Ilona__) ** nothing more to be done * look at missing baseforms (__Thomas__) ** only two missing baseforms at the moment:) !!!7. Name lexicon infrastructure This sub-project needs to get up and running soon. Mainly __Sjur's__ task. Decisions made in Tromsø can be found in [this meeting memo.|/admin/physical_meetings/tromso-2006-08-propnoun.html] __TODO:__ # set up Tomcat and risten.no on the G5 again (__Sjur, Børre__) ## install risten.no # fix bugs in lexc2xml; add comments to the log element (__Saara__) # finish first version of the editing (__Sjur__) # test editing of the xml files. If ok, then: (__Sjur, Thomas, Trond__) # make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (__Sjur, Saara__) # convert propernoun-($lang)-lex.txt to a derived file from common xml files (__Sjur, Tomi, Saara__) # implement data synchronisation between [risten.no|http://www.risten.no] and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way) # start to use the xml file as source file # clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (__Thomas, Maaren, linguists__) # merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (__linguists__) # publish the name lexicon on risten.no (__Sjur__) # add missing parallel names for placenames (__linguists__) # add informative links between first names like Niillas and Nils (__linguists__) !!!8. Proofing tools !!Hunspell TODO: # Follow-up support for the sami languages in OpenOffice.org (__Børre, Sjur__) ## there is still hope to get them included in OOo 2.4 # Hunspell lexicon conversion (__Tomi, Børre__) ## nothing major happened last week, working on getting the basic conversion correctly (ie complete and correct inflection), then adding derivation # add hunspell testing to the make file (__Sjur__) ## done !!Testing !Spelling Error Markup __TODO:__ * Set up ways of adding meta-information (source info, used in testing or not, added to lexicon or not) (__Saara__) * move __Steinar's__ error markup in the xml files to (a copy of) the original (__Børre, Kimme__) * add nested error markup to xml conversion (__Saara__) * test new and nested error markup (__Sjur__) !Automated testing Paradigm testing implemented, but the reporting needs improvements. Testing manually: {{{ cd gt/sme/testing gen-paradigms.sh }}} Output in {{paradigm-sme.txt}}. Test words should go in the file {{parawlist.txt}}. The format is like this: {{{ WORDPOS áigi n ráhkistit v }}} We need to separate proper nouns from regular nouns properly, by checking the files {{prop-codes.txt}} and {{n-codes.txt}}, as well as making sure the Makefile has support for proper noun paradigm generation. __TODO:__ * add hyphenation testing (__Sjur__) * add hunspell testing (__Saara, Sjur__) ** implemented * add paradigm testing (__Børre, Sjur__) ** done, but needs improvements !MS Office We need to check that the proofing tools are working in all Office applications, not only Word. This is especially important on Windows, which includes quite a few applications in the bundle. __TODO:__ * test the proofing tools with all MS Office applications (__Børre, Thomas__) !!Lexicon conversion to the PLX format Open issues based on test results: !smj 482 - still problematic, 552 - still open, Svierigadárogielan - still rejected !sme 397 - not as good as it should be, 408 - fixed, 419, 425 - roman number, 431, 452 - ''miel'' is a prefix, 461 - ''ovda'' accepted, almost 50 % (17) gets correct suggestion, 489, 508 - fixed, 522, 524. __TODO:__ * look at test cases still not behaving properly (__Thomas, Tomi__) !!InDesign tools __TODO:__ * add hyphenation testing (__Sjur__) !!Hyphenators We should look into the possibility of generating pattern-based hyphenation for OOo. It shouldn't be too hard, or require too much work, but needs investigation. __TODO:__ * get command line hyphenator (__Sjur__) !!Release version We need to print the CD cover pretty soon, and for that we need to finish the CD cover, especially the back side text. The cover proof print should be ready in 14 days, ie Nov. 26. __TODO:__ * try to burn a CD at SD (__Risten, Leif-Åge__) * finish text to go on the CD cover (__Risten__) * set up CD-printing printer (__Risten__) * fix Windows CD installation bug (__Sjur, Børre__) * get price and schedule for printed CD cover (__Risten__) !!Actual release December 11-13, one of these days. !!!9. Other !!Corpus contracts Delayed till after final release. TODO: * publish corpus contracts and project infra as open-source on NoDaLi-sta (__Sjur__) !!Faroese Speller for {{fao}} using our infrastructure and the knowledge we have. __TODO:__ * set up a telephone meeting with them and __Sjur__ (__Trond__) !!Bug fixing When fixing bugs, record the version number containing the fix in the Bugzilla bug report, such that for each bug, we know exactly when it should have been fixed, in what file(s) and what version. __69__ open Divvun/Disamb bugs (__35__ of these 56 are speller-related bugs, __34__ are other bugs), and __23__ risten.no bugs !!Dictionaries We have now 7 dictionaries in xml format that could be published in a risten.no-like framework. __Trond__ would like to have them online, both for the feedback and usefulness to the public. It requires that eXist/XQuery + homepage, and conversion to a proper presentation format is in place. __TODO__: * eXist on G5 - done * risten.no on G5 - homepage done, but needs port tweaking/changing * risten.no XQuery framework - NOT done * XInclude conversion script - NOT done * homepage on the documetation pages - draft done !!Parallel corpora There will be a parallel corpus seminar this weekend. It would have been nice to have parallel text for that: * fkvnob (from Kvensk Institutt) * smenob, smanob, smjnob (from Sámi skuvlahistorjá) __TODO:__ * discuss more parallel texts (__Børre, Saara, Trond__) !!SD yearly personell seminar 6.-7. December. __Sjur__ will discuss it with Julia, but our view is that we don't have time to go this year. The release are just a few days later. !!Software updates * SubEthaEdit - Ilona still missing:) * Leopard, 10.5 ** installed: *** Børre *** Sjur *** Risten ** not yet: *** Thomas *** Ilona *** Tomi *** Trond *** Per-Eric * Skype 2.6.x !!!10. Next meeting, closing The next meeting is 19.11.2007, 09:30 Norwegian time. __Trond__ will be away in the next meeting. The meeting was closed at 11:13. !!!Appendix - task lists for the next week !!Boerre * move __Steinar's__ error markup in the xml files to (a copy of) the original * fix Unicode bug in Hunspell conversion java code * fix [bug 550|http://giellatekno.uit.no/bugzilla/show_bug.cgi?id=550] * move Bugzilla to the G5. * fix Windows CD installation bug * discuss more parallel texts * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Ilona * lexicalise {{smj}} missing words * other {{smj}} tasks, ask __Thomas__ !!Maaren * lexicalise actio compounds !!Per-Eric * lexicalise words from the Olavi missing list * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Risten * finish the design/text for the CD and the cover * set up CD-printing printer * try to burn a CD at SD * get price and schedule for printed CD cover !!Saara * add new XSL/XML headers for proofing test docs * Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not) * add nested error markup to xml conversion * discuss more parallel texts !!Sjur * work on the XML name editor/risten.no integration * set up risten.no on the G5 again * test new and nested error markup * get command line hyphenator for automated testing of the hyph-lexicons * add hyphenation testing * improve paradigm testing * fix [bug 550|http://giellatekno.uit.no/bugzilla/show_bug.cgi?id=550] * follow-up support for the sami languages in OpenOffice.org * fix Windows CD installation bug * fix circularity issue in nonrec transducers * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Thomas * {{sme->smj}} lexicon conversion to build bilingual lexicon resources * check for bad hyphenation * look at test cases still not behaving properly * paradigm testing * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Tomi * Hunspell lexicon conversion * fix circularity issue in nonrec transducers * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Trond * {{sme->smj}} lexicon conversion to build bilingual lexicon resources * fix hyphenation of derivations, inflections * telephone meeting with __Sjur__ and the faroese group re faroese speller * fix circularity issue in nonrec transducers * discuss more parallel texts * [fix bugs!|http://giellatekno.uit.no/bugzilla].