!!!Meeting setup * Date: 21.1.2008 * Time: 09.30 Norw. time * Place: Internet * Tools: SubEthaEdit, iChat/Skype !!!Agenda Cf. one of the following, depending on context: * the upper bar of the SEE window (provided you use the JSPWiki syntax mode) * the TOC in Forrest-rendered output, like HTML and PDF !!!1. Opening, agenda review, participants Opened at 09:48. Present: __Børre, Per-Eric, Sjur, Thomas, Tomi, Trond__ Absent: __Maaren__ Agenda accepted as is. !!!2. Updated task status since last meeting !!Børre * start to reorganise the documentation ** not done * check who signed the corpus contracts with __Kurt Tore__, and when * gather {{sma}} texts ** not done * improve forrest stability with i18n, site look ** not done * set up the Leopard Server features for collaborative support ** not done * Hunspell lexicon conversion ** continued work * InDesign documentation ** not done * investigate the NSIS installer ** had a look * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Maaren * Put the list of possible {{sma}} corpus sources into a document * update the ''Changes'' document !!Per-Eric * check some unusual and missing words from the last Olavi missing list ** Still working with it * Corpus gathering, keep the contact with Kurt Tores family about his texts ** Nothing new, no mail from them * Corpus gathering, try to call Sigga Tuolja Sandstrøm again, about her texts ** I have contacted her, and I will visit her personally in Malå maybe next week * [fix bugs!|http://giellatekno.uit.no/bugzilla] ** nothing done !!Saara * add new XSL/XML headers for proofing test docs * Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not) * discuss more parallel texts !!Sjur * document Windows CD installation work-around ** not done * start to reorganise the documentation ** not done * gather {{sma}} texts ** not done * improve forrest stability with i18n, site look ** not done * set up the Leopard Server features for collaborative support ** not done * check the present {{sma}} sources ** not done * name db/risten.no ** got it up and running again on the G5, __Thomas__ and __Børre__ could use it, but ''NOT'' __Trond__ * improve hyphenation testing ** working on it with __Saara__ * investigate the NSIS installer ** not done * get hotel rooms in Snåsa ** not done, but discussed the date (it was changed) and organisation with Julie and Joseph * make a first {{sma}} project plan ** not done * publish corpus contracts and project infra as open-source on NoDaLi-sta ** not done * add verb paradigm generation bug to Bugzilla ** not done * contact DG and MÁ about proofing tools for InDesign ** done, the new newspaper, __Ávvir__, is released Feb. 6. We should deliver final InDesign tools one week ahead of that, that is, by mid next week. * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Thomas * {{sme->smj}} lexicon conversion to build bilingual lexicon resources ** not any this week * look at test cases still not behaving properly ** worked some * add {{%>:0}} alphabet entry in twolc, with a {{%>}} variant for HUNSPELL ** done * [fix bugs!|http://giellatekno.uit.no/bugzilla] ** worked !!Tomi * Hunspell lexicon conversion ** not done * document how compounding is controlled in the PLX conversion ** not done * [fix bugs!|http://giellatekno.uit.no/bugzilla] ** fixed some !!Trond * {{sme->smj}} lexicon conversion to build bilingual lexicon resources ** Now more words in than out... * Reorganise documentation (with Børre and Sjur) ** Not done * Gather sma texts (with Børre and Sjur) ** Not done * Look at the sma source files (with Sjur) ** Done alone, still awaiting common meeting * Name lexicon project: Test editing xml files (when they are ready for it) ** Not there yet * Make a first {{sma}} project plan ** Not done. * [fix bugs!|http://giellatekno.uit.no/bugzilla]. !!!3. Documentation __TODO:__ * start to reorganise the documentation (__Børre, Sjur, Trond__) !!!4. Corpus gathering __TODO:__ * follow-up on the {{smj}} texts from __Kurt Tore__ (__Per-Eric__) * check who signed the corpus contracts with __Kurt Tore__, and when (__Børre__) ** done * call Sigga Tuolja Sandstrøm again, about her texts ** done, planning to go visit her; she has 5 books, and one unpublished * gather {{sma}} texts (__Børre, Sjur, Trond__) * Put the list of possible corpus sources into a document {{gt/doc/lang/sma/sma-corpus-plan.jspwiki}} (__Maaren__) !!!5. Infrastructure __TODO:__ * add Jabber account in iChat (__all__) * improve forrest stability with i18n, site look (__Børre, Sjur, Tomi__) * set up the Leopard Server features for collaborative support - permanent chat rooms, project calendar(s), wiki? (__Børre, Sjur__) !!!6. Linguistics !!North Sámi Hyphenation bugs still there, needs improved test bench. !!Lule Sámi Hyphenation: same as for {{sme}}. __TODO:__ * {{sme->smj}} lexicon conversion to build bilingual lexicon resources, and increase {{smj}} coverage (__Trond, Svenne__). Add the words when all words are ready. !!South Sámi __TODO:__ * check the present sources (__Sjur, Trond__) !!!7. Name lexicon infrastructure Decisions made in Tromsø can be found in [this meeting memo.|/doc/admin/physical_meetings/tromso-2006-08-propnoun.html] __TODO:__ # fix bugs in lexc2xml; add comments to the log element (__Saara__) # finish first version of the editing (__Sjur__) # test editing of the xml files. If ok, then: (__Sjur, Thomas, Trond__) # make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (__Sjur, Saara__) # convert propernoun-($lang)-lex.txt to a derived file from common xml files (__Sjur, Tomi, Saara__) # implement data synchronisation between [risten.no|http://www.risten.no] and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way) # start to use the xml file as source file # clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (__Thomas, Maaren, linguists__) # merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (__linguists__) # publish the name lexicon on risten.no (__Sjur__) # add missing parallel names for placenames (__linguists__) # add informative links between first names like Niillas and Nils (__linguists__) !!!8. Proofing tools !!Hunspell The %> marker does not survive into Hunspell to work as a boundary marker, despite being defined as %> for the Hunspell version. Priority list: # debug the missing > marker # add {{smj}} to the soup, make sure it works roughly as good as {{sme}} # fix the remaining conversion bugs for {{sme}} # return to {{smj}}, and fix whatever is left to fix # integrate the derivations as separate "continuation lexicons" TODO: * Hunspell lexicon conversion (__Tomi, Børre__) * add {{‰>:‰>}} before every {{+Fem}} etc. tag (__Thomas__) ** done * add {{%>:0}} alphabet entry in twolc, with a {{%>}} variant for HUNSPELL (__Thomas__) ** done !!Testing !Spelling Error Markup __TODO:__ * Set up ways of adding meta-information (source info, used in testing or not, added to lexicon or not) (__Saara__) * move __Steinar's__ correct files to the corpus repository (__Børre__) ** done * test new and nested error markup (__Sjur__) !Automated testing __TODO:__ * improve hyphenation testing (__Sjur__) ** working on it * add verb paradigm generation bug to Bugzilla (__Sjur__) !!Lexicon conversion to the PLX format Open issues based on test results: !sme * 425 - roman number - will not be fixed in 1.0 release * 426 - comp words from Divvun.no - ''guoktedássásaš'' accepted - still open ** numerals are now compounded, as in ''guokteduhát'' * 536 - __REGRESSION:__ speller accepts "impossible" compound-forms, ''geažideapmigárvu'' and ''giddesteapmisággi'' accepted - __FIXED__ * 593 - missing words in beta2, still missing ''Nuppelohkái'' - not lexicalized * 595 - prefix+name wihtout hyphen (''ovdaLot'' instead of ''ovda-Lot'') * 597 - does not recognize nubbelohki - not lexicalized * 603 - suomabealdi, norggabealdi accepted * 606 - speller accepts VUOHTA compound ** what about restricting the compound tags filter to disregard tags to the left of derivations? * 609 - Anár-julggaštusa not recognized - __FIXED__, but still need to add a test case for the positive test ** test case added * 611 - double hyphen sugg still accepted * 613 - short gen. as second compound part * 622 - Words with clitic -ban not accepted - __FIXED__ * 625 - word+footnote - possibly Polderland or MS, or a consequence of allowing spell checking of words including digits * 627 - prefix + hyhpen does not get accepted !smj * 482 - __REGRESSION:__ ''Nuorttalijguovlojn'' accepted again * 575 - name+name compounds, three test cases not accepted - __FIXED__ * 599 - numeral attr:s on lot, ''golmmalåk'' still not accepted - it is wrong and correctly sugg. - __FIXED__ * 607 - __REGRESSION:__ acro + hyphen, ''NRKGA'' accepted * 615 - actio and actor compounds - ''bargogáddjon'' still missing ** ACTORTV essive doesn't get left tags * 616 - Bispadime-me-ráden * 618 - dipht. simpl. * 624 - gen of ÅLLAGASJ-adj as first prt of cmp - __FIXED__ * 628 - nevaga * 629 - ''a'' taking part in compound __TODO:__ * look at test cases still not behaving properly (__Thomas, Tomi__) * document how compounding is controlled in the PLX conversion (__Tomi__) !!InDesign tools The speller works in InDesign and InCopy. Lacks user defined lexicons, but Polderland is trying to fix this bug. The new Sámi newspaper, ''Ávvir'', is publishing its first edition on February 6th. We should release final InDesign tools, including final spellers, one week ahead of that, Wednesday Jan. 30th. __TODO:__ * improve hyphenation testing (__Sjur__) * contact DG and MÁ about proofing tools for InDesign (__Sjur__) ** Done * test that the hyphenation is identical in InDesign and the command line hyphenator (__Sjur__) !!Hyphenators We need more test data, to test hyphenation of different types of words. __Thomas__ should make a file {{gt/sme|smj/testing/hyphenation.txt}} of the format: {{{ compoundword com^pound#word }}} It should contain all possible word formation patterns and their correct hyphenation. That is, at least: * compounds * derivations * names * misspellings * compounds with acros, numbers, names, etc. __TODO:__ * create hyphenation test data (__Thomas__) !!Windows installer __TODO:__ * investigate the NSIS installer (__Børre, Sjur__) !!Releases __TODO:__ * update the ''Changes'' document (__Maaren__) * release InDesing tools Jan. 30. (__Børre, Sjur, Thomas, Tomi__) ** compile new lexicons (__Tomi__) ** test (__all__) ** document (__Sjur__) ** package and release (__Sjur__) !!!9. Other !!South Sámi project startup meeting * in Snåsa * 11th - 15th of Feb, kick-off meeting Wednesday 13. * Participants: SD (incl. Divvun), Nord-Trøndelag fylkeskommune, Snåsa kommune, UiT, "resource persons", south Sámi part of SGL (at least one representative) We extend the meeting on our part, to have this project's first gathering. __TODO:__ * get hotel rooms (__Sjur__) * make a first {{sma}} project plan (__Sjur, Trond__) !!Corpus contracts + open source TODO: * publish corpus contracts and project infra as open-source on NoDaLi-sta (__Sjur__) !!Bug fixing When fixing bugs, record the version number containing the fix in the Bugzilla bug report, such that for each bug, we know exactly when it should have been fixed, in what file(s) and what version. __83__ open Divvun/Disamb bugs (__45__ of these 83 are speller-related bugs, __38__ are other bugs), and __23__ risten.no bugs !!!10. Next meeting, closing The next meeting is 28.1.2008, 09:30 Norwegian time. The meeting was closed at 10:59. !!!Appendix - task lists for the next week !!Boerre [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Boerre.ics] * start to reorganise the documentation * gather {{sma}} texts * improve forrest stability with i18n, site look * set up the Leopard Server features for collaborative support * Hunspell lexicon conversion * InDesign documentation * investigate the NSIS installer * release InDesing tools Jan. 30. * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Maaren [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Maaren.ics] * Put the list of possible {{sma}} corpus sources into a document * update the ''Changes'' document !!Per-Eric [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Per-Eric.ics] * check some unusual and missing words from the last Olavi missing list * keep the contact with Kurt Tores family about his texts, send a new contract * try to visit __S T Sandstrøm__ personally as soon as possible, maby this week * try to find other authors who have smj texts digitaly * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Saara [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Saara.ics] * add new XSL/XML headers for proofing test docs * Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not) * discuss more parallel texts !!Sjur [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Sjur.ics] * document Windows CD installation work-around * start to reorganise the documentation * gather {{sma}} texts * improve forrest stability with i18n, site look * set up the Leopard Server features for collaborative support * check the present {{sma}} sources * name db/risten.no * improve hyphenation testing * investigate the NSIS installer * get hotel rooms in Snåsa * make a first {{sma}} project plan * publish corpus contracts and project infra as open-source on NoDaLi-sta * add verb paradigm generation bug to Bugzilla * test that hyphenation is identical in InDesign and the command line tool * release InDesing tools Jan. 30. * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Thomas [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Thomas.ics] * look at test cases still not behaving properly * create hyphenation test data * release InDesing tools Jan. 30. * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Tomi [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Tomi.ics] * Hunspell lexicon conversion * document how compounding is controlled in the PLX conversion * release InDesing tools Jan. 30. * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Trond [iCal|/doc/admin/weekly/2008/Tasks_2008-01-21_Trond.ics] * {{sme->smj}} lexicon conversion to build bilingual lexicon resources * Reorganise documentation (with Børre and Sjur) * Gather sma texts (with Børre and Sjur) * Look at the sma source files (with Sjur) * Name lexicon project: Test editing xml files (when they are ready for it) * Make a first {{sma}} project plan * [fix bugs!|http://giellatekno.uit.no/bugzilla].