!!!Meeting setup * Date: 25.8.2008 * Time: 09.30 Norw. time * Place: Internet * Tools: SubEthaEdit, iChat !!!Agenda Cf. one of the following, depending on context: * the upper bar of the SEE window (provided you use the JSPWiki syntax mode) * the TOC in Forrest-rendered output, like HTML and PDF !!!Opening, agenda review, participants Opened at 10:03. Present: __Ciprian, Jovsset, Sjur, Thomas, Trond__ Absent: __Børre, Tomi__ Agenda accepted as is. !!!Updated task status since last meeting !!Børre * repair G5 ** backed up G5 ** moved all required services to the old Linux server, but it isn't working as well as it should (divvun.no going down all the time, and the restart script does not work) ** worked hard to move all services to the XServe, and to document the prosess ** tested RAM, contacted MacOffice * fix the remaining hunspell conversion bugs ** worked on it a lot, trying to reduce memory consumption * change license on hunspell distros to GPL2+ ** not done * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Ciprian * close the open SVN repository at requested paths (ongoing task) * make a test-all target that runs all tests we have (with Sjur and Trond) * define and document testing routines (with Sjur and Trond) * look at our existing dictionaries and processing tools (ongoing work) ** checking the smenob-entries (automatic pos-assignment for certain lemmata) using the lookup tool * sketch suggestions for improved dictionary infrastructure (ongoing work) ** need more documetation reading about exist/XML-DBs * continue the dictionary infrastructure discussion (with __Sjur, Trond__) !!Jovsset * follow up on {{sma}} corpus texts. Call Sijti Jarnge and Gun Utsi. * get the Verbh manuscript in electronic form * Write and translate leaflet text * distribute CD version through the library bus, the language centres and common sami centres in all of Sápmi !!Lene * Work on test routine with __Trond__ and __Sjur__ !!Per-Eric * follow-up on the {{smj}} texts from __Kurt Tore__ * follow-up contracts from ''Nord-Salten avis'' and __Lena Davidsson__ * Work with missing list same_dutkama_pgr.txt * Plan a {{smj}} pr tour for our tools * contact __Ulf Stefan Winka__ for {{smj}} texts * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Saara * add new XSL/XML headers for proofing test docs * Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not) * implement the ped UI and functionality !!Sjur * follow up on {{sma}} corpus texts ** -> hiring new linguist * name db/risten.no ** nothing here, but more discussions about dictionary infrastructure * update the ''Changes'' document ** nothing * follow-up on some Polderland-related bugs: 621, 630, 652 ** nothing * InDesign documentation ** nothing * make a test-all target that runs all tests we have (with Trond and Ciprian) ** nothing * define and document testing routines (with Trond and Ciprian) ** nothing * write leaflet text ** nothing * hire {{sma}} linguist ** much work here, job interviews now ready and will be conducted this week * continue the dictionary infrastructure discussion (with __Ciprian, Trond__) ** done, ongoing * [fix bugs!|http://giellatekno.uit.no/bugzilla] ** nothing * other things: ** major progress in updating Forrest pdf plugin to support our needs (ie proper i18n and l10n), not yet finished. The goal of the work is to make it possible for us to use standard Forrest, instead of the tailored variant we're using now !!Thomas * look at test cases still not behaving properly ** nothing this week * translate leaflet text ** not done * [fix bugs!|http://giellatekno.uit.no/bugzilla] ** nothing this week !!Tomi * document how compounding is controlled in the PLX conversion * fix double hyphen bugs * fix PL hyphenator errors * fix PL and Hunspell conversion bugs * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Trond * Set up Jabber for Lene ** This time, I have ''forgotten'' it. *** this one depends on the G5 / divvun.no server being online, will at least have to wait until the XServe has taken over the G5 duties * make a test-all target that runs all tests we have (with __Sjur and Ciprian__) ** Still buried under dictionaries * define and document testing routines (with __Sjur and Ciprian__) ** Still buried under dictionaries * Evaluate Hunspell README and installation docs (cf. Divvun frontpage) ** Not done * Dictionaries ** Done substantial updates to the content itself. * rewrite {{.bashrc}} aliases geared towards cvs, if needed ** These should be * prepare external users: Jack Ruether * continue the dictionary infrastructure discussion (with __Ciprian, Sjur__) ** Done. The discussion continues. * [fix bugs!|http://giellatekno.uit.no/bugzilla]. * Other: ** Made first version of the textual side of a Sámi tts. ** Deadline for 3 articles this month. !!!Pedagogical software online Continuously making progress. Meeting memos can be found at [http://giellatekno.uit.no/ped/index.html#Meeting+memos] __TODO:__ * implement the UI and functionality (__Saara__) * get an easy-to-remember URL (__UiT/IT__) * More thorough skin, layout, ... (__External person within the Ped team__, __Internal forrest expert__) This we will postponed until later !!!Corpus gathering Next step: Jovsset to call Sijti Jarnge for texts. Could we get an updated list of Norwegian-Sámi place name pairs from Statens kartverk? Cf [yr.no], which is giving the correct weather forecast independent of which language the place name is written in, that is, they already have such a list. This will help the Ped project, and is useful to all of us. __Thomas__ could look into this. __TODO:__ * follow up on {{sma}} corpus texts (__Sjur, Jovsset__) * follow-up on the {{smj}} texts from __Kurt Tore__ (__Per-Eric__) * other contacts: ''Nord-Salten avis'' (__Børge Strandskog__), Lena Davidsson daughter to Lars-Matto Tuolja * __Ulf Stefan Winka__ has a lot of {{smj}} texts (__Per-Eric__) ** __Thomas__ has discussed this with __Per-Eric__ * plan a {{smj}} pr tour for our tools (__Per-Eric, Thomas__) * meet with the Sámi publishers (meeting delayed) (__Jovsset__) * make leaflet to inform about the project (__Jovsset__) ** first draft available at {{xtdoc/sd/src/documentation/content/xdocs/leaflet.nb.jspwiki}} (there is also a Swedish version there) ** translate text when it is finished (__Thomas, Jovsset__) * distribute CD version through the library bus, the language centres and common sami centres in all of Sápmi. Gaaltije in Östersund for example. (__Leif Åge, Jovsset__) !!!Future plans, directions and ideas See a separate document in {{plan/strat/5year.jspwiki}}. !!!Infrastructure To accomodate future enhancements in different directions (in rough order of importance): # test bench for all parts of our language technology efforts ## test bench enhanced, but not yet complete # close certain parts of the svn code repository ## on the todo list # more modularised make / build infra (prepare for smn, sms, sjd, others) # merge gt, kt and st into one # set up the Leopard Server features for collaborative support: ## permanent chat rooms ## stored (and indexed) chat transcripts of the chat rooms ## iCal server / group calendars ## wiki # wiki? on G5 (is part of Leopard Server) or other web-based documentation # improve Forrest stability and i18n support ( the divvun crashes) ## __Sjur__ has been working on better i18n and pdf rendering ## __Børre__ has some ideas for getting back to serving static html files # reorganise the documentation: ## differ between target groups ## get better grouping ## decide what to write in forrest and what in wiki (cf. Apertium (http://www.apertium.org/ and http://xixona.dlsi.ua.es/apertium/) for a similar split) ## update/add missing parts # migrate lexc lexicons to XML, splitting the task ## Name lexica (the Name project) ## Dictionaries (already in XML, task is to integrate them) ## At least migrate the lexc open POSes (Komi as a pilot case) # change the look of the documentation web # sfst? Both as replacement for xfst and for hunspell/open-source proofing tools # investigate the NSIS installer, potentially replacing the InstallShield package from Polderland # corpus content moved to Max Planck repositories? # update infrastructure to allow content-restricted spellers for special target groups SVN issues: * http access not yet available (https only at the moment, but it works as anonymous checkout if the user is ''not'' specified) * read access to the whole repo is working, BUT: ** {{gt/*/polderland}} should be protected ** {{plan}} should be protected * everything will be google-able by default if the repo URL is posted * certain users need to be on the UiT VPN to be able to commit (bug #705) __TODO:__ * make a test-all target that runs all tests we have (__Ciprian, Sjur, Trond__) * define and document testing routines (__Ciprian, Sjur, Trond__) * add Jabber account in iChat for Lene (__Trond__) * follow-up migration to svn: ** close the open SVN repository at requested paths (__Ciprian__) ** rewrite {{.bashrc}} aliases geared towards cvs, if needed (__Trond__) ** prepare and discuss with external users: Jack Ruether (__Trond__) * try to repair G5 accounts for iCal Server (__Børre__) ** update the OS at the same time *** the G5 needs repair (__Børre__) !!!Linguistics !!North Sámi (nothing new, see proofing bugs below) http://giellatekno.uit.no/bugzilla/show_bug.cgi?id=711 !!Lule Sámi (nothing new, see proofing bugs below) __TODO:__ * {{sme->smj}} lexicon conversion to build bilingual lexicon resources, and increase {{smj}} coverage (__Trond__). * Add the words when all words are ready. !!South Sámi __TODO:__ * get the Verbh manuscript in electronic form (__Jovsset__) * hire a linguist (__Sjur__) !!!Name lexicon/risten.no infrastructure __TODO:__ # fix i18n bug in risten.no/G5 (so they will work without the proper locale request) (__Sjur__) # fix bugs in lexc2xml; add comments to the log element (__Saara__) # finish first version of the editing (__Sjur__) # test editing of the xml files. If ok, then: (__Sjur, Thomas, Trond__) # make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add {{nob}} as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (__Sjur, Saara__) # convert propernoun-($lang)-lex.txt to a derived file from common xml files (__Sjur, Tomi, Saara__) # implement data synchronisation between [risten.no|http://www.risten.no] and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way) # start to use the xml file as source file # clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (__Thomas, linguists__) # merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (__linguists__) # publish the name lexicon on risten.no (__Sjur__) # add missing parallel names for placenames (__linguists__) # add informative links between first names like Niillas and Nils (__linguists__) !!Dictionaries September: * content revision of smenob: ** split in noun, propernoun, adj, verb, other ** make better content * fix the frontend issue (windows, linux) ** Evaluate dictionary providers (Stardict, ...) ** Platform? __TODO:__ * look at our existing dictionaries (__Ciprian__) * sketch suggestions (__Ciprian__) * Continue the dictionary infrastructure discussion (__Ciprian, Sjur, Trond__) * clean up and generalise the make infrastructure * make Linux and Windows local/integrated versions * make simple installer applications * make a public release ** Make a homepage with instructions for dictionary use: {{xtdoc/gtuit/src/documentation/content/xdocs/dict.eng.xml}} ** Clarify the difference between local and online dictionaries: *** Plugin for Firefox and Internet Explorer (online dictionaries) !!!Proofing tools !!Hunspell The conversion script runs out of memory and crashes. __Børre__ is looking into alternative ways of doing the conversion. __TODO:__ # change license on distros to GPL2+ (__Børre__) # QA README and installation docs (__Trond__) # fix the remaining conversion bugs (__Børre, Tomi__) !!Testing !Spelling Error Markup __TODO:__ * Set up ways of adding meta-information (source info, used in testing or not, added to lexicon or not) (__Saara__) * test new and nested error markup (__Sjur__) !!Speller bugs List of bugs returned from Polderland: 621, 630, 652, 656, 676. Open issues based on test results: !sme Version: __Davvisámi, version 1.0.1, 2008-06-02__ * 426 - comp words from Divvun.no - ''guoktedássásaš'' accepted - still __OPEN__ * 435 - roman numbers - inflection of single letter numbers rejected, as well as some complex numbers (but is ok in {{smj}}) - still __OPEN__ ** we should pregenerate all numbers once and for all, and store them in a separate lexicon file * 595 - prefix+name wihtout hyphen (''ovdaLot'' instead of ''ovda-Lot'') - still __OPEN__ * 600 - gen+hyph compound ''sámi-dáru'' - still __OPEN__ * 603 - suomabealdi accepted - still __OPEN__ * 606 - speller accepts VUOHTA compound - still __OPEN__ * 611 - double hyphen sugg still accepted - still __OPEN__ * 613 - short gen. as second compound part - still __OPEN__ * 619 - numerals and pronouns to NAMÁK and SASJ fails - still __OPEN__ * 627 - prefix + hyhpen does not get accepted - __FIXED__ * 629 - ''a'' taking part in compounding without hyphen - still __OPEN__ * 633 - __REGRESSION:__ double hyphens accepted * 634 - PropGen+hyph+PropGen - still __OPEN__ * 641 - numeral+noun compounds - still __OPEN__ * 642 - noun/adj/proper + hyphen + ain - still __OPEN__ * 644 - cased numeral+numeral compund - still __OPEN__ * 646 - adverb + hyphen + noun - still __OPEN__ * 647 - numerals+NOUN - still __OPEN__ * 648 - unmotivated suggestions with numeral+noun - still __OPEN__ * 649 - name + adj compound without hyphen - still __OPEN__ * 654 - speller does not recognize ordinals on -nuppelogát - still __OPEN__ * 655 - pron + nai - still __OPEN__ * 658 - Suggestion saame - still __OPEN__ - won't fix * 666 - guovtte- and njealje- - __FIXED__ * 676 - triple-hyphen - __FIXED__, but double hyphen is still accepted * other __regressions:__ ** ''skuvlajagin'' now accepted ** ''skierranis'' now accepted !smj Version: __Julevsáme, version 1.0.1, 2008-06-02__ * 435 - roman number - single letter numbers now recognised ** we should pregenerate all numbers once and for all, and store them in a separate lexicon file ** please note that ''inflection'' of single letter numerals is __fine__ in {{smj}}, as opposed to {{sme}} * 595 - prefix+name wihtout hyphen (''tsåhkeLot'' instead of ''tsåhke-Lot'') - still __OPEN__ * 599 - __REGRESSION:__ numeral attr:s on lot * 600 - gen+hyph compound ''sáme-dáro'' - still __OPEN__ * 616 - Bispadime-me-ráden - still __OPEN__, try to find an acro or abbr ''me'' * 619 - numerals and pronouns to NAMÁK and SASJ fails - still __OPEN__ * 629 - ''a'' taking part in compound - still __OPEN__ * 634 - rop gen + hyphen + Prop gen - still __OPEN__ * 641 - numeral+noun compounds - still __OPEN__ * 644 - cased numeral+numeral compund - still __OPEN__ * 647 - numerals+NOUN - still __OPEN__ * 648 - unmotivated suggestions with numeral+noun - still __OPEN__ * 649 - name + adj compound without hyphen - still __OPEN__ * 650 - noun prefix+name compound without hyphen - still __OPEN__ * 658 - Suggestion saame - still __OPEN__, won't fix * 692 - __NEW:__ - numeral-variants * other __regressions:__ ** ''gus'' NOT accepted anymore __TODO:__ * compile new speller lexicons (__Tomi__) * document how compounding is controlled in the PLX conversion (__Tomi__) !!Hyphenator bugs Open issues based on test results : !sme Lexicon version: __Davvisámi, version 1.0.1, 2008-04-01__ * 468 - __REGRESSION:__''Márkomeanu'' * 547 - __REGRESSION:__ hyphen in front of vowel: ''Lotnolasealáhusas'' * 548 - __REGRESSION:__ mid syllable hyphenation: ''Háliidivččen'' * 549 - __REGRESSION:__ division without hyph: ''Váccedettiin'' * 673 - adj-derivations: ''guovttenuppelotčoarvvagiin'' (the word is not rec.) * 677 - __NEW:__ Wrongly hyphenated ending -danidja - invalid !smj Lexicon version: __Julevsáme, version 1.0.1, 2008-04-01__ * 545 - __REGRESSION:__ bad hyphenation in compounds: ''åhpadusorganisásjåvnån'' (not recognised) * 546 - __REGRESSION:__ obligatory hyph rules seem to work in facultative manner: ''organisásjåvnån'' (not recognised) * 547 - __REGRESSION:__ hyphen in front of vowel: ''Jienastimnjuolgadusá'' and ''Orgánajs'' __TODO:__ * fix hyphenator errors (__Tomi__) !!InDesign tools Nothing new. !!Releases Support for new Microsoft Office suite in next release. We are waiting for new release to be available to subcontractors. Within a month or so we will release a new version of the spellers, including support for the new Office version, and for Hunspell and aspell if feasible. Beyond improved MS Office version support, we should fix all known linguistic bugs as well. __TODO:__ * update the ''Changes'' document (__Sjur__) * InDesign documentation (__Sjur__) ** Norwegian translation received from Davvi Girji !!!Other !!Speech synthesis __Trond__ had a meeting last week with some relevant parties, and has made a first draft conversion from Sámi text to a Finnish-like transcription suitable for an online synthesis demo for Finnish. {{{ cat text | preprocess | lookup -flags mbTT -utf8 bin/phon-sme.fst | cut -f2 | tr '\n' ' ' | see }}} Glue the result in here: [http://www.bitlips.fi/tts/demo.cgi] !!Forthcoming Sámi allaskuvla conference Info on the [conference site|http://www.samiskhs.no/index.php?c=304&kat=Giellasymposia]. Title submitted is: ''Goallosteapmi ja suorggideapmi Divvun-reaidduin'' Registration: [http://www.viaregi.no/registration/deltagerweb.aspx?kid=3440&aid=8700] Registration deadline is September 10. !!Promoting Divvun Jovsset's neighbor is working at the ''ABC company'', and didn't know about the Divvun tools. Some sort of publicity or commercial for our tools within Sápmi is __really__ needed. It is really important to reach the end users with information about the Divvun project. __TODO:__ * Make a download log (__Børre__) * Finish leaflet * CD distribution * use a newspaper or something to write about the tools from an end-user point of view (a review in Š, Ávvir, Nordsalten avis? ) * Prepare for a coordinated info campaign when Ped is ready (inform teachers about Divvun as well as Ped when we inform about Ped) * Tour de Divvun (smj info tour) * get a stable site! * e-mail list of interested persons (local "installers"/gurus should be on it) !!Forrest news New Forrest component: OOo document out. Hopefully also vice versa (there is already a plugin that reads OOo documents). Goal: Use an off-the-shelf Forrest (the latest, that is), instead of our own version of it. The memory leak issue is still open, but we are hoping for progress. The workaround here is a restart script every 3rd minute. This script worked on the G5, but not on Linux. !!Summer vacations The Divvun team should report their vacation days to __Julie__. Thomas and Sjur done, Børre and Tomi todo. !!Corpus contracts + open source Postponed until the svn repository is fully functional (it is too open now). !!!Next meeting, closing The next meeting is 1.9.2008, 9.30 Norwegian time. The meeting was closed at 11:41. !!!Appendix - task lists for the next five days !!Boerre [iCal|/doc/admin/weekly/2008/Tasks_2008-08-25_Boerre.ics] * repair G5 * fix the remaining hunspell conversion bugs * change license on hunspell distros to GPL2+ * Make a divvun-tools download log * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Ciprian [iCal|/doc/admin/weekly/2008/Tasks_2008-08-25_Ciprian.ics] * close the open SVN repository at requested paths * make a test-all target that runs all tests we have (with Sjur and Trond) * define and document testing routines (with Sjur and Trond) * look at our existing dictionaries * sketch suggestions for improved dictionary infrastructure * continue the dictionary infrastructure discussion (with __Sjur, Trond__) !!Jovsset [iCal|/doc/admin/weekly/2008/Tasks_2008-08-25_Jovsset.ics] * follow up on {{sma}} corpus texts. Call Sijti Jarnge and Gun Utsi. * get the Verbh manuscript in electronic form * Write and translate leaflet text * distribute CD version through the library bus, the language centres and common sami centres in all of Sápmi. * Talk to author of gåessie dah jeatjebh åerieminie, __Christer Olofsson__. * letter to whomever it may concern about the divvun projekt. Translation needed to julevsami and finnish. !!Lene * Work on test routine with __Trond__ and __Sjur__ !!Per-Eric [iCal|/doc/admin/weekly/2008/Tasks_2008-08-25_Per-Eric.ics] * follow-up on the {{smj}} texts from __Kurt Tore__ * follow-up contracts from ''Nord-Salten avis'' and __Lena Davidsson__ * Work with missing list same_dutkama_pgr.txt * Plan a {{smj}} pr tour for our tools * contact __Ulf Stefan Winka__ for {{smj}} texts * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Saara * add new XSL/XML headers for proofing test docs * Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not) * implement the ped UI and functionality !!Sjur [iCal|/doc/admin/weekly/2008/Tasks_2008-08-25_Sjur.ics] * follow up on {{sma}} corpus texts * name db/risten.no * update the ''Changes'' document * follow-up on some Polderland-related bugs: 621, 630, 652 * InDesign documentation * make a test-all target that runs all tests we have (with Trond and Ciprian) * define and document testing routines (with Trond and Ciprian) * write leaflet text * hire {{sma}} linguist * continue the dictionary infrastructure discussion (with __Ciprian, Trond__) * continue work with phon (with __Patrik, Biret-Ánne, Thomas(?)__) * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Thomas * look at test cases still not behaving properly * translate leaflet text * get updated list of Norwegian-Sámi name-pairs from Statens Kartverk * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Tomi * document how compounding is controlled in the PLX conversion * fix double hyphen bugs * fix PL hyphenator errors * fix PL and Hunspell conversion bugs * [fix bugs!|http://giellatekno.uit.no/bugzilla] !!Trond [iCal|/doc/admin/weekly/2008/Tasks_2008-08-25_Trond.ics] * Hunspell QA README and installation docs (ask Börre for details) * Set up Jabber for Lene * make a test-all target that runs all tests we have (with __Sjur and Ciprian__) * define and document testing routines (with __Sjur and Ciprian__) * Evaluate Hunspell README and installation docs (cf. Divvun frontpage) * Dictionaries * prepare external users: Jack Ruether * continue the dictionary infrastructure discussion (with __Ciprian, Sjur__) * [fix bugs!|http://giellatekno.uit.no/bugzilla].