Sinitic Diversity

[ztl8702]

Overview

Build a website that gathers and displays information about Sinitic languages.
建立一個展示漢語各分支的資訊（特別是語言保護資訊）的網站。

Goals

• Let the public appreciate that Chinese is not just Mandarin, not just 'Nihao'.
• Showcase the work of language revitalisationists of each language community (i.e. 講福建話運動, 粵典, 客語維基)
• Bring together the Sinitic language revitalisation communities so that one can learn from each other 各社羣可以互通有無，知道其他社羣語言保護者在做什麼，可以效仿
• Provide news feed of what's happening in each community

Components

• A map of Sinitic language communities around the world;
• A tree representation of Sinitic languages
• For each language: a portal of all the news, resources and information about that language. This is much like the Bloomberg Terminal, with information such as:
  • the current status of the language
  • where it is spoken
  • who are doing revitalisation projects for this language
  • news coverage related to this language (realtime feed)
    • what type of event is covered in the news (education? volunteering work? debate about a certain issue? or publication in the language)
    • what is the location of the news event (Geo location; to city-level)

Related Projects

• Linguistic Minorities HK

[ztl8702]

For the "news portal" part

It's kind of like Hacker News or Design News, only that it is not for programmers or designers, but for language revitalisationists. Plus, I want this portal to have more structured information than Hacker News / Design News.

Conceptually that would be a data processing pipeline which:

• Gathers information about Sintic language revitalisation
• Transforms and enhances the data to show a "big picture" of what's happening in each community. This process includes:
  • Distinguish which community this article is talking about (閩東語?閩南語?粵語?), and what is the geo-location of the event happening?
  • Figure out what type the article is? (報導一個語言項目/報導一項活動/報導一個人物/評論文章)
  • Sentiment Analysis
  • Keyword Analysis

Examples of communities to focus on

We will need to distinguish different communities based on language varieties and geo-location. For example, the Hokkien community in Taiwan should be considered separate from the Hokkien community in Malaysia.

(incomplete list)

• 閩東語
  • 福州的福州話社羣
  • 馬祖的福州話社羣
  • 西馬來西亞的福州話社羣（實兆遠）
  • 東馬來西亞的福州話社羣（詩巫、古晉、美里、民都魯 etc.）
• 閩南語
  • 臺灣的臺語社羣
  • 馬來西亞的福建話社羣（特別是檳城，或許需要單列）
• 客家
  • 臺灣的客語社羣
• 粵語
  • 香港的粵語社羣
• 吳語

We will need to classify news article into the above categories / locations.

Examples of article types

• Language-related Story 和語言相關的故事
  • https://www.hk01.com/sns/article/46577
• News coverage of a language-related event/project 關於某個語言相關活動/項目的新聞報導
  • http://news.ltn.com.tw/news/life/breakingnews/2180034
  • http://www.chinapress.com.my/20170808/%E5%87%BA%E7%89%88%E7%A4%BE%E9%85%8D%E5%90%88%E9%A6%AC%E5%A4%A7%E6%A0%A1%E6%85%B6-%E3%80%8A%E9%BC%A0%E9%B9%BF%E8%88%87%E9%B1%B7%E9%AD%9A%E3%80%8B%E8%AD%AF111%E7%A8%AE%E8%AA%9E%E8%A8%80/
  • http://www.orientaldaily.com.my/s/56579
  • http://sh.sina.com.cn/news/k/2017-06-06/detail-ifyfuzmy2159127.shtml
  • https://udn.com/news/story/6966/2817035
• News coverage of a language-related figure 關於某個語言相關人物的新聞報導
  • https://pinprestige.com/ji-an-interview/
  • https://www.youtube.com/watch?v=kHEF-7Ze-fg
• Commentary / Debate 評論/辯論
  • https://opinion.udn.com/opinion/story/10481/2766607
  • http://www.sinchew.com.my/node/1700568/%E5%BC%A0%E5%90%89%E5%AE%89%C2%B7%E8%A2%AB%E9%80%BC%E9%85%8D%E9%9F%B3%E7%9A%84%E6%A7%9F%E5%9F%8E%E4%BA%BA
• 各語言自媒體(FB/微信公衆號)的更新

One article could belong to multiple categories. This is only a rough example.

Projects to learn from technically

• Collecting Low-Density Language Materials on the Web
• Challenges in web corpus construction for low-resource languages in a post-BootCaT world
• Towards a Web search service for minority language communities
• Lobsters
• HackerNews

[ztl8702]

https://udn.com/news/story/6966/2817035

[ztl8702]

https://www.google.com.hk/url?q=https://hal.archives-ouvertes.fr/halshs-00919410/document&sa=U&ved=0ahUKEwi90N2Qo77XAhXLjZQKHV4NDo8QFgg4MAg&usg=AOvVaw2QNo0yRLCoJ3zOwABVJyHe

[ztl8702]

https://www.google.com.hk/url?q=https://minerva-access.unimelb.edu.au/handle/11343/34901&sa=U&ved=0ahUKEwj9287zo77XAhUBnJQKHbPBCOEQFggLMAA&usg=AOvVaw0l2d6KQaWeJv19qROVaPQA

[ztl8702]

https://lobste.rs/about

[ztl8702]

• http://www.michaelnielsen.org/ddi/how-to-crawl-a-quarter-billion-webpages-in-40-hours/
• Bloom filter

[laubonghaudoi]

請問該網站目前的開發進度如何？

[ztl8702]

只是构想。还没有付诸行动。

[laubonghaudoi]

我目前也有建设一个类似网站的相关构想，请问有无其他联系方式，我们可以讨论一下。