Skip to content

Ethanscuter/tokenizer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Chinese Words Frequencies Analysis

BRM is a project for Chinese words frequencies analysis.

- Wordlist is obtained and cleaned from the morden Chinese frequency dictionary.
- Jieba is used to tokenize sentences in the corpus.

Requirement:

- Python 3.8
- Pandas 1.3.4
- Jieba 0.42.1

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages