GitHub - amartyads/bert-practice-pytorch: Examples testing out BertForMaskedLM and BertForSequenceClassification. Uses dataset at https://archive.ics.uci.edu/ml/datasets/YouTube+Spam+Collection

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
BERT masked LM.py		BERT masked LM.py
BERT youtube comments.py		BERT youtube comments.py
README.txt		README.txt

Repository files navigation

These python programs were run on Spyder, to explore how BERT pretrained models are used with PyTorch.

BERT youtube comments.py uses the dataset available at https://archive.ics.uci.edu/ml/datasets/YouTube+Spam+Collection , and tries to classify comments as spam or ham.

BERT masked LM.py takes one sentence, sees its output in the pretrained corpus, and tries to finetune the corpus to give desired output.