Skip to content

Commit

Permalink
readme 3
Browse files Browse the repository at this point in the history
  • Loading branch information
lilianweng committed Nov 7, 2018
1 parent d61214c commit 0c2786f
Showing 1 changed file with 9 additions and 1 deletion.
10 changes: 9 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,14 @@ Implementations that helped me:
* http://nlp.seas.harvard.edu/2018/04/01/attention.html


### Setup

```bash
$ git clone https://github.com/lilianweng/transformer-tensorflow.git
$ cd transformer-tensorflow
$ pip install -r requirements.txt
```

### Train a Model

```bash
Expand Down Expand Up @@ -44,7 +52,7 @@ $ python train.py --dataset wmt14

Let's say, the model is saved in folder `transformer-wmt14-seq20-d512-head8-1541573730` in `checkpoints` folder.

```
```bash
$ python eval.py transformer-wmt14-seq20-d512-head8-1541573730
```
With the default config, this implementation gets BLEU ~ 20 on wmt14 test set.
Expand Down

0 comments on commit 0c2786f

Please sign in to comment.