Skip to content

V2.2.0 - bugfix and better interface to detokenizer

Compare
Choose a tag to compare
@amir-zeldes amir-zeldes released this 17 Jun 14:06
· 332 commits to master since this release
a35476b
  • Refactor rf_tokenizer for relative import as single file
  • Smarter auto 'line' tag detection in api.py
  • Adjust boundaries within thetas in 'from pipes' mode (bug fix)
  • Add detokenizer to web interface
  • More control over detokenizer aggressive/conservative + split norms at group merge point
  • Option to merge gold trees into pipeline