Code

New chat models#247

Code

Merged

mitya52 merged 8 commits intodevsmallcloudai/refact:devfrom new-chat-modelssmallcloudai/refact:new-chat-modelsCopy head branch name to clipboardDec 22, 2023

+92-22

Commits

Commits on Dec 20, 2023

• WIP: adding new models, needs test

  mitya52

  committed
  1624917

  Copy full SHA for 1624917

• fix models loading

  mitya52

  committed
  1a5c3a5

  Copy full SHA for 1a5c3a5

• fix setup

  mitya52

  committed
  e15c62b

  Copy full SHA for e15c62b

• detect chat as filter caps

  mitya52

  committed
  b7b1418

  Copy full SHA for b7b1418

Commits on Dec 21, 2023

• update setup to build auto-gptq cuda extensions

  mitya52

  committed
  9939cd2

  Copy full SHA for 9939cd2

• install autogptq with cuda 11.8 in dockerfile

  mitya52

  committed
  f9749b9

  Copy full SHA for f9749b9

• update torch to 2.1.2

  mitya52

  committed
  d9d826a

  Copy full SHA for d9d826a

Commits on Dec 22, 2023

• disable phind model due to tokenizer and unexpectedly stop errors

  mitya52

  committed
  dedeff2

  Copy full SHA for dedeff2