Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
Signed-off-by: Sertac Ozercan <[email protected]>
  • Loading branch information
sozercan committed May 16, 2024
1 parent 157f0bd commit 4bf23bd
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pkg/aikit2llb/inference/exllama.go
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ func installExllama(c *config.InferenceConfig, s llb.State, merge llb.State) llb
}

savedState := s
s = s.Run(utils.Sh("apt-get update && apt-get install --no-install-recommends -y git ca-certificates python3-pip python3-dev make g++ curl && curl -LsSf https://astral.sh/uv/install.sh | sh && source $HOME/.cargo/env && apt-get clean"), llb.IgnoreCache).Root()
s = s.Run(utils.Sh("apt-get update && apt-get install --no-install-recommends -y git ca-certificates python3-pip python3-dev make g++ curl && curl -LsSf https://astral.sh/uv/install.sh | sh && . $HOME/.cargo/env && apt-get clean"), llb.IgnoreCache).Root()

// clone localai exllama backend only
s = cloneLocalAI(s, backend)
Expand Down

0 comments on commit 4bf23bd

Please sign in to comment.