Skip to content

Commit

Permalink
Apply suggestions from code review
Browse files Browse the repository at this point in the history
Co-authored-by: vb <vaibhavs10@gmail.com>
  • Loading branch information
mishig25 and Vaibhavs10 authored Oct 7, 2024
1 parent 20fd826 commit 5246377
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions packages/tasks/src/local-apps.ts
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,7 @@ const snippetLlamacpp = (model: ModelData, filepath?: string): LocalAppSnippet[]
`${binary} \\`,
` --hf-repo "${model.id}" \\`,
` --hf-file ${filepath ?? "{{GGUF_FILE}}"} \\`,
` -p "${model.tags.includes("conversational") ? "You are a helpful assistant" : "Once upon a time "}"`,
` -p "${model.tags.includes("conversational") ? "You are a helpful assistant" : "Once upon a time"}"`,
].join("\n");
if (model.tags.includes("conversational")) {
snippet += " \\\n --conversation";
Expand Down Expand Up @@ -164,7 +164,7 @@ const snippetVllm = (model: ModelData): LocalAppSnippet[] => {
` -H "Content-Type: application/json" \\`,
` --data '{`,
` "model": "${model.id}",`,
` "prompt": "Once upon a time ",`,
` "prompt": "Once upon a time",`,
` "max_tokens": 512,`,
` "temperature": 0.5`,
` }'`,
Expand Down
2 changes: 1 addition & 1 deletion packages/tasks/src/model-libraries-snippets.ts
Original file line number Diff line number Diff line change
Expand Up @@ -381,7 +381,7 @@ llm = Llama.from_pretrained(
)`;
} else {
snippet += `output = llm(
"Once upon a time ",
"Once upon a time",
max_tokens=512,
echo=True
)
Expand Down

0 comments on commit 5246377

Please sign in to comment.