Agent with Llama3.1 #1428
Unanswered
nacartwright
asked this question in
Q&A
Agent with Llama3.1
#1428
Replies: 1 comment 1 reply
-
|
Good Q, and one comment is that the formatting really depends on the model host, since they all will do slightly different things like maybe templateing and parse the tool outputs. What host are you using here? |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
NVIDIA NIMs currently. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm attempting to create a LangGraph and/or agent with Llama3.1. I've attempted to use the create_tool_calling_agent agent. It calls the tool just fine but for some reason the output is just:
{'input': 'What is the current price of CDW on NASDAQ?',
'output': '<|python_tag|><function=google_finance>{"stock_symbol": "CDW", "market": "NASDAQ"}'}
Not sure how to get rid of that output and actually have it answer the question. Thoughts or examples of a tool calling agent with Llama3.1 Instruct is appreciated.
Beta Was this translation helpful? Give feedback.
All reactions