Can I achieve this with a custom tool?

[thelbg]

Hi,

Experimenting with a small app, I enjoyed integrating Letta but then ran into an issue.
Prior to integrating Letta, my app was using OpenAI API and I defined a function that can call Google Cloud API to query my calendar. It worked well.
Trying to define it as a tool in Letta seems to fail in runtime, and my best guess is that the Letta behavior of running the tool in a sandbox has some limitations. Can you take a look at my code and let me know if there is a way for me to make it work in Letta?

General description of my function/tool:

• The tool creation in my main app.py:

# create a tool from the function
Google_calendar_tool = letta_client.create_tool(get_events_next_30_days)

• Fetches the data of the next 30 days of my Google calendar events
• once called, it requires connecting to the Google API, and if necessary, authenticate (which may require user interaction)
• attached is the file that implements the code of the tool
  google_calendar_helper.py.tar.gz

The error message I receive when the tool is called:
Letta.letta.services.tool_execution_sandbox - ERROR - Executing tool get_events_next_30_days has an unexpected error: name 'get_calendar_service' is not defined
Letta.letta.services.tool_execution_sandbox - ERROR - Logging out tool get_events_next_30_days auto-generated code for debugging: (... followed by a dump of the log)

BTW, I tried to copy the code of 'get_calendar_service' into the code of 'get_events_next_30_days' but then I get similar error messages for other dependecies, such as "name 'os' is not defined" (although it is imported).

1. Is there a chance that I can get this to work as a letta tool, including user authentication step, if needed, or is it not aligned with the Letta tools paradigm?
2. If not supported, is there another way I can ask my agent to let my code execute it and then return the data to the agent for further processing (similar to the OpenAI function flow)?

Thanks,
Lior

[mattzh72]

Hi! We think we know what the issue is, but would we be able to move this conversation to discord? There's higher visibility there. Once we fix this, I will post a link to the discord discussion on this thread.

[thelbg]

Matt, do you have an idea about when do you expect to publish this? Thanks!

[thelbg]

Oh great. Sure, feel free to move it. Thanks,LiorOn Dec 12, 2024, at 1:58 PM, Matthew Zhou ***@***.***> wrote: Hi! We think we know what the issue is, but would we be able to move this conversation to discord? There's higher visibility there. Once we fix this, I will post a link to the discord discussion on this thread. —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: ***@***.***>

[sarahwooders]

@thelbg sorry for the delayed response - for your tool definition, you need all imports and variables to be contained inside the tool definition. You also need to make sure that all dependencies are installed in the environment that the letta server is running inside.

We will have support for custom execution environment that allow you to import your own code/dependencies as long as it's inside the right file -- documentation for this should be out by EOW.

[thelbg]

Thanks Sarah, sounds good! Looking forward to try it out

[thelbg]

Hi, quick follow up Q: I was not using a letta server in my app. Can this work without a letta server or is that a pre-requisite?

[thelbg]

Update: just wanted to share that I was able to get my calendar tool to work, by following your instructions. Thank you!