Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AgentOps Implementation #411

Merged
merged 32 commits into from
Apr 20, 2024
Merged

AgentOps Implementation #411

merged 32 commits into from
Apr 20, 2024

Conversation

bboynton97
Copy link
Contributor

@bboynton97 bboynton97 commented Apr 2, 2024

Integrates AgentOps.

Adds support for tracking LLM calls, Agents, and Tool usage

@bboynton97 bboynton97 marked this pull request as ready for review April 3, 2024 19:31
@bboynton97
Copy link
Contributor Author

bboynton97 commented Apr 4, 2024

Don't merge this as is. We need to handle the case where agentops isn't installed more gracefully. Working on this now.

src/crewai/crew.py Outdated Show resolved Hide resolved
# Conflicts:
#	poetry.lock
#	src/crewai/tools/tool_usage.py
# Conflicts:
#	src/crewai/crew.py
@ajaywingify
Copy link

@joaomdmoura possible to merge this branch soon? We really need AgentOps to monitor the performance of a support bot we're building using Crew.

pyproject.toml Outdated
@@ -28,6 +28,7 @@ click = "^8.1.7"
python-dotenv = "1.0.0"
embedchain = "^0.1.98"
appdirs = "^1.4.4"
agentops = "^0.1.1"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's make it optional, same way we do to crewai-tools, so we don't add the extra dependency for everyone, feel unnecessary if people are not using agent ops

pyproject.toml Outdated
@@ -28,6 +28,7 @@ click = "^8.1.7"
python-dotenv = "1.0.0"
embedchain = "^0.1.98"
appdirs = "^1.4.4"
agentops = { version = "^0.1.1", optional = true }
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updating it to be an option dependency, so we might need to add some fallback when importing the agent ops

@joaomdmoura
Copy link
Collaborator

temporarily merging this for the weekend

@joaomdmoura joaomdmoura merged commit 3d52575 into crewAIInc:main Apr 20, 2024
0 of 3 checks passed
joaomdmoura added a commit that referenced this pull request May 2, 2024
bhancockio pushed a commit that referenced this pull request Jan 2, 2025
* implements agentops with a langchain handler, agent tracking and tool call recording

* track tool usage

* end session after completion

* track tool usage time

* better tool and llm tracking

* code cleanup

* make agentops optional

* optional dependency usage

* remove telemetry code

* optional agentops

* agentops version bump

* remove org key

* true dependency

* add crew org key to agentops

* cleanup

* Update pyproject.toml

* Revert "true dependency"

This reverts commit e52e8e9.

* Revert "cleanup"

This reverts commit 7f5635f.

* optional parent key

* agentops 0.1.5

* Revert "Revert "cleanup""

This reverts commit cea33d9.

* Revert "Revert "true dependency""

This reverts commit 4d1b460

* cleanup

* Forcing version 0.1.5

* Update pyproject.toml

---------

Co-authored-by: João Moura <[email protected]>
bhancockio pushed a commit that referenced this pull request Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants