Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removed Mentions of Mask RCNN #8853

Open
wants to merge 12 commits into
base: develop
Choose a base branch
from

Conversation

prateekshukla1108
Copy link

@prateekshukla1108 prateekshukla1108 commented Dec 20, 2024

Removed mentions of Masked RCNN from the website and README

Motivation and context

Mask RCNN was removed but the documentation and README wasn't modified

How has this been tested?

Just checked in the preview tab in github

Checklist

  • I submit my changes into the develop branch
  • I have created a changelog fragment Not needed
  • I have updated the documentation accordingly
  • I have added tests to cover my changes -> not needed
  • I have linked related issues -> Not needed
  • I have increased versions of npm packages if it is necessary --> not needed
    (cvat-canvas,
    cvat-core,
    cvat-data and
    cvat-ui)

License

  • I submit my code changes under the same MIT License that covers the project.
    Feel free to contact the maintainers if that's a concern.

Summary by CodeRabbit

  • New Features

    • Added sections on "Deep learning serverless functions for automatic labeling", "Supported annotation formats", and "Public datasets" in the documentation.
    • Expanded details on CVAT versions and capabilities in the overview.
    • Updated deployment instructions for "SiamMask", "YOLO v3", and "RetinaNet" in the serverless tutorial.
  • Bug Fixes

    • Removed outdated content related to "Mask RCNN" and improved clarity in the AI tools documentation.
  • Documentation

    • Enhanced structure and content across multiple documents for better readability and user engagement.

Removed Masked RCNN
Removed masked rcnn from overview
removed mentions of Mask RCNN
Copy link
Contributor

coderabbitai bot commented Dec 20, 2024

Important

Review skipped

Auto incremental reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Walkthrough

The pull request introduces comprehensive updates to CVAT's documentation across multiple files. The changes focus on enhancing user understanding by providing more detailed information about the tool's capabilities, annotation formats, AI tools, and serverless functions. The updates span README.md, overview documentation, AI tools guide, and serverless tutorial, with improvements in content clarity, model descriptions, and deployment instructions.

Changes

File Change Summary
README.md - Added "Deep learning serverless functions for automatic labeling" section
- Expanded "Supported annotation formats" section
- Updated "Public datasets" section
- Minor formatting improvements
site/content/en/docs/getting_started/overview.md - Refined introduction and version descriptions
- Enhanced "Tools and formats" section
- Added detailed annotation tools table
- Updated automated labeling section
site/content/en/docs/manual/advanced/ai-tools.md - Updated title and description
- Expanded sections on interactors and OpenCV tools
- Improved detectors and trackers model descriptions
site/content/en/docs/manual/advanced/serverless-tutorial.md - Removed Mask RCNN references
- Added SiamMask and YOLO v3 model deployment instructions
- Added RetinaNet deployment details
- Included serverless function debugging guidance

Sequence Diagram

sequenceDiagram
    participant User
    participant CVAT
    participant ServerlessFunction
    participant AIModel

    User->>CVAT: Select Annotation Task
    CVAT->>ServerlessFunction: Deploy Serverless Function
    ServerlessFunction->>AIModel: Load Pre-trained Model
    User->>CVAT: Upload Image/Video
    CVAT->>ServerlessFunction: Request Annotation
    ServerlessFunction->>AIModel: Process Image
    AIModel-->>ServerlessFunction: Return Annotations
    ServerlessFunction-->>CVAT: Provide Annotation Results
    CVAT-->>User: Display Annotated Data
Loading

Poem

🐰 Hop, hop, through CVAT's domain,
Where AI and vision sweetly reign,
Serverless functions dance with glee,
Annotations flow, now swift and free!
A rabbit's guide to learning's art, 🤖
Where machine and human smartly start! 🌟


Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Generate unit testing code for this file.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit testing code for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and generate unit testing code.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR. (Beta)
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@prateekshukla1108 prateekshukla1108 changed the title Removed Mentions of CVAT Removed Mentions of Mask RCNN Dec 20, 2024
Copy link
Contributor

@klakhov klakhov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’m not sure if removing all mentions of Mask R-CNN from the documentation is the right approach.

First, we still support the CPU version of it.
Second, it would be better to replace the Mask R-CNN section in the tutorial with another existing GPU detector, such as Faster R-CNN. Writing a new tutorial may not need to be part of this PR, but at the very least, we should retain the CPU section

@@ -108,7 +108,6 @@ Below is a detailed table of the supported algorithms and the platforms they ope
| [Segment Anything](https://github.com/cvat-ai/cvat/tree/develop/serverless/pytorch/facebookresearch/sam/nuclio) | Interactor | PyTorch | ✔️ | ✔️ |
| [Deep Extreme Cut](https://github.com/cvat-ai/cvat/tree/develop/serverless/openvino/dextr/nuclio) | Interactor | OpenVINO | ✔️ | |
| [Faster RCNN](https://github.com/cvat-ai/cvat/tree/develop/serverless/openvino/omz/public/faster_rcnn_inception_resnet_v2_atrous_coco/nuclio) | Detector | OpenVINO | ✔️ | |
| [Mask RCNN](https://github.com/cvat-ai/cvat/tree/develop/serverless/openvino/omz/public/mask_rcnn_inception_resnet_v2_atrous_coco/nuclio) | Detector | OpenVINO | ✔️ | |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thist model was not removed

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Once again, this function is not removed.

@klakhov klakhov added the documentation Documentation should be updated label Dec 23, 2024
@prateekshukla1108
Copy link
Author

I’m not sure if removing all mentions of Mask R-CNN from the documentation is the right approach.

First, we still support the CPU version of it. Second, it would be better to replace the Mask R-CNN section in the tutorial with another existing GPU detector, such as Faster R-CNN. Writing a new tutorial may not need to be part of this PR, but at the very least, we should retain the CPU section

hi klakhov, thanks for the correction, I will correct it!

Added mask RCNN as CPU version is still supported
@prateekshukla1108
Copy link
Author

I corrected it! Thanks for the feedback and sorry for the bad PR.
Let me know if I can help in any other way!

Copy link
Contributor

@klakhov klakhov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @prateekshukla1108,

Could you please avoid deleting the GPU deployment section of the tutorial in the documentation? Instead, consider updating it to reference another available GPU function from the repository.

I believe removing the GPU tutorial entirely is bad idea, as having a slightly outdated tutorial is still better than having none at all.

@@ -108,7 +108,6 @@ Below is a detailed table of the supported algorithms and the platforms they ope
| [Segment Anything](https://github.com/cvat-ai/cvat/tree/develop/serverless/pytorch/facebookresearch/sam/nuclio) | Interactor | PyTorch | ✔️ | ✔️ |
| [Deep Extreme Cut](https://github.com/cvat-ai/cvat/tree/develop/serverless/openvino/dextr/nuclio) | Interactor | OpenVINO | ✔️ | |
| [Faster RCNN](https://github.com/cvat-ai/cvat/tree/develop/serverless/openvino/omz/public/faster_rcnn_inception_resnet_v2_atrous_coco/nuclio) | Detector | OpenVINO | ✔️ | |
| [Mask RCNN](https://github.com/cvat-ai/cvat/tree/develop/serverless/openvino/omz/public/mask_rcnn_inception_resnet_v2_atrous_coco/nuclio) | Detector | OpenVINO | ✔️ | |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Once again, this function is not removed.

@@ -201,11 +201,9 @@ see {{< ilink "/docs/manual/advanced/automatic-annotation" "Automatic annotation

| Model | Description |
| ------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| Mask RCNN | The model generates polygons for each instance of an object in the image. <br><br> For more information, see: <li>[GitHub: Mask RCNN](https://github.com/matterport/Mask_RCNN) <li>[Paper: Mask RCNN](https://arxiv.org/pdf/1703.06870.pdf) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No need to delete this line


Now you should be able to annotate objects using segmentation masks.

![Mask RCNN results](/images/mask_rcnn_results.jpg)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please check that this image is not used anywhere else and also delete it.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think that it is not used anywhere as I searched the whole website when I was removing mentions of mask rcnn I searched the whole website

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, great.
Could deploy some other available gpu function and change the tutorial to use that function?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, great. Could deploy some other available gpu function and change the tutorial to use that function?

I am still getting familiar with codebase, I would do it by tomorrow

@@ -161,7 +160,6 @@ Finally you will get bounding boxes.
![SiamMask results](/images/siammask_results.gif)

`SiamMask` model is more optimized to work on Nvidia GPUs.
For more information about deploying the model for the GPU, [read on](#objects-segmentation-using-mask-rcnn).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets not remove documentation about GPU functions deployment. As a bit outdated documentation is better than no docs at all.

@prateekshukla1108
Copy link
Author

@klakhov Thanks for your patience. I am new to this project so I just made the changes without giving it much thought
I would make the changes you mentioned

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Documentation should be updated
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants