Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor code using black formatter and add dockerhub push cmd, and update base image to version containing cudnn8 #13

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

FrostFlowerFairy
Copy link

No description provided.

feat: docker hub push
feat: update websocket server to aiohttp server with include client
@FrostFlowerFairy FrostFlowerFairy marked this pull request as draft March 20, 2024 07:29
@FrostFlowerFairy FrostFlowerFairy marked this pull request as ready for review March 20, 2024 07:29
@alesaccoia
Copy link
Owner

Hey there could you explain the rationale behind these changes? There are a lot of files affected including beautification

@FrostFlowerFairy
Copy link
Author

nvidia/cuda:11.6.2-base-ubuntu20.04 does not include cudnn, so users need to install cudnn and other required dependencies.
However, if use nvidia/cuda:11.6.2-cudnn8-runtime-ubuntu20.04, manual installation is not required.
I updated the port to port 80 to make deployment easier for users.
I also used Python autopep8 to format the code to make it easier for users to understand the code.

@@ -1,5 +1,5 @@
# Use an NVIDIA CUDA base image with Python 3
FROM nvidia/cuda:11.6.2-base-ubuntu20.04
FROM nvidia/cuda:11.6.2-cudnn8-runtime-ubuntu20.04
Copy link
Collaborator

@jinmiaoluo jinmiaoluo May 20, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Dockerfile in the current repository will lead to the following issues:

Client 583ffd78-2bfe-4e1e-bbbc-8efed00e1904 connected
2024-05-20T08:38:53.837582891Z Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory

The current commit can fix this issue.

@jinmiaoluo
Copy link
Collaborator

This PR contains too many changes. I will create related issues and rewrite the relevant commits.

continue
else:
print(f"Unexpected message type from {client.client_id}")
def setup_routes(self):
Copy link
Collaborator

@jinmiaoluo jinmiaoluo May 20, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This method is redeclared.

@alesaccoia
Copy link
Owner

@jinmiaoluo is this PR still relevant afer merging the other one?

@jinmiaoluo
Copy link
Collaborator

@alesaccoia This pull request contains several useful changes. We should separate and merge them individually, focusing on the following topics:

  1. Code style and editor configuration.
  2. Replacing websockets (Should we proceed with this change or leave it? The modification in this PR attempts to serve index.html and handle websocket requests together).
  3. Freezing dependency versions.

@jinmiaoluo
Copy link
Collaborator

jinmiaoluo commented May 23, 2024

@alesaccoia The code for the first and third topic has been rewritten in PR: #21 , please take a look.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants