Refactor Docker Deployment and Add Linux Server CPU Results #5
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Refactored the main function for improved readability and maintainability. - Extracted benchmarking, prediction, and utility functions into separate modules. - Created dedicated modules for ONNX, OpenVINO, and CUDA operations to enhance code organization. - Simplified CUDA configurations and added detailed comments for clarity.
# Conflicts: # prediction/prediction_utils.py
# Conflicts: # README.md
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request introduces the following key changes:
Docker Deployment Refactoring: Simplified the Docker deployment process by automating the selection between CPU and GPU base images based on provided arguments, making deployment more intuitive and error-free.
Added Linux Server CPU Results: Incorporated example results from benchmarking on a Linux Server using only the CPU, providing users with a practical point of reference.
Documentation Updates: Revised the README's overview section to better reflect the project's capabilities and the benefits of model optimization. Also clarified the requirements for GPU support.