Skip to content

Add smart conversion mode#57

Open
CosmicElysium wants to merge 28 commits into
devfrom
alex/smart_converter
Open

Add smart conversion mode#57
CosmicElysium wants to merge 28 commits into
devfrom
alex/smart_converter

Conversation

@CosmicElysium
Copy link
Copy Markdown
Contributor

@CosmicElysium CosmicElysium commented Apr 10, 2024

Adds a smart converter option.

This is accessed with a "-r" flag plus an optional integer that indicates max memory allocation in MB (for example, -r2000 for 2 GB limit). If no number is indicated, then the fast mode is used as the assumption is that memory is not an issue for the user.

Currently, the memory allocation must be enough to hold the area of a chunk times the depth of the cube. Otherwise, the user receives an error, and the minimum memory is suggested.

The included converter tests also now include a way to test the smart converter option.

Important thing to note: this is a branch from the 3D mipmap calculation branch, so it includes the changes from PR #53

Closes #44

Still possible race conditions present. Need to do further testing.
Still need to debug statsZ as the current statsZ region has race conditions as a shared variable in the parallel for loop
@CosmicElysium
Copy link
Copy Markdown
Contributor Author

CosmicElysium commented Apr 16, 2024

"memory allocation is not applied to the rotated data set calculation."

This needs to be re-looked at. Everything should fit in the specified memory allocation by the user.

EDIT: fixed

@confluence confluence self-assigned this May 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Smart converter mode

2 participants