Releases: Sun-Lab-NBB/ataraxis-data-structures
Releases · Sun-Lab-NBB/ataraxis-data-structures
6.0.1
Patch Release
Major Changes:
- Fixed LogArchiveReader onset timestamp deserialization to decode unsigned 64-bit integers, aligning it with the ataraxis-time
serialization contract and preventing corrupted onset values. - Enforced an explicit spawn multiprocessing context across SharedMemoryArray and DataLogger for identical cross-platform
behavior, added pickle-safe SharedMemoryArray state transfer, and relaxed the connect() and buffer-destruction ordering
requirements. - Added automatic executor ID resolution to ProcessingTracker, so start_job now derives the executor from the SLURM job ID with
a process ID fallback when the caller provides none. - Hardened YamlConfig deserialization and corrected docstring inaccuracies across the library.
- Renamed "Sun Lab" references to "Ataraxis framework" and "Sollertia", and applied style-compliance cleanup across the source,
test suite, and documentation.
What's Changed
- Added automatic executor ID resolution to ProcessingTracker. by @Inkaros in #17
- Cleaned up docstrings, comments, and code style across the library. by @Inkaros in #18
- Fixed onset timestamp deserialization to use unsigned 64-bit integers. by @Inkaros in #19
- Refactor/library cleanup by @Inkaros in #20
Full Changelog: 6.0.0...6.0.1
6.0.0
Major Release
Major Changes:
- Re-licensed the library to Apache 2.0 from GPL 3.
- Migrated project automation and dependencies to ataraxis-automation 8.0.0+ standard.
- Moved all data checksumming, transfer, and interpolation assets from upstream ataraxis and sl libraries into this project.
- Improved YamlConfig serialization to support serializing Path, Enum and tuple objects.
- Added a LogArchiveReader class for streamlining reading the archives generated by the DataLogger class.
What's Changed
- Feature/apache 2.0 license by @Inkaros in #13
- Feature/codebase modernization by @Inkaros in #14
- Added type-aware serialization and deserialization to YamlConfig. by @Inkaros in #15
- Feature/processing assets and trackers by @Inkaros in #16
Full Changelog: 5.0.0...6.0.0
5.0.0
4.0.0
Major Update
Critical Changes:
- Deprecated NestedDictionary Class
- Refactored the SharedMemoryArray class to support n-dimensional arrays and allow users to directly access and manipulate the underlying array. In turn, this allows using the full range of NumPy operations directly on the data stored in the shared memory buffer with optional exclusive locking support.
- Refactored the DataLogger class to streamline the API and clearly separate log creation (DataLogger) from log archive assembly (formerly compression), which is now fulfilled by a dedicated standalone function.
- Switched project development automation and dependency management to ataraxis-automation 6.2.0+ compatible strategy.
- Optimized the source code where feasible.
- Improved the API and ReadMe documentation.
What's Changed
Full Changelog: 3.1.1...4.0.0
3.1.1
Minor Feature Update
- Introduced a new independent function
compress_npy_logs. This function allows compressing npy log files without having an initialized DataLogger instance. - Also optimized log compression processing to better parallelize processing stages and achieve noticeably faster processing speed.
Full Changelog: 3.1.0...3.1.1
3.1.0
Minor Feature Update
-- Optimized DataLogger log compression procedure to improve processing time for large log files.
-- Made data verification during log compression optional (enabled by default).
-- Made log compression optional (enabled by default).
Overall, these changes allow developers to drastically reduce the log compression time by disabling the features they do not require to gain a reduction in processing time.
Full Changelog: 3.0.2...3.1.0
3.0.2
Minor Bugfixes
- Revised DataLogger multiprocessing manager initialization order position to address a rare issue related to del attempting to to collect a non-existing manager instance
What's Changed
Full Changelog: 3.0.1...3.0.2
3.0.1
3.0.0
Major Update
- Removed Data Converters from this library
- Optimized SharedMemoryArray and DataLogger treatment of shared memory buffer
- QoL updated to DataLogger and better resource management during expected and unexpected shutdowns
- Optimized log compression to run faster and (on Unix) use less RAM by default (via memory mapping)
What's Changed
Full Changelog: 2.0.1...3.0.0