Zarr Read Exception:java.lang.IllegalArgumentException: Negative initial size: -1033970400

[runnerzz]

Hello, we are currently encountering the following issue: After converting NetCDF (nc) files to Zarr format, area.nc (as shown in the figure below) can be successfully converted to area.zarr and read normally. However, when global.nc (as shown in the figure below) is converted to global.zarr, an exception is thrown during the reading process (see the figure below). Could you please advise on the root cause? Could it be that the dimensions of global.zarr (lat=2041, lon=4320) are excessively large, leading to lack of support at present?

Error Code:
Array arr = var.read(new int[]{depthIndex, 0, 0}, new int[]{1, shape[1], shape[2]});

pom.xml

`
4.0.0

<groupId>org.example</groupId>
<artifactId>ZarrTest</artifactId>
<version>1.0-SNAPSHOT</version>

<properties>
    <maven.compiler.source>21</maven.compiler.source>
    <maven.compiler.target>21</maven.compiler.target>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
</properties>

<dependencies>
    <!--解析zarr个文件相关依赖-->
    <dependency>
        <groupId>edu.ucar</groupId>
        <artifactId>cdm-core</artifactId>
        <version>5.9.1</version>
    </dependency>
    <dependency>
        <groupId>edu.ucar</groupId>
        <artifactId>cdm-zarr</artifactId>
        <version>5.9.1</version>
    </dependency>

</dependencies>

`

area.nc

global.nc

[lesserwhirls]

Would you mind posting the full stack trace that contains the IllegalArgumentException?

[runnerzz]

java.lang.IllegalArgumentException: Negative initial size: -1014491832 at java.base/java.io.ByteArrayOutputStream.<init>(ByteArrayOutputStream.java:78) at ucar.nc2.filter.Deflate.decode(Deflate.java:75) at ucar.nc2.iosp.zarr.ZarrLayoutBB$DataChunk.getByteBuffer(ZarrLayoutBB.java:189) at ucar.nc2.iosp.LayoutBBTiled.hasNext(LayoutBBTiled.java:101) at ucar.nc2.iosp.zarr.ZarrLayoutBB.hasNext(ZarrLayoutBB.java:102) at ucar.nc2.iosp.IospHelper.readData(IospHelper.java:364) at ucar.nc2.iosp.IospHelper.readDataFill(IospHelper.java:292) at ucar.nc2.iosp.zarr.ZarrIosp.readData(ZarrIosp.java:87) at ucar.nc2.NetcdfFile.readData(NetcdfFile.java:2122) at ucar.nc2.Variable.reallyRead(Variable.java:874) at ucar.nc2.Variable._read(Variable.java:768) at ucar.nc2.Variable.read(Variable.java:600) at ucar.nc2.dataset.VariableDS.reallyRead(VariableDS.java:559) at ucar.nc2.dataset.VariableDS._read(VariableDS.java:496) at ucar.nc2.Variable.read(Variable.java:600) at ucar.nc2.Variable.read(Variable.java:546) at org.example.New2ZarrTest.processMultiLayerVariables(New2ZarrTest.java:201) at org.example.New2ZarrTest.main(New2ZarrTest.java:60)

[lesserwhirls]

The dimensions should not be an issue as long as they are less than the maximum size of a java integer (2^32 - 1). That said, something odd is happening when trying to set the buffer size. I'd need an example file to investigate locally where the negative size for the output stream is coming from.

[runnerzz]

File size too big，1.43GB

[lesserwhirls]

If you have a gmail account, I can share a folder where you could upload it. Is that an option?