[tmva][sofie][gsoc] Add InstanceNormalization operator

[AaradhyaSaxena]

This Pull request:

Development of the Instance Normalization operator for the Google Summer of Code 2021 project Inference Code Generation for Batch Normalization.
Depends on #8882

Checklist:

• [ x] tested changes locally

[phsft-bot]

Can one of the admins verify this patch?

[lmoneta]

@phsft-bot build just on ROOT-ubuntu2004/default with flags -Dtmva-sofie=On

[phsft-bot]

Starting build on ROOT-ubuntu2004/default with flags -Dtmva-sofie=On
How to customize builds

[phsft-bot]

Build failed on ROOT-ubuntu2004/default.
Running on root-ubuntu-2004-1.cern.ch:/home/sftnight/build/workspace/root-pullrequests-build
See console output.

Warnings:

• [2021-08-23T15:39:53.276Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [25, 32] from the object at ‘onnx::TensorProto_Segment_default_instance’ is out of the bounds of referenced subobject ‘onnx::TensorProto_Segment::begin’ with type ‘long int’ at offset 16 [-Warray-bounds]
• [2021-08-23T15:39:53.276Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [25, 28] from the object at ‘onnx::TypeProto_Tensor_default_instance’ is out of the bounds of referenced subobject ‘onnx::TypeProto_Tensor::shape’ with type ‘onnx::TensorShapeProto*’ at offset 16 [-Warray-bounds]
• [2021-08-23T15:39:53.276Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [25, 28] from the object at ‘onnx::TypeProto_Map_default_instance’ is out of the bounds of referenced subobject ‘onnx::TypeProto_Map::value_type’ with type ‘onnx::TypeProto*’ at offset 16 [-Warray-bounds]
• [2021-08-23T15:39:53.276Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [49, 56] from the object at ‘onnx::SparseTensorProto_default_instance’ is out of the bounds of referenced subobject ‘onnx::SparseTensorProto::values’ with type ‘onnx::TensorProto*’ at offset 40 [-Warray-bounds]
• [2021-08-23T15:39:53.276Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [73, 80] from the object at ‘onnx::TrainingInfoProto_default_instance’ is out of the bounds of referenced subobject ‘onnx::TrainingInfoProto::initialization’ with type ‘onnx::GraphProto*’ at offset 64 [-Warray-bounds]
• [2021-08-23T15:39:53.553Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [25, 32] from the object at ‘onnx::TensorProto_Segment_default_instance’ is out of the bounds of referenced subobject ‘onnx::TensorProto_Segment::begin’ with type ‘long int’ at offset 16 [-Warray-bounds]
• [2021-08-23T15:39:53.553Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [25, 28] from the object at ‘onnx::TypeProto_Tensor_default_instance’ is out of the bounds of referenced subobject ‘onnx::TypeProto_Tensor::shape’ with type ‘onnx::TensorShapeProto*’ at offset 16 [-Warray-bounds]
• [2021-08-23T15:39:53.553Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [25, 28] from the object at ‘onnx::TypeProto_Map_default_instance’ is out of the bounds of referenced subobject ‘onnx::TypeProto_Map::value_type’ with type ‘onnx::TypeProto*’ at offset 16 [-Warray-bounds]
• [2021-08-23T15:39:53.554Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [49, 56] from the object at ‘onnx::SparseTensorProto_default_instance’ is out of the bounds of referenced subobject ‘onnx::SparseTensorProto::values’ with type ‘onnx::TensorProto*’ at offset 40 [-Warray-bounds]
• [2021-08-23T15:39:53.554Z] /usr/include/x86_64-linux-gnu/bits/string_fortified.h:71:33: warning: ‘void* _builtin_memset(void*, int, long unsigned int)’ offset [73, 80] from the object at ‘onnx::TrainingInfoProto_default_instance’ is out of the bounds of referenced subobject ‘onnx::TrainingInfoProto::initialization’ with type ‘onnx::GraphProto*’ at offset 64 [-Warray-bounds]

And 12 more

[guitargeek]

A test was missing here, which is I guess the reason why the PR didn't proceed. Also, there are many merge conflicts not, there was no initial review, and there is a successor PR, which took this original PR as inspiration.

• [tmva][sofie] Add ONNX InstanceNormalization operator #21331

I suggest to close this PR as is it replaced by the new one, which also includes a test. Thank you for this initial proposal!