must-gathers are not imported

[jorti]

Two must-gathers in .tgz format were uploaded but nothing was imported. There were no errors in the web interface.

Below the logs of the logsviewer container in which I attempted 3 uploads:

• must-gather.local.2029921240791469245.tgz
• must-gather.local.5001830969658947017.tgz (Download interrupted)
• must-gather.local.5001830969658947017.tgz

$ oc logs logsviewer-1pqslb -c logsviewer 

backend.go:13: Starting logsviewer
server.go:739: HTTP JSON POST URL: http://localhost:5601/api/data_views/data_view
server.go:753: response Status: 200 OK
server.go:754: response Headers: map[Cache-Control:[private, no-cache, no-store, must-revalidate] Connection:[keep-alive] Content-Length:[209] Content-Type:[application/json; charset=utf-8] Date:[Tue, 16 May 2023 13:16:51 GMT] Kbn-License-Sig:[5de939bab19d5e3d28bb88a8d162b05c1e24760500ae211051d741398a17a21c] Kbn-Name:[logsviewer-1pqslb] Keep-Alive:[timeout=120] Referrer-Policy:[no-referrer-when-downgrade] X-Content-Type-Options:[nosniff]]
server.go:756: response Body: {"data_view":{"id":"cnvlogs-default","version":"WzEzLDFd","title":"cnvlogs*","timeFieldName":"@timestamp","fields":{},"typeMeta":{},"fieldFormats":{},"runtimeFieldMap":{},"fieldAttrs":{},"allowNoIndex":false}}
server.go:717: HTTP JSON POST URL: http://localhost:5601/api/data_views/default
server.go:731: response Status: 200 OK
server.go:732: response Headers: map[Cache-Control:[private, no-cache, no-store, must-revalidate] Connection:[keep-alive] Content-Length:[21] Content-Type:[application/json; charset=utf-8] Date:[Tue, 16 May 2023 13:16:51 GMT] Kbn-License-Sig:[5de939bab19d5e3d28bb88a8d162b05c1e24760500ae211051d741398a17a21c] Kbn-Name:[logsviewer-1pqslb] Keep-Alive:[timeout=120] Referrer-Policy:[no-referrer-when-downgrade] X-Content-Type-Options:[nosniff]]
server.go:734: response Body: {"acknowledged":true}
server.go:787: Routes set
server.go:115: Get Pods Endpoint Hit:  map[]
db.go:716: queryString:  select uuid, name, namespace, phase, activeContainers, totalContainers, creationTime, createdBy from pods
File Upload Endpoint Hit
server.go:621: File Upload Endpoint Hit
Uploaded File: must-gather.local.2029921240791469245.tgz
server.go:639: Uploaded File:  must-gather.local.2029921240791469245.tgz
File Size: 277083392
MIME Header: map[Content-Disposition:[form-data; name="file"; filename="must-gather.local.2029921240791469245.tgz"] Content-Type:[application/x-compressed-tar]]
Successfully Uploaded File:  must-gather.local.2029921240791469245.tgz
server.go:669: Successfully Uploaded File:  must-gather.local.2029921240791469245.tgz
server.go:205: Get Vmis Endpoint Hit:  map[]
server.go:244: Get Vmi migrations Endpoint Hit:  map[name:[{}] namespace:[{}]]
server.go:251: vmiName:  {}
server.go:253: vmiDetails:  {   false}
server.go:256: Namespace:  {}
server.go:258: vmiDetails:  {   false}
db.go:994: queryString:  select name, namespace, uuid, phase, vmiName, targetPod, creationTime, endTimestamp, sourceNode, targetNode, completed, failed from vmimigrations
server.go:115: Get Pods Endpoint Hit:  map[]
db.go:716: queryString:  select uuid, name, namespace, phase, activeContainers, totalContainers, creationTime, createdBy from pods
server.go:353: Get PVCs Endpoint Hit:  map[]
db.go:820: queryString:  select name, namespace, uuid, reason, phase, accessModes, storageClassName, volumeName, volumeMode, capacity, creationTime from pvcs
server.go:166: Get nodes Endpoint Hit:  map[]
File Upload Endpoint Hit
server.go:621: File Upload Endpoint Hit
Error Retrieving the File
multipart: NextPart: unexpected EOF
server.go:634: multipart: NextPart: unexpected EOF
File Upload Endpoint Hit
server.go:621: File Upload Endpoint Hit
Uploaded File: must-gather.local.5001830969658947017.tgz
server.go:639: Uploaded File:  must-gather.local.5001830969658947017.tgz
File Size: 643383224
MIME Header: map[Content-Disposition:[form-data; name="file"; filename="must-gather.local.5001830969658947017.tgz"] Content-Type:[application/x-compressed-tar]]
Successfully Uploaded File:  must-gather.local.5001830969658947017.tgz
server.go:669: Successfully Uploaded File:  must-gather.local.5001830969658947017.tgz
server.go:244: Get Vmi migrations Endpoint Hit:  map[name:[{}] namespace:[{}]]
server.go:251: vmiName:  {}
server.go:253: vmiDetails:  {   false}
server.go:256: Namespace:  {}
server.go:258: vmiDetails:  {   false}
db.go:994: queryString:  select name, namespace, uuid, phase, vmiName, targetPod, creationTime, endTimestamp, sourceNode, targetNode, completed, failed from vmimigrations
server.go:115: Get Pods Endpoint Hit:  map[]
db.go:716: queryString:  select uuid, name, namespace, phase, activeContainers, totalContainers, creationTime, createdBy from pods

[vladikr]

Looks like the issue here is that the file is compressed as application/x-compressed-tar and not one of application/gzip or application/x-gzip that logsviewer is currently handling

[vladikr]

@jorti could you please create a .tar.gz file in the meanwhile?

[jorti]

@jorti could you please create a .tar.gz file in the meanwhile?

Renaming the file to .tar.gz works. Thank you.

[sradco]

@vladikr Is there an action item needed here or we should close this?

[vladikr]

@sradco we need to try importing a .tgz (application/x-compressed-tar archive)
I'll try to fix it tonight. I guess it's just a matter of allowing this mime.

[vladikr]

@jorti could you please create a .tar.gz file in the meanwhile?

Renaming the file to .tar.gz works. Thank you.

Was it just a matter or renaming or did you need to compress this archive differently?

[jorti]

Was it just a matter or renaming or did you need to compress this archive differently?

Just renaming the file worked.