v5.0 - Active Storage

[picman]

Has anybody already installed the last release v5.0.0? Any feedback from the plugin migration and Active Storage usage?

[giorgiorossi]

Hi,
I migrated to version 5.01. Everything seemed fine, but now we've noticed that some of the migrated documents return a 504 error when I try to download them. This is a major issue, especially since I don't know how to scan the new repository for missing documents and, if necessary, restore them from the backup. Do you have a procedure for identifying documents that appear in the interface, but cannot be downloaded?

Thanks in advance

[picman]

=> #24

[picman]

Could you also provide what is in the production.log if you try to download such a missing document?

[picman]

Weren't there any errors during the migration?

[giorgiorossi]

I didn't notice any errors during the migration, and all the original files were deleted. I couldn't find a migration log, and while I was working in the terminal, I didn't notice any errors.

In production.log, the error that occurred when downloading the missing documents is:
I, [2026-03-16T09:32:04.049257 #15502] INFO -- : [71dbcb0f-78e1-4aa4-a239-64ff3f7e88c3] Started GET "/dmsf/files/12887/view" for 192.168.1.253 at 2026-03-16 09:32:04 +0100
I, [2026-03-16T09:32:04.057101 #15502] INFO -- : [71dbcb0f-78e1-4aa4-a239-64ff3f7e88c3] Processing by DmsfFilesController#view as HTML
I, [2026-03-16T09:32:04.057221 #15502] INFO -- : [71dbcb0f-78e1-4aa4-a239-64ff3f7e88c3] Parameters: {"id"=>"12887"}
I, [2026-03-16T09:32:04.083163 #15502] INFO -- : [71dbcb0f-78e1-4aa4-a239-64ff3f7e88c3] Current user: giorgio.rossi (id=3)
E, [2026-03-16T09:32:04.116487 #15502] ERROR -- : [71dbcb0f-78e1-4aa4-a239-64ff3f7e88c3] ActionController::MissingFile
I, [2026-03-16T09:32:04.267907 #15502] INFO -- : [71dbcb0f-78e1-4aa4-a239-64ff3f7e88c3] Rendered layout layouts/base.html.erb (Duration: 148.0ms | GC: 21.2ms)
I, [2026-03-16T09:32:04.268865 #15502] INFO -- : [71dbcb0f-78e1-4aa4-a239-64ff3f7e88c3] Completed 404 Not Found in 211ms (Views: 135.0ms | ActiveRecord: 29.7ms (25 queries, 1 cached)

[picman]

There in the devel branch is a new rake task for identifying missing files.
rake redmine:dmsf_missing_files RAILS_ENV="production"

[giorgiorossi]

Thanks, I'll let you know. Another thing I noticed is that the files are imported into Redmine with the migration date, not the original creation or modification date.

[giorgiorossi]

Hi,
This is the final part of the control script log:
0%dmsf_file_revision 29155 has no shared file attached
0%dmsf_file_revision 30788 has no shared file attached
0%dmsf_file_revision 31720 has no shared file attached
100%426 missing files
done
Seem 426 files missing!
How can I re-upload the missing files? Do I need to run a new migration, or should I upload them individually via the web interface?

[picman]

Hm, you can hardly upload 426 files manually. I'd restore all files and the database from the backup and re-run the migration. I'd suggest saving the output to a log file for a later investigation what was happening during the migration.

[giorgiorossi]

I can't restore the backup or the snapshot of the VM. We didn't realize there was a problem until a few days later and, unfortunately, since this is a production environment, I can't restore a backup from a few days ago. I'm afraid I'll have to recharge them manually

[giorgiorossi]

How can I use the revision number to locate the missing file via the Redmine web interface or via API ?

[picman]

I've modified the rake task in order the error output contains dmsf_file_id too. You can edit a file then using the following link:
http://localhost:3000/dmsf/files/dmsf_file_id e.g. http://localhost:3000/dmsf/files/123
The file then can be added via the new revision form or using API.

[picman]

Maybe to write a rake task which would attach proper files to the corresponding revisions...

[giorgiorossi]

Thanks, I'll try it

[giorgiorossi]

I'm looking at the client in the extra/api directory, but the examples provided only show how to create a new revision, not how to upload a binary file to it. Is that correct? I've currently created a client that download files from a previous redmine version based on the version ID using API, and I'd like to re-upload them to the new Redmine version under the same ID as a new revision, as you suggested.

Thanks in advance

[picman]

There is no API to re-upload a file. You will have to create a new revision and upload the file to the new revision. A new revision is created if the file name corresponds with an existing filename.

# 3. Upload a document into a given folder or the root folder
curl --data-binary "@cat.gif" -H "Content-Type: application/octet-stream" -X POST -u ${USER_LOGIN}:${USER_PASSWORD} http://localhost:3000/projects/12/dmsf/upload.xml?filename=cat.gif
curl -v -H "Content-Type: application/xml" -X POST --data "@file.xml" -u ${USER_LOGIN}:${USER_PASSWORD} http://localhost:3000/projects/12/dmsf/commit.xml

[giorgiorossi]

Thanks, I've modified the program to extract the project_id and dmsf_file_id from the old Redmine as well, and use them for the upload to the new Redmine.
By the way, I figured out why the bulk upload failed. These are files uploaded years ago whose names contained the characters “[” and “]”. In the import program, I modified the file names to remove the brackets.

[adam-zaljez]

Hello, I have a new installation of Redmine 6.1.2 and Redmine DMSF Plugin 5.0.1 with active storage enabled, and I'm wondering why files are being stored in two locations at the same time? When I upload a file to the DMS module, it is saved in redmine/files and redmine/dmsf_as. Is this how it's supposed to work, or am I missing something?

[picman]

=> #23

[picman]

Thank you both for your feedback. It helped me a lot to tune the migration.