Program metadata issues

[SpyTheEngineer]

I'm running fanficfare off a calibre docker container, and i have the sharing server and custom columns set up.
I have a separate email for fanfiction updates, too
When the program grabs a new fic from the email, it removes it from the library, and puts it back without all the metadata? i keep having to manually re-add the metadata back before i forget too. I've tinkered with both config.toml, personal.ini and it keeps doing this, the log indicates its reading the ini files, but then it says stuff like:

Going to remove story 4478 from Calibre.

I have the update_method set to update, if that changes anything

[MrTyton]

Are you losing custom metadata? All of the metadata that FFF should normally put in should still be there - that's how it works for my library.

Since we're basically doing a wrapper on the FFF with the calibre library, we're basically exporting the old epub, using FFF to update it, then removing the old one from the calibre db and putting in our updated one.

Can you paste the logs or show some examples of before/after?

[SpyTheEngineer]

Im losing ALL metadata, all fields except name blank here are some screen shots

Example fic, highlighted before i turn on auto downloader all metadata there:

after the downloader ran:

I'll include the config file i used, modified for privacy, of course:

config - Copy.txt

and here are the logs

Logs.txt

[MrTyton]

Thanks. Could I ask for a bit more debug information?

What are your personal.ini and default.ini (redacted for privacy)

What happens if you just past the URL into calibre's FFF plug install with the same personal/defaults, do you still get the metadata then? Both for a new story and for a story that already exists. Can you share the urls of the stories so that I can try and replicate?

Can you paste a bit more of the logs? It's cutting off at the updating part, I just want to see the full process.

Sorry for all the things that I'm asking, I haven't run into this before.

I can push a new release that will include more debugging information if we need it, but let's see what these come out with first.

[SpyTheEngineer]

sure, here are the ini files:

personal - Copy.txt
plugin-defaults - Copy.txt

the logs only put out 2-3 more lines since then, here:

Logs.txt

[MrTyton]

for your [custom_columns_settings] in the personal.ini

[custom_columns_settings]
 Chapters=>#chapters
 Characters=>#characters
 Status=>#completion_status
 Published=>#datepublished
 Updated=>#dateupdated
 Category=>#fandom
 Relationships=>#relationships
 Site=>#origin_site
 Words=>#word_count

Can you try removing the # for them? That's the comment symbol for .ini, so it ignores everything past that marker, so what I think is happening is that it's basically saying "Take all of the columns and replace them with nothing"

[SpyTheEngineer]

Got it, I'll try

[SpyTheEngineer]

no luck :/

Logs.txt

[MrTyton]

Just making sure that you restarted the container after updating the personal.ini?

[SpyTheEngineer]

yea, i shut down the container, deleted the old personal.ini, brought in the new one and started it back up, ill do it again to make sure, though.

[MrTyton]

Try also adding the story from fresh, like just delete it from your calibre library and let the script download it from scratch.

If this doesn't work, then I'll push a new update that will do more debugging, but it'll be about a week - I'm about to go on a work trip and I'm not going to be able to do any coding in that meantime, if you can wait?

[SpyTheEngineer]

its downloading fics that arent in my library yet, and those are coming up blank too. I dont mind waiting I'm just glad I'm getting any help with this.

[MrTyton]

Ok. Yeah, after I get back late next week I'll push an update that will add in a lot more verbose debugging, so hopefully that'll help figure out what's going on.

[SpyTheEngineer]

Sounds good to me. Thank you for the help!

[MrTyton]

Ok, I've pushed a new version with a few other metadata preservation things. Can you give those a try, the instructions should be in the readme. If it still doesn't work, I added a bunch of logging, so try running it with the verbose flag set, and upload the logs, so we can see what's going on better. Hope that it helps.

[SpyTheEngineer]

alright, let me take a looksie and test it out!