Do you get similar or the same result as the original paper?

[lihk11]

Hi, there~
Thanks for your implementation!
I tried to run one of the notebooks(NCT_modified), but the results didn't go very well.
How about yours? Or maybe i do something wrong?

[rassilon712]

Hello
We implemented the Neural Color Transfer and modified some of parameters but we also didn't get all fine results like paper.

We were trying to fix some of codes but, our team is guessing that the patch match is somewhat working not perfectly.

Also, the processing time is so much slower than the original paper because we implemented on Pytorch not CUDA exactly.

For now some results are similar with the paper and we are not making progress further from that implementation.

If you make better results please share with us and if we made further progress, I will update on my git.

Thanks.

[lihk11]

Thanks for your reply!
Could you point out which pictures you run that reach similar result with the paper? I think
we can start with them.

[rassilon712]

Sorry for the late reply. We had hard time finding some good images we got.
Our Input Image is

and the style image is

And the result from those images are here. The images are from layer 5 to 1 below.

Also we are trying to change some Markdown on front with results. But it is not completely implemented so we have lot of TODO.

[lihk11]

Thanks for your reply!
I have implemented my own version, and i think i got a similar result for the original paper.
My best results:

As for the picture you given, here are my results(5 to 1):

[lihk11]

I just checked your version. I think the parameter "radius" of FastGuidedFilter is not set properly. It could be larger (eg. 16). I am not very sure, cuz there are a lot of differences between our implements.

[nieguangyang]

Hi @rassilon712 ,
I'm currently working on the NCT model with tensorflow and keras based on your implementation.
Here is output of my implementation

It's pretty well on your given picture, but when it comes to some other pictures, the output are barely satisfied.

The biggest reason that I think might be the limit of capability of VGG19. It seems require very high semantic similarity to perform color transfer.

Now I am trying to replace VGG19 with other more semantic-oriented model.

[nieguangyang]

Thanks for your reply!
I have implemented my own version, and i think i got a similar result for the original paper.
My best results:

As for the picture you given, here are my results(5 to 1):

Hi @lihk11 ,
I'm currently working on NCT too and my version got bad results for the pictures in the paper.
I think the biggest problem is loss d instead radius of fast guided filter. I've tried loss d exactly as showed in the paper and the modified version of rassilon712, non of them got decent output for pictures in the paper, can I have a look at your implementation of loss d?

[rassilon712]

Hello, sorry for late reply. Me and my co-worker are busy on doing other projects so, this NCT progress is delayed for moments.
For the implementation of our code is based on version 1 of the paper. We need to change some loss functions as the version 2 of the paper changed some loss terms.
Did you check the version 2 of the paper and followed their terms? Also, my work needs some tuning for GuidedFilter, even though we have had some tests.

[nieguangyang]

Hello, sorry for late reply. Me and my co-worker are busy on doing other projects so, this NCT progress is delayed for moments.
For the implementation of our code is based on version 1 of the paper. We need to change some loss functions as the version 2 of the paper changed some loss terms.
Did you check the version 2 of the paper and followed their terms? Also, my work needs some tuning for GuidedFilter, even though we have had some tests.

Thanks for reply~
I think most changes in v2 paper is about the loss d. It contains a factor 4 ** (L - 1). Although it still not work well for me. Weirdly, when I change it to 4 ** (5 - L), got better result. Therefore, now it is confusing for me...
Looking forward to your later improvement and hope the paper's authors can release the source code soon, there are so many tricky parts!

[rassilon712]

Yes, I also think that there are some tricks in code that they didn't mention in paper. We will work further when we have enough time and if you get some remarkable results, I hope to share the results with us !

[nieguangyang]

Sure, I will! :)

[Ssakura-go]

urther when we have enough time and if you get some remarkable results, I hope to share the results with us !

Hi, could you please share the code you run with me?
Recently I focus on color transfer task and also learn a lots from this paper. Now I want to run out the results by myself, however, I got the wrong code and I can't find out the available implement of it at present.