Skip to content

Different Results #1

Description

@mhsultan-1998

Hello,

I was told to use this PU algorithm for a research project so I copy-and-pasted the code you wrote into my own Python file and ran it. It has been over a year since you wrote this code and the corresponding article on it so some stuff has changed. Speaking of the article, thank you so much for it. When I ran what you wrote, I got warnings about the label encoder in XGBClassifier and the default evaluation metric in XGBoost having changed. Ignoring those warnings, the results I got didn't match what yours.

Classification results:
f1: 53.54%
roc: 68.28%
recall: 36.56%
precision: 100.00%

When I rewrote the XGBClassifiers as "xgb.XGBClassifier(eval_metric='error')", my results were a little better.

Classification results:
f1: 60.57%
roc: 71.72%
recall: 43.44%
precision: 100.00%

Regardless of what I did with the XGBClassifiers, the baseline results were consistently the same as yours.

Classification results:
f1: 99.57%
roc: 99.57%
recall: 99.15%
precision: 100.00%

Do you know why the final classification results I got are different from yours?

Thank you

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions