Skip to content

Chapter 7 : Gradient Boosting Algorithm : loss function is incorrect #239

@pschhikara88

Description

@pschhikara88
Image

Formula should be :

Incorrect formula
`Li = - yi log(Pi) + (1- yi)log(1-Pi)

Correct formula

Either
Li = -  ( yi log(Pi) + (1- yi)log(1-Pi) )
or

Li = - yi log(Pi) - (1- yi)log(1-Pi)

Because i tried to derive the above incorrect formula to
Li = log(1+ e^yi) - yi*yihat
and then i realised, initial loss function is not correct.

Please let me know if my understanding is correct.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions