Liblinear output

[simsong]

From @JordanCheney on May 25, 2016 18:59

Hello,

I am using liblinear to do an SVM classification and I am seeing output during training that I don't understand. Specifically,

...
iter 259 act 2.666e-02 pre 2.666e-02 delta 1.443e-03 f 8.453e+03 |g| 3.771e+01 CG   2
cg reaches trust region boundary
iter 260 act 3.524e-02 pre 3.522e-02 delta 1.451e-03 f 8.453e+03 |g| 7.068e+01 CG   3
cg reaches trust region boundary
iter 261 act 2.766e-02 pre 3.918e-02 delta 1.143e-03 f 8.453e+03 |g| 5.879e+01 CG   3
cg reaches trust region boundary
iter 262 act 3.855e-02 pre 3.855e-02 delta 1.299e-03 f 8.453e+03 |g| 1.061e+02 CG   3
cg reaches trust region boundary
iter 263 act 2.558e-02 pre 2.558e-02 delta 1.316e-03 f 8.453e+03 |g| 4.086e+01 CG   2
cg reaches trust region boundary
iter 264 act 3.885e-02 pre 3.885e-02 delta 1.442e-03 f 8.453e+03 |g| 1.712e+02 CG   3
...

I haven't been able to find documentation anywhere for what these values mean. Is it bad that the "trust boundary" is reached? Does it mean training isn't working? In the first few iterations the trust boundary is not always reached but later in training it seems to be. Is there a resource anywhere that can help me understand?

Thanks!
Jordan

Copied from original issue: cjlin1#23

[simsong]

From @cjlin1 on May 25, 2016 22:33

For this method please check

http://www.csie.ntu.edu.tw/~cjlin/papers/logistic.pdf
JordanCheney writes:

Hello,

I am using liblinear to do an SVM classification and I am
seeing output during training that I don't understand.
Specifically,

...
iter 259 act 2.666e-02 pre 2.666e-02 delta 1.443e-03 f 8.453e+03 |g| 3.771e+01 CG 2
cg reaches trust region boundary
iter 260 act 3.524e-02 pre 3.522e-02 delta 1.451e-03 f 8.453e+03 |g| 7.068e+01 CG 3
cg reaches trust region boundary
iter 261 act 2.766e-02 pre 3.918e-02 delta 1.143e-03 f 8.453e+03 |g| 5.879e+01 CG 3
cg reaches trust region boundary
iter 262 act 3.855e-02 pre 3.855e-02 delta 1.299e-03 f 8.453e+03 |g| 1.061e+02 CG 3
cg reaches trust region boundary
iter 263 act 2.558e-02 pre 2.558e-02 delta 1.316e-03 f 8.453e+03 |g| 4.086e+01 CG 2
cg reaches trust region boundary
iter 264 act 3.885e-02 pre 3.885e-02 delta 1.442e-03 f 8.453e+03 |g| 1.712e+02 CG 3
...

I haven't been able to find documentation anywhere for what
these values mean. Is it bad that the "trust boundary" is
reached? Does it mean training isn't working? In the first few
iterations the trust boundary is not always reached but later
in training it seems to be. Is there a resource anywhere that
can help me understand?

Thanks!
Jordan

—
You are receiving this because you are subscribed to this
thread.
Reply to this email directly or view it on GitHub*