What is the meaning of Warning message after logistical regression ?

Dear All,

After running logistical regression on R using glm function I am getting following warning message ...

> watch_dog <- glm(Output~mean1+mean3+Var1+Var3+StandDiv1+StandDiv3,Training_data, family = "binomial")
Warning message:
glm.fit: fitted probabilities numerically 0 or 1 occurred 

There was Cross Validated post on this issue a while back. As my brother likes to joke (without malice, actually a kinda deep thought)

Perfection offends the Buddha

And the message indicates that the model produced a "perfect separation." According to the post, model results are still produced, but coefficients are inflated. This may arise either from a sampling artifact or the population characteristics itself. If the former, penalized methods can be used; if the former, then it is what it is.

I haven't got yet to the chapter in Applied Logistic Regression 3rd Edition by David W. Hosmer Jr., Stanley Lemeshow and Rodney X. Sturdivant (2009) that discusses this yet. Cross Validated is probably a better forum for such a relatively advanced question. Even so, it may catch the eye of one or more of the real statisticians who appear from time to time.

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.

I think that's best. It strikes me as a somewhat advanced topic in logistic regression, and I think you'll find more of that narrow expertise there.

Good luck!

Thanks for suggestion, but to be frank I didn't completely understand the explanation. But will ask someone in cross validated post.

1 Like