Discrete default intensity based or logit type models are commonly used as reduced form models for conditional default probabilities for corporate loans where this default probability depends upon macroeconomic as well as firm-specific covariates. Typically, maximum likelihood (ML) methods are used to estimate the parameters associated with these models. Since defaults are rare, a large amount of data is needed for this estimation resulting in a computationally time consuming optimization. In this talk, we observe that since the defaults are typically rare, the first order equations from ML estimation suggest a simple, accurate and intuitively appealing closed form estimator of the underlying parameters. We analyze the properties of the proposed estimator as well as the ML estimator in a statistical asymptotic regime where the conditional probabilities decrease to zero, the number of firms as well as the data availability time period increases to infinity. We characterize the dependence of the mean square error of the estimator on the number of firms as well as time period of available data. Our conclusion, validated by numerical analysis, is that when the underlying model is correctly specified, the proposed estimator is typically similar or only slightly worse than the ML estimator. Importantly however, since usually any model is misspecified due to hidden factor(s), then both the proposed and the ML estimator are equally good or equally bad! The proposed approximations should also have applications outside finance where logit type models are used and probabilities of interest are small.