Information Theoretic Models for Dependence Analysis And missing Data Estimation
American Journal of Theoretical and Applied Statistics
Volume 2, Issue 2, March 2013, Pages: 15-20
Received: Feb. 3, 2013;
Published: Mar. 10, 2013
Views 3033 Downloads 107
D. S. Hooda, Department of Mathematics, Jaypee University of Engineering andTechnology, A.B. Road, Raghogarh, Distt.Guna-473226 (M.P.) India; Department of Statistics, University of Jammu, Jammu-(India)
Permil Kumar, Department of Mathematics, Jaypee University of Engineering andTechnology, A.B. Road, Raghogarh, Distt.Guna-473226 (M.P.) India; Department of Statistics, University of Jammu, Jammu-(India)
Follow on us
In the present communication information theoretic dependence measure has been defined using maximum entropy principle, which measures amount of dependence among the attributes in a contingency table. A relation between information theoretic measure of dependence and Chi-square statistic has been discussed. A generalization of this information theoretic dependence measure has been also studied. In the end Yate’s method and maximum entropy estimation of missing data in design of experiment have been described and illustrated by considering practical problems with empirical data.
Maximum Entropy Principle, Contingency Table, Chi-Square Statistics, Lagrange’s Multipliers And Depen-dence Measure
To cite this article
D. S. Hooda,
Information Theoretic Models for Dependence Analysis And missing Data Estimation, American Journal of Theoretical and Applied Statistics.
Vol. 2, No. 2,
2013, pp. 15-20.
Burg J.P.(1970). "The relationship between Maximum Entropy Spectra and Maximum Likelihood in Modern Spectra Analysis", ed D.G. Childers, pp130-131.
Harvda, J. and Charvat, F. (1967). Quantification method of classification processes concepts of structural - entropy, Kybernetika, 3: 30-35.
Kapur, J.N. and Kesavan, H.K. (1992)." Entropy optimization principles with applications." Academic press, San Diego.K. Elissa, "Title of paper if known," unpublished.
Soofi, E.S. and Gokhale, D.V. (1997). "Information theoretic methods for categorical data. Advances in Econometrics." , JAI Press, Greenwich.
Watanabe,S.(1969)."Knowing and Guessing".John Wiley,New York,1969.
Watanabe, S. (1981). "Pattern recognition as a quest for minimum entropy.", Pattern Recognition. 13:381-387.
Yates, F. (1933). "The analysis of replicated experiments when the field experiments are incomplete.", Emp. Journ. Exp. Agri. 1, 129-142.