Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

Data science, information theory, probability theory, statistical learning and other related disciplines greatly benefit from non-negative measures of dissimilarity between pairs of probability measures. These are known as divergence measures, and exploring their mathematical foundations and diverse applications is of significant interest. The present Special Issue, entitled “Divergence Measures: Mathematical Foundations and Applications in Information-Theoretic and Statistical Problems”, includes eight original contributions, and it is focused on the study of the mathematical properties and applications of classical and generalized divergence measures from an information-theoretic perspective. It mainly deals with two key generalizations of the relative entropy: namely, the R_ényi divergence and the important class of f -divergences. It is our hope that the readers will find interest in this Special Issue, which will stimulate further research in the study of the mathematical foundations and applications of divergence measures.

Research & information: general --- Mathematics & science --- Bregman divergence --- f-divergence --- Jensen–Bregman divergence --- Jensen diversity --- Jensen–Shannon divergence --- capacitory discrimination --- Jensen–Shannon centroid --- mixture family --- information geometry --- difference of convex (DC) programming --- conditional Rényi divergence --- horse betting --- Kelly gambling --- Rényi divergence --- Rényi mutual information --- relative entropy --- chi-squared divergence --- f-divergences --- method of types --- large deviations --- strong data–processing inequalities --- information contraction --- maximal correlation --- Markov chains --- information inequalities --- mutual information --- Rényi entropy --- Carlson–Levin inequality --- information measures --- hypothesis testing --- total variation --- skew-divergence --- convexity --- Pinsker’s inequality --- Bayes risk --- statistical divergences --- minimum divergence estimator --- maximum likelihood --- bootstrap --- conditional limit theorem --- Bahadur efficiency --- α-mutual information --- Augustin–Csiszár mutual information --- data transmission --- error exponents --- dimensionality reduction --- discriminant analysis --- statistical inference --- n/a --- Jensen-Bregman divergence --- Jensen-Shannon divergence --- Jensen-Shannon centroid --- conditional Rényi divergence --- Rényi divergence --- Rényi mutual information --- strong data-processing inequalities --- Rényi entropy --- Carlson-Levin inequality --- Pinsker's inequality --- Augustin-Csiszár mutual information

Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

Data science, information theory, probability theory, statistical learning and other related disciplines greatly benefit from non-negative measures of dissimilarity between pairs of probability measures. These are known as divergence measures, and exploring their mathematical foundations and diverse applications is of significant interest. The present Special Issue, entitled “Divergence Measures: Mathematical Foundations and Applications in Information-Theoretic and Statistical Problems”, includes eight original contributions, and it is focused on the study of the mathematical properties and applications of classical and generalized divergence measures from an information-theoretic perspective. It mainly deals with two key generalizations of the relative entropy: namely, the R_ényi divergence and the important class of f -divergences. It is our hope that the readers will find interest in this Special Issue, which will stimulate further research in the study of the mathematical foundations and applications of divergence measures.

Bregman divergence --- f-divergence --- Jensen–Bregman divergence --- Jensen diversity --- Jensen–Shannon divergence --- capacitory discrimination --- Jensen–Shannon centroid --- mixture family --- information geometry --- difference of convex (DC) programming --- conditional Rényi divergence --- horse betting --- Kelly gambling --- Rényi divergence --- Rényi mutual information --- relative entropy --- chi-squared divergence --- f-divergences --- method of types --- large deviations --- strong data–processing inequalities --- information contraction --- maximal correlation --- Markov chains --- information inequalities --- mutual information --- Rényi entropy --- Carlson–Levin inequality --- information measures --- hypothesis testing --- total variation --- skew-divergence --- convexity --- Pinsker’s inequality --- Bayes risk --- statistical divergences --- minimum divergence estimator --- maximum likelihood --- bootstrap --- conditional limit theorem --- Bahadur efficiency --- α-mutual information --- Augustin–Csiszár mutual information --- data transmission --- error exponents --- dimensionality reduction --- discriminant analysis --- statistical inference --- n/a --- Jensen-Bregman divergence --- Jensen-Shannon divergence --- Jensen-Shannon centroid --- conditional Rényi divergence --- Rényi divergence --- Rényi mutual information --- strong data-processing inequalities --- Rényi entropy --- Carlson-Levin inequality --- Pinsker's inequality --- Augustin-Csiszár mutual information

Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

Data science, information theory, probability theory, statistical learning and other related disciplines greatly benefit from non-negative measures of dissimilarity between pairs of probability measures. These are known as divergence measures, and exploring their mathematical foundations and diverse applications is of significant interest. The present Special Issue, entitled “Divergence Measures: Mathematical Foundations and Applications in Information-Theoretic and Statistical Problems”, includes eight original contributions, and it is focused on the study of the mathematical properties and applications of classical and generalized divergence measures from an information-theoretic perspective. It mainly deals with two key generalizations of the relative entropy: namely, the R_ényi divergence and the important class of f -divergences. It is our hope that the readers will find interest in this Special Issue, which will stimulate further research in the study of the mathematical foundations and applications of divergence measures.

Research & information: general --- Mathematics & science --- Bregman divergence --- f-divergence --- Jensen-Bregman divergence --- Jensen diversity --- Jensen-Shannon divergence --- capacitory discrimination --- Jensen-Shannon centroid --- mixture family --- information geometry --- difference of convex (DC) programming --- conditional Rényi divergence --- horse betting --- Kelly gambling --- Rényi divergence --- Rényi mutual information --- relative entropy --- chi-squared divergence --- f-divergences --- method of types --- large deviations --- strong data-processing inequalities --- information contraction --- maximal correlation --- Markov chains --- information inequalities --- mutual information --- Rényi entropy --- Carlson-Levin inequality --- information measures --- hypothesis testing --- total variation --- skew-divergence --- convexity --- Pinsker's inequality --- Bayes risk --- statistical divergences --- minimum divergence estimator --- maximum likelihood --- bootstrap --- conditional limit theorem --- Bahadur efficiency --- α-mutual information --- Augustin-Csiszár mutual information --- data transmission --- error exponents --- dimensionality reduction --- discriminant analysis --- statistical inference --- Bregman divergence --- f-divergence --- Jensen-Bregman divergence --- Jensen diversity --- Jensen-Shannon divergence --- capacitory discrimination --- Jensen-Shannon centroid --- mixture family --- information geometry --- difference of convex (DC) programming --- conditional Rényi divergence --- horse betting --- Kelly gambling --- Rényi divergence --- Rényi mutual information --- relative entropy --- chi-squared divergence --- f-divergences --- method of types --- large deviations --- strong data-processing inequalities --- information contraction --- maximal correlation --- Markov chains --- information inequalities --- mutual information --- Rényi entropy --- Carlson-Levin inequality --- information measures --- hypothesis testing --- total variation --- skew-divergence --- convexity --- Pinsker's inequality --- Bayes risk --- statistical divergences --- minimum divergence estimator --- maximum likelihood --- bootstrap --- conditional limit theorem --- Bahadur efficiency --- α-mutual information --- Augustin-Csiszár mutual information --- data transmission --- error exponents --- dimensionality reduction --- discriminant analysis --- statistical inference

Choose an application

• Reference Manager
• EndNote
• RefWorks (Direct export to RefWorks)

Most real-world search and optimization problems naturally involve multiple criteria as objectives. Generally, symmetry, asymmetry, and anti-symmetry are basic characteristics of binary relationships used when modeling optimization problems. Moreover, the notion of symmetry has appeared in many articles about uncertainty theories that are employed in multi-criteria problems. Different solutions may produce trade-offs (conflicting scenarios) among different objectives. A better solution with respect to one objective may compromise other objectives. There are various factors that need to be considered to address the problems in multidisciplinary research, which is critical for the overall sustainability of human development and activity. In this regard, in recent decades, decision-making theory has been the subject of intense research activities due to its wide applications in different areas. The decision-making theory approach has become an important means to provide real-time solutions to uncertainty problems. Theories such as probability theory, fuzzy set theory, type-2 fuzzy set theory, rough set, and uncertainty theory, available in the existing literature, deal with such uncertainties. Nevertheless, the uncertain multi-criteria characteristics in such problems have not yet been explored in depth, and there is much left to be achieved in this direction. Hence, different mathematical models of real-life multi-criteria optimization problems can be developed in various uncertain frameworks with special emphasis on optimization problems.

Information technology industries --- multiple-criteria decision-making --- underground mines --- mining methods --- expert knowledge --- failure mode and effects analysis --- solar panel systems --- step-wise weight assessment ratio analysis --- grey relational analysis --- Z-number theory --- B2C e-commerce factors --- website --- MCDM --- Fuzzy AHP --- TOPSIS-Grey --- China --- IoT --- platform selection --- multi criteria decision analysis (MCDA) --- AHP --- PROMETHEE-II --- Industry 4.0 --- data envelopment analysis --- conjoint analysis --- experimental design --- criteria importance --- weight restrictions --- subjective and objective teacher efficiency --- multi-objective planning --- reverse supply chain --- robust optimization --- uncertainty --- meta-heuristic algorithm --- steel making industry --- fuzzy PIPRECIA --- fuzzy EDAS --- railway --- multi-criteria decision-making --- transport policy --- Six Sigma (6σ) --- DMAIC --- vehicle fleet --- optimization --- text mining --- Multi-Attribute Decision Making (MADM), criteria selection --- weighting --- Prospective MADM --- Latent Semantic Analysis (LSA) --- SIMUS --- decision tree --- transport plan --- Laplace’s criterion --- Hurwitz’s criterion --- q-rung orthopair fuzzy numbers --- q-rung orthopair fuzzy prioritized weighted average operator --- q-rung orthopair fuzzy prioritized weighted geometric operator --- green supply chain management --- fuzzy theory --- sustainable development --- SCOR model --- FAHP --- PROMETHEE II --- textile and garments industry --- sustainable supplier selection --- MCDA --- efficiency --- DEA --- SFA --- classification --- dimensionality reduction --- q-ROFNs --- Einstein operators --- prioritized aggregation operators --- multi-criteria group decision making --- hazardous materials --- vehicle route model (VRP) --- uncertainty theory --- chance constrained programming model --- hybrid intelligent algorithm --- linear Diophantine fuzzy set --- linear Diophantine fuzzy soft rough set --- soft rough linear Diophantine fuzzy set --- upper reduct and lower reduct --- core set --- multi-criteria decision making --- q-Rung orthopair fuzzy sets --- geometric aggregation operators based on generalized and group-generalized parameters --- water loss management --- decision making --- intuitionistic fuzzy sets --- the COMET method --- service quality --- fuzzy set --- Jensen–Shannon divergence --- shapley function --- TODIM --- port-hinterland transportation system --- bi-objective programming --- intermodal transportation --- carbon emissions --- uncertain demand --- distributionally robust --- chance constraint --- Yangtze River Economic Belt --- multi-criteria decision-analysis --- MCDA benchmark --- normalization --- entropy --- decision-making methods --- multi-criteria problems --- evolutionary algorithms --- machine learning --- fuzzy logic --- uncertain data --- consistency weights --- fuzzy preference relation (FPR) --- hesitant fuzzy preference relation (HFPR) --- Łukasiewicz consistency --- normal hesitant fuzzy preference relation (NHFPR) --- multiple criteria decision-making (MCDM) --- outsourcing provider --- DEMATEL --- CRITIC --- TOPSIS --- comparison measure --- representation --- disjoint --- multiplicative preference relation (MPR) --- group decision-making (GDM) --- incomplete fuzzy preference relation (IFPR) --- TL-consistency --- cubic m-polar fuzzy set --- Dombi’s operations --- cubic m-polar fuzzy aggregation operators with P-order (R-order) --- SIR technique --- complex networks --- social networks --- viral marketing --- information propagation --- crisp probability --- interval probability --- influence diagrams --- circuit breakers --- granular computing --- interval-valued --- intuitionistic fuzzy set --- multiple granulation --- ordered information system --- multiple-criteria decision-making --- underground mines --- mining methods --- expert knowledge --- failure mode and effects analysis --- solar panel systems --- step-wise weight assessment ratio analysis --- grey relational analysis --- Z-number theory --- B2C e-commerce factors --- website --- MCDM --- Fuzzy AHP --- TOPSIS-Grey --- China --- IoT --- platform selection --- multi criteria decision analysis (MCDA) --- AHP --- PROMETHEE-II --- Industry 4.0 --- data envelopment analysis --- conjoint analysis --- experimental design --- criteria importance --- weight restrictions --- subjective and objective teacher efficiency --- multi-objective planning --- reverse supply chain --- robust optimization --- uncertainty --- meta-heuristic algorithm --- steel making industry --- fuzzy PIPRECIA --- fuzzy EDAS --- railway --- multi-criteria decision-making --- transport policy --- Six Sigma (6σ) --- DMAIC --- vehicle fleet --- optimization --- text mining --- Multi-Attribute Decision Making (MADM), criteria selection --- weighting --- Prospective MADM --- Latent Semantic Analysis (LSA) --- SIMUS --- decision tree --- transport plan --- Laplace’s criterion --- Hurwitz’s criterion --- q-rung orthopair fuzzy numbers --- q-rung orthopair fuzzy prioritized weighted average operator --- q-rung orthopair fuzzy prioritized weighted geometric operator --- green supply chain management --- fuzzy theory --- sustainable development --- SCOR model --- FAHP --- PROMETHEE II --- textile and garments industry --- sustainable supplier selection --- MCDA --- efficiency --- DEA --- SFA --- classification --- dimensionality reduction --- q-ROFNs --- Einstein operators --- prioritized aggregation operators --- multi-criteria group decision making --- hazardous materials --- vehicle route model (VRP) --- uncertainty theory --- chance constrained programming model --- hybrid intelligent algorithm --- linear Diophantine fuzzy set --- linear Diophantine fuzzy soft rough set --- soft rough linear Diophantine fuzzy set --- upper reduct and lower reduct --- core set --- multi-criteria decision making --- q-Rung orthopair fuzzy sets --- geometric aggregation operators based on generalized and group-generalized parameters --- water loss management --- decision making --- intuitionistic fuzzy sets --- the COMET method --- service quality --- fuzzy set --- Jensen–Shannon divergence --- shapley function --- TODIM --- port-hinterland transportation system --- bi-objective programming --- intermodal transportation --- carbon emissions --- uncertain demand --- distributionally robust --- chance constraint --- Yangtze River Economic Belt --- multi-criteria decision-analysis --- MCDA benchmark --- normalization --- entropy --- decision-making methods --- multi-criteria problems --- evolutionary algorithms --- machine learning --- fuzzy logic --- uncertain data --- consistency weights --- fuzzy preference relation (FPR) --- hesitant fuzzy preference relation (HFPR) --- Łukasiewicz consistency --- normal hesitant fuzzy preference relation (NHFPR) --- multiple criteria decision-making (MCDM) --- outsourcing provider --- DEMATEL --- CRITIC --- TOPSIS --- comparison measure --- representation --- disjoint --- multiplicative preference relation (MPR) --- group decision-making (GDM) --- incomplete fuzzy preference relation (IFPR) --- TL-consistency --- cubic m-polar fuzzy set --- Dombi’s operations --- cubic m-polar fuzzy aggregation operators with P-order (R-order) --- SIR technique --- complex networks --- social networks --- viral marketing --- information propagation --- crisp probability --- interval probability --- influence diagrams --- circuit breakers --- granular computing --- interval-valued --- intuitionistic fuzzy set --- multiple granulation --- ordered information system