Version 2.4


  • Tversky index (TI) added
  • Area under the PR curve (AUPR) added
  • FUNDING.yml added
  • AUC_calc function modified
  • Document modified
  • summary parameter added to save_html,save_stat,save_csv and stat methods
  • sample_weight bug in numpy array format fixed
  • Inputs manipulation bug fixed
  • Test system modified
  • Warning system modified
  • alt_link parameter added to save_html method and online_help function
  • Compare class tests moved to compare_test.py
  • Warning tests moved to warning_test.py

 Source Code (.Zip) (894 KB) 

 Source Code (.tar.gz) (869 KB) 

 Version 2.3


  • Adjusted F-score (AGF) added
  • Overlap coefficient (OC) added
  • Otsuka-Ochiai coefficient (OOC) added
  • save_stat and save_vector parameters added to save_obj method
  • Document modified
  • README.md modified
  • Parameters recommendation for imbalance dataset modified
  • Minor bug in Compare class fixed
  • pycm_help function modified
  • Benchmarks color modified

 Source Code (.Zip) (882 KB) 

 Source Code (.tar.gz) (861 KB) 

 Version 2.2


  • Negative likelihood ratio interpretation (NLRI) added
  • Cramer's benchmark (SOA5) added
  • Matthews correlation coefficient interpretation (MCCI) added
  • Matthews's benchmark (SOA6) added
  • F1 macro added
  • F1 micro added
  • Accuracy macro added
  • Compare class score calculation modified
  • Parameters recommendation for multi-class dataset modified
  • Parameters recommendation for imbalance dataset modified
  • README.md modified
  • Document modified
  • Logo updated

 Source Code (.Zip) (871 KB) 

 Source Code (.tar.gz) (849 KB) 

 Version 2.1


  • Adjusted geometric mean (AGM) added
  • Yule's Q (Q) added
  • Compare class and parameters recommendation system block diagrams added
  • Document links bug fixed
  • Document modified

 Source Code (.Zip) (790 KB) 

 Source Code (.tar.gz) (768 KB) 

 Version 2.0


  • G-Mean (GM) added
  • Index of balanced accuracy (IBA) added
  • Optimized precision (OP) added
  • Pearson's C (C) added
  • Compare class added
  • Parameters recommendation warning added
  • ConfusionMatrix equal method added
  • Document modified
  • stat_print function bug fixed
  • table_print function bug fixed
  • Beta parameter renamed to beta (F_calc function & F_beta method)
  • Parameters recommendation for imbalance dataset modified
  • normalize parameter added to save_html method
  • pycm_func.py splitted into pycm_class_func.py and pycm_overall_func.py
  • vector_filter,vector_check,class_check and matrix_check functions moved to pycm_util.py
  • RACC_calc and RACCU_calc functions exception handler modified
  • Docstrings modified

 Source Code (.Zip) (731 KB) 

 Source Code (.tar.gz) (709 KB) 

 Version 1.9


  • Automatic/Manual (AM) added
  • Bray-Curtis dissimilarity (BCD) added
  • CODE_OF_CONDUCT.md added
  • ISSUE_TEMPLATE.md added
  • PULL_REQUEST_TEMPLATE.md added
  • CONTRIBUTING.md added
  • X11 color names support for save_html method added
  • Parameters recommendation system added
  • Warning message for high dimension matrix print added
  • Interactive notebooks section (binder) added
  • save_matrix and normalize arguments added to save_csv method
  • README.md modified
  • Document modified
  • ConfusionMatrix.__init__ optimized
  • Document and examples output files moved to different folders
  • Test system modified
  • relabel method bug fixed

 Source Code (.Zip) (710 KB) 

 Source Code (.tar.gz) (689 KB) 

 Version 1.8


  • Lift Score (LS) added
  • color argument added to save_html method
  • version_check.py added
  • Error messages modified
  • Document modified
  • Website changed to http://www.pycm.ir
  • Interpretation functions moved to pycm_interpret.py
  • Utility functions moved to pycm_util.py
  • Unnecessary else and elif removed
  • == changed to is

 Source Code (.Zip) (675 KB) 

 Source Code (.tar.gz) (663 KB) 

 Version 1.7


  • Gini Index (GI) added
  • Example-7 added
  • pycm_profile.py added
  • class_name argument added to stat,save_stat,save_csv and save_html methods
  • overall_param and class_param arguments empty list bug fixed
  • matrix_params_calc, matrix_params_from_table and vector_filter functions optimized
  • overall_MCC_calc, CEN_misclassification_calc and convex_combination functions optimized
  • Document modified

 Source Code (.Zip) (671 KB) 

 Source Code (.tar.gz) (660 KB) 

 Version 1.6


  • AUC Value Interpretation (AUCI) added
  • Example-6 added
  • Anaconda cloud package added
  • overall_param and class_param arguments added to stat,save_stat and save_html methods
  • class_param argument added to save_csv method
  • _ removed from overall statistics names
  • README.md modified
  • Document modified

 Source Code (.Zip) (608 KB) 

 Source Code (.tar.gz) (597 KB) 

 Version 1.5


  • Relative Classifier Information (RCI) added
  • Discriminator Power (DP) added
  • Youden's Index (Y) added
  • Discriminant Power Interpretation (DPI) added
  • Positive Likelihood Ratio Interpretation (PLRI) added
  • __len__ method added
  • relabel method added
  • __class_stat_init__ function added
  • __overall_stat_init__ function added
  • matrix attribute added
  • normalized_matrix attribute added
  • normalized_table attribute added
  • Python 3.7 added to .travis.yml & appveyor.yml
  • README.md modified
  • Document modified
  • LR+ renamed to PLR
  • LR- renamed to NLR
  • normalized_matrix method renamed to print_normalized_matrix
  • matrix method renamed to print_matrix
  • entropy_calc fixed
  • cross_entropy_calc fixed
  • conditional_entropy_calc fixed
  • print_table bug for large numbers fixed
  • JSON key bug in save_obj fixed
  • transpose bug in save_obj

 Source Code (.Zip) (604 KB) 

 Source Code (.tar.gz) (593 KB) 

 Version 1.4


  • Area Under Curve added
  • AUNU added
  • AUNP added
  • Class Balance Accuracy added
  • Global Performance Index (RR) added
  • Overall MCC added
  • Distance index (dInd) added
  • Similarity index (sInd) added
  • one_vs_all added
  • dev-requirements.txt added
  • README.md modified
  • Document modified
  • save_stat modified
  • requirements.txt modified

 Source Code (.Zip) (597 KB) 

 Source Code (.tar.gz) (586 KB) 

 Version 1.3


  • Confusion Entropy added
  • Overall Confusion Entropy added
  • Modified Confusion Entropy added
  • Overall Modified Confusion Entropy added
  • Information Score added
  • README.md modified

 Source Code (.Zip) (588 KB) 

 Source Code (.tar.gz) (577 KB) 

 Version 1.2


  • NIR (No Information Rate) added
  • P-Value added
  • sample_weight added
  • transpose added
  • README.md modified
  • Key error in some parameters fixed
  • OSX env added to .travis.yml

 Source Code (.Zip) (584 KB) 

 Source Code (.tar.gz) (574 KB) 

 Version 1.1


  • Zero-one loss added
  • Support added
  • online_help function added
  • README.md modified
  • html_table function modified
  • table_print function modified
  • normalized_table_print function modified

 Source Code (.Zip) (503 KB) 

 Source Code (.tar.gz) (495 KB) 

 Version 1.0


  • Hamming loss added
  • README.md modified

 Source Code (.Zip) (500 KB) 

 Source Code (.tar.gz) (493 KB) 

 Version 0.9.5


  • Obj load added
  • Obj save added
  • Example-4 added
  • README.md modified
  • Block diagram updated

 Source Code (.Zip) (500 KB) 

 Source Code (.tar.gz) (493 KB) 

 Version 0.9


  • Activation Threshold added
  • Example-3 added
  • Jaccard index added
  • Overall Jaccard index added
  • README.md modified
  • setup.py modified

 Source Code (.Zip) (361 KB) 

 Source Code (.tar.gz) (353 KB) 

 Version 0.8.6


  • Example section in document added
  • Python 2.7 CI added
  • JOSS paper pdf added
  • Cite section modified
  • ConfusionMatrix docstring modified
  • round function changed to numpy.around
  • README.md modified

 Source Code (.Zip) (358 KB) 

 Source Code (.tar.gz) (351 KB) 

 Version 0.8.5


  • Confusion matrix size in HTML report modified
  • Example-1 (Comparison of three different classifiers) added
  • Example-2 (How to plot via matplotlib) added
  • ConfusionMatrix docstring added
  • JOSS paper added
  • Test system modified
  • README.md modified

 Source Code (.Zip) (237 KB) 

 Source Code (.tar.gz) (227 KB) 

 Version 0.8.1


  • New parameters added
    • Goodman and Kruskal's lambda B
    • Goodman and Kruskal's lambda A
    • Cross Entropy
    • Conditional Entropy
    • Joint Entropy
    • Reference Entropy
    • Response Entropy
    • Kullback-Liebler divergence
    • Mutual Information
    • Kappa Unbiased
    • Kappa No Prevalence
    • Random Accuracy Unbiased
  • Direct ConfusionMatrix added
  • pycmVectorError class added
  • pycmMatrixError class added
  • Support numpy arrays
  • pycmError class removed

 Source Code (.Zip) (111 KB) 

 Source Code (.tar.gz) (105 KB) 

 Version 0.7


  • New parameters added
    • Cramer's V
    • 95% Confidence interval
    • Chi-Squared
    • Phi-Squared
    • Chi-Squared DF
    • Standard error
    • Kappa standard error
    • Kappa 95% confidence interval
    • Cicchetti benchmark
  • Parameters description links in HTML report modified
  • Confusion matrix color in HTML report modified

 Source Code (.Zip) (60 KB) 

 Source Code (.tar.gz) (56 KB) 

 Version 0.6


  • CSV Report added (save_csv)
  • Changelog added
  • Confusion matrix color in HTML report changed
  • Parameters description links in HTML report added

 Source Code (.Zip) (56 KB) 

 Source Code (.tar.gz) (52 KB) 

 Version 0.5


  • New parameters added
    • Scott's pi
    • Gwet's AC1
    • Bennett S score
  • HTML Report Added (save_html)

 Source Code (.Zip) (50 KB) 

 Source Code (.tar.gz) (48 KB) 

 Version 0.4


  • New parameters added
    • TPR Micro/Macro
    • PPV Micro/Macro
    • RACC Overall
  • Normalized matrix bugs fixed
  • Zero class bugs fixed
  • Fleiss & Altman benchmarks added
  • Output file(.pycm) method added

 Source Code (.Zip) (47 KB) 

 Source Code (.tar.gz) (45 KB) 

 Version 0.3


  • New parameters added
    • Kappa
    • Random Accuracy
    • Strength of Agreement
  • Overall statistics added
  • Round bug fixed

 Source Code (.Zip) (45 KB) 

 Source Code (.tar.gz) (43 KB) 

 Version 0.2


  • New parameters added
    • Population
    • Condition positive
    • Test outcome positive
    • Test outcome negative
    • Prevalence
    • G-measure
  • matrix & normalized_matrix method added
  • params method added

 Source Code (.Zip) (42 KB) 

 Source Code (.tar.gz) (40 KB) 

 Version 0.1


  • First Release
  • Supported Class Statistics
    • ACC
    • BM
    • DOR
    • F1-Score
    • FDR
    • FNR
    • FOR
    • FPR
    • LR+
    • LR-
    • MCC
    • MK
    • NPV
    • PPV
    • TNR
    • TPR

 Source Code (.Zip) (40 KB) 

 Source Code (.tar.gz) (38 KB)