OpenCog ULL - clustering	2017-12-23
Vector space	Gutenberg_16_10
Algorithm	KMeans - sklearn.cluster
Number of clusters	40
Lexicon file	Gut_16_10_lexicon.csv
Lexicon size (words)	6855
AVERAGE METRICS FOR ALL CLUSTERS	-
Average top cluster word similarity to centroid	0.473
Average top 10 words similarity to centroid	0.443
Average cluster words similarity to centroid	0.313
Similarity weighted by words frequency within cluster (SWFC)	0.287
Similarity weighted by words frequency within lexicon (SWFL)	0.003
METRICS FOR CLUSTERS	-
Cluster sizes (words)	182, 186, 216, 125, 124, 205, 164, 136, 547, 250, 231, 167, 142, 244, 153, 136, 93, 121, 93, 144, 172, 212, 177, 150, 92, 189, 136, 123, 246, 157, 142, 63, 163, 180, 149, 185, 169, 162, 150, 179
Cluster top words	deserved, shepherd, distributed, strove, unbelief, fates, bury, bade, sleep, neighbours, triumphant, sixpence, nick, disembodied, devotee, kids, can't, xxii, ut, verse, lydgate, beauties, proofreading, shoemaker, sob, coin, exercises, restrain, mesmerism, submission, youngest, crowell, disturb, sewed, spiteful, destruction, irritably, bounds, duel, select
Cluster top word similarities to centroids	0.354, 0.465, 0.503, 0.532, 0.498, 0.523, 0.447, 0.42, 0.147, 0.503, 0.477, 0.521, 0.463, 0.497, 0.524, 0.459, 0.478, 0.598, 0.616, 0.427, 0.311, 0.494, 0.48, 0.497, 0.509, 0.501, 0.427, 0.459, 0.447, 0.42, 0.488, 0.687, 0.44, 0.434, 0.349, 0.475, 0.522, 0.485, 0.593, 0.463
Cluster top 10 words avg similarities to centroids	0.326, 0.442, 0.475, 0.515, 0.471, 0.491, 0.434, 0.381, 0.14, 0.458, 0.449, 0.485, 0.403, 0.467, 0.489, 0.394, 0.46, 0.594, 0.594, 0.399, 0.294, 0.474, 0.443, 0.455, 0.471, 0.475, 0.391, 0.411, 0.426, 0.389, 0.458, 0.684, 0.412, 0.394, 0.324, 0.452, 0.47, 0.443, 0.57, 0.431
Cluster words avg similarities to centroids	0.228, 0.319, 0.333, 0.327, 0.317, 0.331, 0.322, 0.297, 0.067, 0.314, 0.307, 0.354, 0.29, 0.31, 0.344, 0.275, 0.31, 0.386, 0.427, 0.297, 0.208, 0.351, 0.307, 0.311, 0.372, 0.338, 0.283, 0.307, 0.3, 0.272, 0.324, 0.495, 0.3, 0.279, 0.224, 0.331, 0.334, 0.32, 0.395, 0.324
Similarities weighted by words frequency within cluster (SWFC)	0.232, 0.287, 0.32, 0.297, 0.309, 0.304, 0.294, 0.281, 0.042, 0.289, 0.282, 0.34, 0.268, 0.283, 0.324, 0.256, 0.241, 0.384, 0.364, 0.264, 0.186, 0.322, 0.284, 0.294, 0.328, 0.297, 0.25, 0.261, 0.273, 0.246, 0.311, 0.438, 0.287, 0.257, 0.192, 0.294, 0.319, 0.301, 0.377, 0.295
Similarities weighted by words frequency within lexicon (SWFL)	0.007, 0.002, 0.001, 0.001, 0.001, 0.002, 0.002, 0.001, 0.024, 0.002, 0.002, 0.001, 0.001, 0.002, 0.001, 0.001, 0.023, 0.001, 0.003, 0.002, 0.012, 0.002, 0.001, 0.001, 0.003, 0.003, 0.002, 0.002, 0.003, 0.002, 0.001, 0.002, 0.003, 0.003, 0.003, 0.003, 0.001, 0.001, 0.001, 0.002
SUPPLEMENTAL FILES	CONTENT
Gut_16_10_40_cluster_top_words.txt	Cluster top 10 words statistics
Gut_16_10_40_cluster_words.txt	Cluster words, sorted by similarities to cluster centroids
Gut_16_10_40_cluster_similarities.txt	Cluster word similarities to cluster centroids