OpenCog ULL - clustering	2017-12-23
Vector space	Gutenberg_16_10
Algorithm	KMeans - sklearn.cluster
Number of clusters	70
Lexicon file	Gut_16_10_lexicon.csv
Lexicon size (words)	6855
AVERAGE METRICS FOR ALL CLUSTERS	-
Average top cluster word similarity to centroid	0.506
Average top 10 words similarity to centroid	0.467
Average cluster words similarity to centroid	0.357
Similarity weighted by words frequency within cluster (SWFC)	0.331
Similarity weighted by words frequency within lexicon (SWFL)	0.003
METRICS FOR CLUSTERS	-
Cluster sizes (words)	130, 86, 78, 119, 89, 140, 106, 82, 59, 118, 82, 49, 115, 111, 99, 112, 82, 100, 75, 163, 112, 140, 111, 118, 48, 54, 103, 106, 100, 76, 86, 157, 105, 12, 76, 130, 52, 181, 86, 114, 90, 96, 115, 75, 82, 164, 83, 111, 58, 94, 95, 105, 37, 153, 141, 96, 98, 53, 124, 91, 94, 108, 70, 52, 89, 103, 130, 157, 56, 73
Cluster top words	naumann, laughs, coin, destruction, what'll, luggage, give, submission, metropolis, disturb, strove, verdict, irritably, bounds, sep, jurgis, can't, restrain, systems, triumphant, devotee, prof, shrine, physician, wing, adieu, resemblance, shoemaker, sixpence, lovers, deficient, distributed, blurted, bid, mechanical, enabled, isaiah, mesmerism, yes, else, youngest, haughtily, intolerable, nick, appreciate, disembodied, ut, clearer, halls, sob, kids, idiot, caelte, shepherd, select, ananda, fates, rushing, snarled, commented, spiteful, pin, citizenship, resolutely, beauties, exclaim, sewed, fine, mifflin, shrugged
Cluster top word similarities to centroids	0.458, 0.576, 0.347, 0.519, 0.408, 0.531, 0.335, 0.495, 0.571, 0.484, 0.62, 0.406, 0.566, 0.531, 0.661, 0.366, 0.514, 0.492, 0.531, 0.52, 0.582, 0.529, 0.46, 0.451, 0.539, 0.47, 0.455, 0.553, 0.594, 0.619, 0.545, 0.529, 0.54, 0.567, 0.59, 0.478, 0.594, 0.489, 0.363, 0.265, 0.527, 0.656, 0.58, 0.538, 0.501, 0.547, 0.643, 0.475, 0.517, 0.504, 0.516, 0.474, 0.485, 0.497, 0.493, 0.529, 0.558, 0.448, 0.434, 0.411, 0.411, 0.489, 0.561, 0.541, 0.56, 0.55, 0.474, 0.119, 0.724, 0.546
Cluster top 10 words avg similarities to centroids	0.421, 0.537, 0.332, 0.494, 0.361, 0.486, 0.299, 0.452, 0.523, 0.446, 0.596, 0.366, 0.513, 0.486, 0.639, 0.338, 0.491, 0.44, 0.5, 0.493, 0.547, 0.466, 0.432, 0.423, 0.494, 0.438, 0.426, 0.502, 0.55, 0.573, 0.525, 0.505, 0.459, 0.501, 0.537, 0.46, 0.542, 0.464, 0.327, 0.249, 0.497, 0.652, 0.549, 0.483, 0.439, 0.516, 0.62, 0.383, 0.467, 0.468, 0.449, 0.45, 0.45, 0.471, 0.457, 0.459, 0.515, 0.424, 0.403, 0.376, 0.374, 0.461, 0.498, 0.491, 0.535, 0.461, 0.425, 0.106, 0.72, 0.481
Cluster words avg similarities to centroids	0.318, 0.422, 0.237, 0.383, 0.267, 0.358, 0.208, 0.347, 0.405, 0.337, 0.421, 0.3, 0.394, 0.374, 0.484, 0.245, 0.342, 0.345, 0.4, 0.362, 0.418, 0.343, 0.32, 0.326, 0.396, 0.346, 0.33, 0.376, 0.432, 0.454, 0.391, 0.371, 0.341, 0.46, 0.404, 0.357, 0.431, 0.348, 0.228, 0.185, 0.374, 0.456, 0.435, 0.381, 0.337, 0.372, 0.462, 0.285, 0.348, 0.368, 0.336, 0.349, 0.362, 0.356, 0.361, 0.349, 0.374, 0.335, 0.306, 0.299, 0.286, 0.346, 0.395, 0.399, 0.427, 0.357, 0.318, 0.052, 0.546, 0.383
Similarities weighted by words frequency within cluster (SWFC)	0.291, 0.413, 0.231, 0.346, 0.253, 0.328, 0.212, 0.317, 0.385, 0.324, 0.397, 0.276, 0.383, 0.361, 0.461, 0.212, 0.287, 0.308, 0.374, 0.342, 0.402, 0.325, 0.285, 0.292, 0.365, 0.335, 0.286, 0.36, 0.424, 0.415, 0.379, 0.356, 0.316, 0.406, 0.373, 0.329, 0.421, 0.324, 0.229, 0.165, 0.349, 0.446, 0.403, 0.363, 0.317, 0.345, 0.406, 0.266, 0.329, 0.319, 0.32, 0.315, 0.345, 0.33, 0.334, 0.295, 0.353, 0.305, 0.27, 0.271, 0.261, 0.317, 0.368, 0.367, 0.401, 0.316, 0.286, 0.045, 0.478, 0.373
Similarities weighted by words frequency within lexicon (SWFL)	0.002, 0.001, 0.002, 0.002, 0.005, 0.002, 0.007, 0.001, 0.001, 0.003, 0.001, 0.001, 0.001, 0.001, 0.001, 0.009, 0.019, 0.002, 0.001, 0.001, 0.001, 0.001, 0.003, 0.002, 0.001, 0.0, 0.003, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.0, 0.001, 0.002, 0.0, 0.002, 0.023, 0.01, 0.001, 0.001, 0.002, 0.001, 0.001, 0.001, 0.002, 0.002, 0.001, 0.003, 0.001, 0.001, 0.0, 0.002, 0.002, 0.003, 0.001, 0.001, 0.003, 0.002, 0.002, 0.001, 0.001, 0.001, 0.001, 0.003, 0.003, 0.019, 0.002, 0.001
SUPPLEMENTAL FILES	CONTENT
Gut_16_10_70_cluster_top_words.txt	Cluster top 10 words statistics
Gut_16_10_70_cluster_words.txt	Cluster words, sorted by similarities to cluster centroids
Gut_16_10_70_cluster_similarities.txt	Cluster word similarities to cluster centroids