OpenCog ULL - clustering	2017-12-23
Vector space	Gutenberg_16_10
Algorithm	KMeans - sklearn.cluster
Number of clusters	80
Lexicon file	Gut_16_10_lexicon.csv
Lexicon size (words)	6855
AVERAGE METRICS FOR ALL CLUSTERS	-
Average top cluster word similarity to centroid	0.511
Average top 10 words similarity to centroid	0.472
Average cluster words similarity to centroid	0.367
Similarity weighted by words frequency within cluster (SWFC)	0.345
Similarity weighted by words frequency within lexicon (SWFL)	0.002
METRICS FOR CLUSTERS	-
Cluster sizes (words)	55, 93, 100, 76, 85, 50, 93, 53, 41, 104, 68, 69, 85, 60, 64, 163, 85, 90, 125, 163, 97, 74, 77, 89, 65, 38, 42, 65, 88, 141, 131, 94, 135, 89, 129, 82, 68, 78, 84, 56, 103, 119, 67, 93, 66, 67, 106, 70, 112, 69, 85, 155, 97, 101, 106, 53, 108, 49, 100, 97, 79, 116, 59, 113, 83, 96, 90, 43, 86, 53, 84, 80, 63, 94, 63, 42, 74, 114, 75, 81
Cluster top words	isaiah, odd, ropes, nick, nobody, beseech, nos, carriages, store, bounds, appreciate, romantic, devotee, s'pose, give, mesmerism, kids, sob, fates, disembodied, restrain, previously, bade, shoemaker, congratulate, stockings, comrades, rely, ananda, shepherd, luggage, proofreading, naumann, sep, jurgis, prevented, scotland, yes, ut, mifflin, idiot, irritably, clapped, blurted, hybrids, knitting, pin, strove, intolerable, offered, clearer, twenty, triumphant, shrine, exclaim, what'll, sewed, memorandum, concerns, destruction, can't, verse, stepped, snarled, submission, prof, pioneer, madeira, systems, distributed, citizenship, neighbours, cherry, beauties, passed, copyright, drift, sixpence, commented, sentimental
Cluster top word similarities to centroids	0.583, 0.363, 0.509, 0.535, 0.285, 0.592, 0.651, 0.546, 0.524, 0.543, 0.517, 0.364, 0.603, 0.395, 0.401, 0.507, 0.528, 0.513, 0.587, 0.552, 0.491, 0.461, 0.456, 0.577, 0.509, 0.495, 0.634, 0.549, 0.545, 0.507, 0.545, 0.557, 0.453, 0.681, 0.346, 0.525, 0.494, 0.38, 0.64, 0.724, 0.474, 0.573, 0.494, 0.557, 0.452, 0.576, 0.496, 0.636, 0.581, 0.414, 0.507, 0.145, 0.547, 0.47, 0.562, 0.423, 0.505, 0.63, 0.482, 0.507, 0.525, 0.458, 0.448, 0.443, 0.503, 0.564, 0.508, 0.638, 0.509, 0.549, 0.453, 0.605, 0.468, 0.581, 0.35, 0.573, 0.509, 0.585, 0.428, 0.495
Cluster top 10 words avg similarities to centroids	0.531, 0.341, 0.465, 0.483, 0.267, 0.537, 0.647, 0.504, 0.474, 0.496, 0.454, 0.341, 0.564, 0.347, 0.379, 0.48, 0.459, 0.476, 0.55, 0.519, 0.439, 0.442, 0.424, 0.526, 0.467, 0.448, 0.599, 0.51, 0.472, 0.481, 0.499, 0.519, 0.421, 0.654, 0.322, 0.497, 0.444, 0.339, 0.617, 0.72, 0.449, 0.521, 0.478, 0.473, 0.43, 0.502, 0.467, 0.614, 0.55, 0.383, 0.412, 0.131, 0.527, 0.439, 0.47, 0.368, 0.445, 0.586, 0.466, 0.473, 0.501, 0.43, 0.408, 0.411, 0.461, 0.5, 0.487, 0.599, 0.473, 0.506, 0.434, 0.559, 0.403, 0.555, 0.324, 0.484, 0.468, 0.544, 0.392, 0.462
Cluster words avg similarities to centroids	0.418, 0.251, 0.367, 0.385, 0.212, 0.423, 0.455, 0.396, 0.408, 0.388, 0.354, 0.246, 0.446, 0.261, 0.302, 0.365, 0.35, 0.378, 0.405, 0.375, 0.344, 0.336, 0.36, 0.411, 0.38, 0.364, 0.487, 0.402, 0.364, 0.368, 0.375, 0.399, 0.315, 0.505, 0.231, 0.404, 0.339, 0.242, 0.457, 0.546, 0.347, 0.401, 0.405, 0.361, 0.339, 0.401, 0.352, 0.447, 0.437, 0.303, 0.313, 0.056, 0.407, 0.331, 0.364, 0.29, 0.336, 0.479, 0.365, 0.365, 0.354, 0.333, 0.34, 0.314, 0.356, 0.389, 0.366, 0.498, 0.37, 0.404, 0.337, 0.437, 0.304, 0.46, 0.252, 0.394, 0.37, 0.433, 0.325, 0.372
Similarities weighted by words frequency within cluster (SWFC)	0.405, 0.228, 0.337, 0.368, 0.207, 0.405, 0.443, 0.38, 0.399, 0.373, 0.342, 0.235, 0.425, 0.275, 0.309, 0.348, 0.336, 0.336, 0.378, 0.349, 0.303, 0.304, 0.347, 0.399, 0.359, 0.326, 0.48, 0.373, 0.325, 0.34, 0.35, 0.387, 0.289, 0.478, 0.205, 0.387, 0.308, 0.238, 0.397, 0.478, 0.299, 0.388, 0.389, 0.339, 0.308, 0.39, 0.323, 0.422, 0.405, 0.298, 0.294, 0.049, 0.387, 0.303, 0.325, 0.296, 0.311, 0.466, 0.341, 0.328, 0.33, 0.3, 0.357, 0.285, 0.334, 0.376, 0.35, 0.489, 0.337, 0.377, 0.322, 0.41, 0.269, 0.44, 0.249, 0.371, 0.341, 0.423, 0.307, 0.343
Similarities weighted by words frequency within lexicon (SWFL)	0.0, 0.003, 0.001, 0.001, 0.003, 0.0, 0.001, 0.001, 0.0, 0.001, 0.001, 0.002, 0.001, 0.001, 0.01, 0.002, 0.001, 0.003, 0.001, 0.001, 0.002, 0.001, 0.001, 0.001, 0.001, 0.0, 0.0, 0.001, 0.002, 0.002, 0.001, 0.001, 0.002, 0.001, 0.009, 0.002, 0.001, 0.021, 0.003, 0.002, 0.001, 0.001, 0.001, 0.001, 0.001, 0.0, 0.001, 0.001, 0.002, 0.002, 0.001, 0.023, 0.001, 0.002, 0.002, 0.002, 0.001, 0.0, 0.001, 0.002, 0.015, 0.002, 0.006, 0.002, 0.001, 0.001, 0.001, 0.0, 0.001, 0.0, 0.001, 0.001, 0.001, 0.001, 0.009, 0.0, 0.001, 0.001, 0.001, 0.002
SUPPLEMENTAL FILES	CONTENT
Gut_16_10_80_cluster_top_words.txt	Cluster top 10 words statistics
Gut_16_10_80_cluster_words.txt	Cluster words, sorted by similarities to cluster centroids
Gut_16_10_80_cluster_similarities.txt	Cluster word similarities to cluster centroids