OpenCog ULL - clustering 2017-12-23 Vector space Gutenberg_16_10 Algorithm KMeans - sklearn.cluster Number of clusters 50 Lexicon file Gut_16_10_lexicon.csv Lexicon size (words) 6855 AVERAGE METRICS FOR ALL CLUSTERS - Average top cluster word similarity to centroid 0.488 Average top 10 words similarity to centroid 0.454 Average cluster words similarity to centroid 0.332 Similarity weighted by words frequency within cluster (SWFC) 0.307 Similarity weighted by words frequency within lexicon (SWFL) 0.003 METRICS FOR CLUSTERS - Cluster sizes (words) 57, 120, 349, 84, 121, 190, 154, 116, 118, 144, 165, 158, 139, 119, 126, 149, 134, 156, 106, 100, 119, 176, 148, 91, 91, 109, 193, 157, 118, 112, 138, 206, 153, 60, 110, 82, 92, 143, 112, 118, 164, 129, 209, 169, 121, 135, 147, 201, 125, 122 Cluster top words entrained, nick, away, isaiah, pay, beauties, prof, bade, exercises, shoemaker, destruction, naumann, snarled, rosencrantz, verse, enabled, sixpence, fates, ananda, deserved, exclaim, coin, sewed, can't, ut, restrain, distributed, select, trunk, deficient, mesmerism, neighbours, suppose, hurst, regarded, strove, sob, youngest, laughs, submission, luggage, pin, disembodied, shepherd, odd, irritably, jurgis, triumphant, devotee, sep Cluster top word similarities to centroids 0.546, 0.476, 0.144, 0.542, 0.402, 0.511, 0.522, 0.435, 0.444, 0.503, 0.494, 0.432, 0.425, 0.604, 0.441, 0.472, 0.56, 0.554, 0.519, 0.465, 0.54, 0.51, 0.462, 0.487, 0.621, 0.477, 0.512, 0.483, 0.321, 0.497, 0.534, 0.525, 0.341, 0.697, 0.448, 0.601, 0.508, 0.496, 0.534, 0.453, 0.508, 0.467, 0.517, 0.483, 0.337, 0.547, 0.334, 0.488, 0.558, 0.628 Cluster top 10 words avg similarities to centroids 0.467, 0.42, 0.134, 0.486, 0.381, 0.49, 0.461, 0.397, 0.406, 0.469, 0.471, 0.402, 0.393, 0.6, 0.414, 0.452, 0.519, 0.519, 0.45, 0.418, 0.451, 0.483, 0.416, 0.466, 0.599, 0.429, 0.485, 0.448, 0.305, 0.476, 0.501, 0.479, 0.299, 0.694, 0.43, 0.579, 0.471, 0.463, 0.492, 0.416, 0.46, 0.442, 0.484, 0.459, 0.317, 0.498, 0.311, 0.461, 0.524, 0.606 Cluster words avg similarities to centroids 0.363, 0.311, 0.064, 0.365, 0.301, 0.371, 0.331, 0.317, 0.299, 0.33, 0.353, 0.293, 0.293, 0.394, 0.316, 0.345, 0.394, 0.364, 0.337, 0.304, 0.344, 0.35, 0.303, 0.318, 0.434, 0.329, 0.347, 0.349, 0.228, 0.325, 0.382, 0.343, 0.203, 0.509, 0.324, 0.401, 0.373, 0.334, 0.368, 0.302, 0.329, 0.322, 0.333, 0.34, 0.217, 0.373, 0.227, 0.324, 0.388, 0.441 Similarities weighted by words frequency within cluster (SWFC) 0.326, 0.29, 0.043, 0.355, 0.301, 0.345, 0.314, 0.299, 0.263, 0.314, 0.318, 0.266, 0.269, 0.388, 0.282, 0.326, 0.388, 0.333, 0.297, 0.293, 0.296, 0.308, 0.275, 0.245, 0.369, 0.29, 0.33, 0.324, 0.213, 0.319, 0.364, 0.318, 0.198, 0.452, 0.314, 0.376, 0.325, 0.324, 0.35, 0.276, 0.294, 0.296, 0.307, 0.313, 0.193, 0.358, 0.202, 0.298, 0.369, 0.424 Similarities weighted by words frequency within lexicon (SWFL) 0.001, 0.001, 0.022, 0.001, 0.011, 0.002, 0.001, 0.001, 0.002, 0.001, 0.003, 0.002, 0.003, 0.001, 0.002, 0.002, 0.001, 0.001, 0.003, 0.001, 0.004, 0.003, 0.003, 0.023, 0.003, 0.002, 0.001, 0.002, 0.002, 0.001, 0.001, 0.002, 0.012, 0.002, 0.001, 0.001, 0.003, 0.001, 0.001, 0.001, 0.002, 0.002, 0.002, 0.002, 0.003, 0.001, 0.01, 0.002, 0.001, 0.001 SUPPLEMENTAL FILES CONTENT Gut_16_10_50_cluster_top_words.txt Cluster top 10 words statistics Gut_16_10_50_cluster_words.txt Cluster words, sorted by similarities to cluster centroids Gut_16_10_50_cluster_similarities.txt Cluster word similarities to cluster centroids