OpenCog ULL - clustering 2017-12-23 Vector space Gutenberg_16_10 Algorithm KMeans - sklearn.cluster Number of clusters 30 Lexicon file Gut_16_10_lexicon.csv Lexicon size (words) 6855 AVERAGE METRICS FOR ALL CLUSTERS - Average top cluster word similarity to centroid 0.45 Average top 10 words similarity to centroid 0.423 Average cluster words similarity to centroid 0.288 Similarity weighted by words frequency within cluster (SWFC) 0.263 Similarity weighted by words frequency within lexicon (SWFL) 0.004 METRICS FOR CLUSTERS - Cluster sizes (words) 254, 178, 268, 252, 216, 207, 214, 198, 198, 213, 193, 175, 243, 193, 242, 236, 104, 198, 245, 62, 207, 376, 242, 694, 183, 155, 257, 246, 187, 219 Cluster top words suppose, bounds, distributed, gulf, coin, select, youngest, sixpence, shepherd, fates, gad, laughs, prof, strove, triumphant, mesmerism, can't, destruction, neighbours, houghton, irritably, prevented, citizenship, emma, idiot, shrine, disembodied, duel, snarled, luggage Cluster top word similarities to centroids 0.295, 0.464, 0.472, 0.47, 0.474, 0.452, 0.444, 0.51, 0.459, 0.521, 0.406, 0.481, 0.458, 0.47, 0.468, 0.451, 0.459, 0.461, 0.502, 0.691, 0.497, 0.36, 0.47, 0.115, 0.394, 0.409, 0.49, 0.514, 0.391, 0.464 Cluster top 10 words avg similarities to centroids 0.26, 0.426, 0.445, 0.467, 0.45, 0.414, 0.421, 0.471, 0.436, 0.492, 0.379, 0.446, 0.404, 0.454, 0.439, 0.428, 0.442, 0.441, 0.456, 0.688, 0.446, 0.333, 0.452, 0.106, 0.374, 0.388, 0.456, 0.49, 0.364, 0.419 Cluster words avg similarities to centroids 0.159, 0.301, 0.3, 0.272, 0.31, 0.307, 0.284, 0.335, 0.313, 0.329, 0.268, 0.305, 0.268, 0.264, 0.296, 0.303, 0.289, 0.317, 0.314, 0.502, 0.304, 0.213, 0.323, 0.054, 0.262, 0.274, 0.301, 0.318, 0.258, 0.283 Similarities weighted by words frequency within cluster (SWFC) 0.157, 0.279, 0.276, 0.266, 0.271, 0.274, 0.273, 0.325, 0.283, 0.304, 0.244, 0.287, 0.249, 0.254, 0.272, 0.273, 0.252, 0.279, 0.279, 0.443, 0.286, 0.215, 0.287, 0.035, 0.23, 0.238, 0.274, 0.306, 0.234, 0.251 Similarities weighted by words frequency within lexicon (SWFL) 0.009, 0.001, 0.002, 0.001, 0.004, 0.003, 0.001, 0.001, 0.002, 0.002, 0.003, 0.001, 0.001, 0.001, 0.002, 0.003, 0.018, 0.003, 0.002, 0.002, 0.001, 0.008, 0.003, 0.021, 0.003, 0.005, 0.002, 0.002, 0.003, 0.003 SUPPLEMENTAL FILES CONTENT Gut_16_10_30_cluster_top_words.txt Cluster top 10 words statistics Gut_16_10_30_cluster_words.txt Cluster words, sorted by similarities to cluster centroids Gut_16_10_30_cluster_similarities.txt Cluster word similarities to cluster centroids