OpenCog ULL - clustering 2017-12-23 Vector space Gutenberg_16_10 Algorithm KMeans - sklearn.cluster Number of clusters 60 Lexicon file Gut_16_10_lexicon.csv Lexicon size (words) 6855 AVERAGE METRICS FOR ALL CLUSTERS - Average top cluster word similarity to centroid 0.505 Average top 10 words similarity to centroid 0.466 Average cluster words similarity to centroid 0.35 Similarity weighted by words frequency within cluster (SWFC) 0.325 Similarity weighted by words frequency within lexicon (SWFL) 0.003 METRICS FOR CLUSTERS - Cluster sizes (words) 119, 80, 72, 39, 113, 133, 132, 159, 99, 107, 182, 100, 121, 106, 124, 108, 79, 164, 111, 120, 83, 106, 164, 54, 100, 154, 243, 55, 184, 197, 141, 170, 101, 122, 137, 106, 63, 64, 128, 142, 165, 111, 90, 140, 146, 115, 109, 86, 46, 73, 130, 96, 34, 119, 104, 109, 96, 115, 90, 99 Cluster top words suppose, knitting, vietnam, weighing, disembodied, sewed, disturb, select, memorandum, youngest, neighbours, kids, prof, shoemaker, shrine, sep, unbelief, destruction, snarled, minded, can't, bounds, coin, caelte, ananda, shepherd, go, isaiah, citizenship, mesmerism, take, triumphant, drift, verse, irritably, blurted, waist, houghton, sixpence, fates, luggage, nick, strove, jurgis, bury, exclaim, restrain, ut, blanket, resolutely, clearer, submission, five, idiot, proofreading, devotee, sentimental, pin, sob, pp Cluster top word similarities to centroids 0.367, 0.518, 0.448, 0.582, 0.573, 0.471, 0.477, 0.477, 0.581, 0.508, 0.543, 0.491, 0.542, 0.558, 0.442, 0.646, 0.56, 0.493, 0.448, 0.334, 0.508, 0.547, 0.521, 0.472, 0.525, 0.497, 0.167, 0.589, 0.515, 0.48, 0.375, 0.517, 0.461, 0.451, 0.552, 0.543, 0.479, 0.678, 0.565, 0.568, 0.506, 0.487, 0.598, 0.335, 0.468, 0.543, 0.476, 0.634, 0.468, 0.476, 0.462, 0.471, 0.6, 0.458, 0.542, 0.576, 0.467, 0.488, 0.512, 0.644 Cluster top 10 words avg similarities to centroids 0.323, 0.463, 0.423, 0.502, 0.55, 0.424, 0.44, 0.442, 0.557, 0.478, 0.496, 0.425, 0.48, 0.511, 0.416, 0.623, 0.54, 0.47, 0.413, 0.315, 0.488, 0.496, 0.494, 0.414, 0.455, 0.469, 0.16, 0.532, 0.494, 0.455, 0.353, 0.491, 0.426, 0.42, 0.498, 0.462, 0.446, 0.674, 0.526, 0.532, 0.459, 0.43, 0.575, 0.314, 0.451, 0.453, 0.428, 0.611, 0.407, 0.449, 0.373, 0.433, 0.55, 0.432, 0.5, 0.536, 0.437, 0.46, 0.475, 0.64 Cluster words avg similarities to centroids 0.229, 0.362, 0.327, 0.419, 0.411, 0.315, 0.328, 0.342, 0.437, 0.357, 0.362, 0.31, 0.36, 0.392, 0.305, 0.463, 0.411, 0.353, 0.318, 0.218, 0.339, 0.385, 0.362, 0.32, 0.345, 0.351, 0.081, 0.42, 0.377, 0.335, 0.27, 0.359, 0.32, 0.323, 0.373, 0.344, 0.349, 0.482, 0.403, 0.383, 0.327, 0.324, 0.394, 0.225, 0.346, 0.349, 0.328, 0.45, 0.315, 0.36, 0.275, 0.326, 0.43, 0.327, 0.379, 0.404, 0.343, 0.343, 0.377, 0.442 Similarities weighted by words frequency within cluster (SWFC) 0.228, 0.354, 0.297, 0.396, 0.382, 0.289, 0.32, 0.314, 0.427, 0.342, 0.337, 0.293, 0.342, 0.378, 0.273, 0.438, 0.405, 0.318, 0.29, 0.188, 0.318, 0.371, 0.318, 0.28, 0.308, 0.32, 0.058, 0.411, 0.353, 0.308, 0.275, 0.339, 0.291, 0.289, 0.358, 0.318, 0.322, 0.421, 0.39, 0.352, 0.291, 0.297, 0.358, 0.201, 0.32, 0.308, 0.287, 0.389, 0.301, 0.337, 0.259, 0.3, 0.408, 0.283, 0.366, 0.381, 0.308, 0.32, 0.335, 0.432 Similarities weighted by words frequency within lexicon (SWFL) 0.01, 0.001, 0.001, 0.0, 0.001, 0.002, 0.002, 0.002, 0.001, 0.001, 0.002, 0.001, 0.001, 0.001, 0.003, 0.001, 0.0, 0.003, 0.002, 0.003, 0.014, 0.001, 0.003, 0.001, 0.002, 0.002, 0.033, 0.0, 0.002, 0.002, 0.009, 0.001, 0.001, 0.002, 0.001, 0.001, 0.001, 0.002, 0.001, 0.001, 0.002, 0.001, 0.001, 0.01, 0.002, 0.003, 0.002, 0.003, 0.0, 0.001, 0.002, 0.001, 0.003, 0.002, 0.001, 0.001, 0.003, 0.001, 0.003, 0.001 SUPPLEMENTAL FILES CONTENT Gut_16_10_60_cluster_top_words.txt Cluster top 10 words statistics Gut_16_10_60_cluster_words.txt Cluster words, sorted by similarities to cluster centroids Gut_16_10_60_cluster_similarities.txt Cluster word similarities to cluster centroids