Consistency across three seeds in MIB tasks
A user reports that 87% of the top 10% of nodes were shared across a pair of seeds, calling the consistency “high but not perfect.”
TLDR
For three seeds reported in an appendix for MIB tasks, a user reports an average Spearman rank correlation of 0.884 between pairs of seeds. They also say 87% of the top 10% of nodes were shared across a pair of seeds—describing high, but not perfect, consistency.
Consistency across three seeds in MIB tasks
A user reports that 87% of the top 10% of nodes were shared across a pair of seeds, calling the consistency “high but not perfect.”
TLDR
For three seeds reported in an appendix for MIB tasks, a user reports an average Spearman rank correlation of 0.884 between pairs of seeds. They also say 87% of the top 10% of nodes were shared across a pair of seeds—describing high, but not perfect, consistency.