Reactions from ranked influencers
7 posts
@eliebakouch @thinkymachines I really should read the j-space thing more in depth. People are still using CKA? That makes me feel ancient. Takes me back to my first year of gradschool.
@code_star @thinkymachines aha is it a bad metric? i think it's a good one for similarity of layers no?
@eliebakouch @thinkymachines This was the first of a few of these types of things that ultimately ended with CKA https://arxiv.org/abs/1706.05806
@eliebakouch @thinkymachines “We have j-space at home” J-space at home:
@code_star @thinkymachines i actually have no idea, we might be? do you have other thing to look at? (tho anthropic used CKA in the paper hence why i choosed it)