Nick Cammarata Questions Focus on Circuit Depth for Interpretability

In a tweet Nick Cammarata who focuses on neural network interpretability and previously contributed to OpenAI's Circuits series published on Distill.pub addressed worries about circuit depth. He stated he does not understand why people focus on the number of layers because the actual problem is that no solution to interpretability exists yet. The researcher expressed strong optimism despite this assessment.