
@CSProfKGD Yeah esp. in the age of agents, the experimental results can often be automatically verified if the compute budget is not too high
Industry researchers recently backed a similar motion at PAMITC.
Positive users favor reproducibility requirements for award-winning papers because results can be automatically verified with agents, while negative users cite challenges releasing specialized big-company code.

@CSProfKGD Yeah esp. in the age of agents, the experimental results can often be automatically verified if the compute budget is not too high

@CSProfKGD This is the argument Marc also made after I pitched the motion at the PAMITC
What is critical to note is that all people that spoke up there had industrial affiliations: Georgia, Marc, Myself.
This is not even something a group of pure academics requested

One challenge is that code at big companies is too specialized for their infrastructure. Releasing it doesn't enable the broader community to understand it, nor can the community frankly reproduce something trained on 1000s of GPUs.
The whole community will be poorer if they discourage industrial labs to publish, at a time, when the most impactful work is being done in industry!