CROCODIL Paper Tests Cross-Model Code Editing

Elvis Saravia posted about the arXiv paper CROCODIL by Linghan Zhong, Aditya Thimmaiah, Milos Gligoric and Junyi Jessy Li. The work from UT Austin and Cisco Research measures editing by one model on code originally produced by a different model. Saravia noted that some models over-edit such code and that many repositories now contain commits from multiple models, which changes subsequent edits by each model.