QED AI Platform Reviews 57K Preprints and Releases Year's Top 1% Papers

@OdedRechavi Any chance to get some of my papers scored? (Arxiv also) :D

Either way, cool experiment. I have not really looked into the quality of the reviews or the rankings. But look forward to spot checking some & also to opinions from others on the quality/biases of the reviews & the rankings. 5/5

Again all of these may be biased in different ways but objectively there is no definition of top 1% like metrics based on scalar aggregates. Readers should be able to personalize content as well based on what they care about the most. 3/

Also one of the issues with creating such scalar ranking metric is that people then desperately game the metric. If the metrics are multi-dimensional and there are many possible ways to rank (based on reader preferences), then much harder to game. 4/

@OdedRechavi Can you provide a link to a Github repository with the code to reproduce all the results and the figures from your company's blogpost about this?

@jdpereira @HaoYin20 The thing about pre prints is that you can keep updating version, and adding more work, it's a live format

@danofer @OdedRechavi @danofer, simply upload them to http://qedscience.com and see you're score

@OdedRechavi So QED is the new journal where people instead of reading the work can rely on qed choosing the worthy?

There is an opportunity here to do something much better. Extract multi-dimensional interpretable attributes of scientific utility & allow users to sort content based on these properties e.g. usability, rigor, transparency, scope, novelty etc. 2/

@OdedRechavi An amazing service for the community, thank you!

@OdedRechavi @HaoYin20 Fair.

@WalentekLab Please do read the work :) There's the score, but there's also the review that you can dive into (analysis of each aim, what's new, where are the gaps, and so on). Not just a journal name.

@OdedRechavi @HaoYin20 Ok, so this is really cool, and you know I’m sold on the platform, but wouldn’t stuff like this encourage late pre-prints instead of early ones?

@OdedRechavi @HaoYin20 I dunno, the more I think about it, the more I think you’re going to get a lot of pushback on this. And honestly? Probably some warranted pushback amidst the chaos.

@OdedRechavi I did but only 2 of 26 non 1% papers in Dev Biol could be seen.

@OdedRechavi Also, what does the 12/36 mean? Only 36 dev biol papers? Why can one not see the 99%? What makes papers be 1%?

@OdedRechavi

@OdedRechavi

@OdedRechavi Congratulations Oded!

@anshulkundaje I mean it’s just a one dimensional UMAP, what’s wrong with that?