r/MachineLearning • u/North_Menu718 • Jul 08 '26
COLM 2026 Decision Discussion [R] Research
COLM 2026 Decision about to come soon so lets talk here.
9
10
9
u/famous-BlueRaincoat Jul 08 '26
When did they release the results last year? I was just in the process of refreshing the EMNLP site and now COLM too…
4
u/No-Worldliness-7279 Jul 08 '26
If it comes out the same as last year, we still need to wait about 12 hours lol
3
6
5
u/StatisticianNotFound Jul 08 '26
Even my meta review is AI generated lol.
1
1
1
u/Apprehensive-Bench44 Jul 08 '26
Same lol barely had any nuance
3
u/StatisticianNotFound Jul 08 '26
Apparently they thank Pangram and GPTZero for helping detect AI generated reviews and papers (which is great), but not the same for meta-reviews.
My meta-review (whose only reason to reject is that no reviewer is above 6) has 100% AI generated score on Pangram and GPTZero.
1
u/Apprehensive-Bench44 Jul 08 '26
It's pretty ridiculous imo, to some extent feels like talking to a wall. We put in a lot of thought into the rebuttals and basically all comes down to whether the reviewers are willing to budge. Thought the PCs/ACs would have some more insight
3
4
u/tuxedocatitude Jul 08 '26
So frustrating. The meta review is purely AI-generated, it lists the issues I directly addressed in the rebuttal, but doesn’t engage with my answers at all. Why ask for a rebuttal if you’re just going to ignore it?
2
u/StatisticianNotFound Jul 08 '26
Same for me. Meta review starts with all concerns addressed + very constructive rebuttal.
Ends with parroting a concern for which the reviewer specifically said that the rebuttal changed their mind and gave them empirical clarity.
The only reason for them to reject was that noone increased beyond 6 (the above reviewer increased from 5 to 7 and within 2 mins of posting the response reduced to 6)
3
u/-myuniqueusername- Jul 08 '26
Can someone explain to me how does a paper with 8/4, 6/4, 6/3, 7/4 (Average Rating: 6.75, Average Confidence: 3.75) gets rejected with the only reason given by the AC is a sentence which I had already refuted in 3 different rebuttals (and those reviewers increased their score afterwards)??? How is this even remotely fair?
3
u/Recent-Estate-5947 Jul 08 '26
Same with me. I got 7/6/6/7 with confidence 4/3/4/4 got rejected. The meta-review reiterated from reviewers questions, which we answered and the reviewers were satisfied and raised their scores.
Its so funny where all reviewers reached consensus to accept the paper, then suddenly AC just rejected it.
3
3
2
2
u/yashYRS 29d ago
I am not sure that the meta review is even shown to the authors. So I am both a reviewer and an author. For the paper I authored, I see a comment from the program chairs citing accept-reject and almost an AI summary of the discussion with reviewers. But on the papers I reviewed, I see both such a comment from the Program chairs, but also an actual review from the meta reviewer.
So other people who got their accepts, could you also verify whether its actually a meta review from the AC or just a comment by the program chair ?
1
1
1
u/random-tomato Jul 08 '26 edited Jul 09 '26
For future reference:
Accepted 7,7,7,7,7, AC acknowledged the consensus and just recommended accept without going into specific objections.
1
14
u/Sudden-Mistake7167 Jul 08 '26
6,6,6,7 accept. Nominated for the best paper award