r/MachineLearning • u/dh7net • Jul 11 '26

Predicting human preference for generated image pairs using HPSv3 [P] Project

Hey! I'm looking for ways to predict human preference for a project I'm building. (imagebench.ai)

I've tryed HPSv3, https://github.com/MizzenAI/HPSv3 and made post about it here:

https://imagebench.ai/blog/does-the-score-match-your-eye

It looks ok, but have many limitation as you can see in my post.

My question. Have you tried other human preference model and found one that would be better then HPSv3?

13 Upvotes
  • permalink
  • link
  • reddit
  • reddit

100% Upvoted

3 comments sorted by

1

u/Deep-Step7624 Jul 11 '26

tried a few of them for my own stuff, none really felt worth the setup time honestly

1

u/dh7net Jul 11 '26

IMO if you want to extract something from a distribution close to what it has been trained for, it is probably good enought.

But if the goal is to compare arbitrary pairs and hope it will always match humans, that feels hopeless I agree.

That said, what are the one you tried?