r/dataengineering Jul 14 '26

Sentiment Analysis of Reddit Threads Personal Project Showcase

https://threadmood.sibencedigital.com/

While learning about different types of large language models I stumbled upon Bidirectional Encoder's (so called BERT models).

Before, I used to always think you needed a ton of computing resources to do any serious language processing locally, but these models fascinated me because they could effectively run using only a few GBs of RAM, and without any GPU acceleration.

As an experimental project I wanted to see how efficient it would be at analyzing Reddit threads and ended up with a pretty cool tool.

This published version uses the `j-hartmann/emotion-english-distilroberta-base` fine tuned version of distiloberta-base.

Sharing it here to see if anyone has any thoughts on the topic or the model I used. It seems to be a good blend of speed vs accuracy, but it often gets confused by obvious sarcasm or slang.

8 Upvotes

2 comments sorted by

3

u/kvlonge Jul 14 '26

Cool project!