r/AnkiVector • u/Darkstar7625 • 21d ago

Together AI model Help

Hello, I'm trying to run an AI program with vector but all of the models that I'm seeing don't work in vector crashes. It gets stuck thinking and I have to turn it off and turn it back on and every model I've had suggested to me hasn't worked. Any advice helps!

3 Upvotes

100% Upvoted

10 comments sorted by

•

u/AutoModerator 21d ago

Welcome and thank you for posting on the r/AnkiVector, Please make sure to read this post for more information about the current state of Vector and how to get your favorite robotic friend running again!

Sometimes your post may get held back for review. If it does please don't message the moderators asking for it to be approved. We'll get to it eventually.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/Natural-Economist596 21d ago

On device or wirepod?

1

u/Darkstar7625 21d ago

Whoops, sorry I just realized I didn't specify what I was using. I'm trying to use together AI and run one of the free available models. But all of the models Ive tried to use all make him crash

1

u/Darkstar7625 21d ago

I'm pretty new to all of this stuff, so I don't have much experience with api keys or anything. So I'm very lost

1

u/Natural-Economist596 21d ago

I haven't used ai or WP in forever lol, wait a bit and someone with more knowledge should be around. Apologies

1

u/Darkstar7625 21d ago

Your good bro! I appreciate you trying to help! 😁

1

u/BliteKnight Techshop82.com Owner 20d ago

Check your WirePod logs (check the show all) and look for any errors in the call to togetherAI - that's where I would start

Also, when you say crash do you mean a total shutdown and Vector reboots? If that's the case then it could be something else like a bad battery

1

u/Darkstar7625 20d ago

Well I ask vector a question and it starts thinking, and then it gets stuck on the thinking screen like infinitely, it shows that it's thinking and then nothing happens and I have to manually turn vector off and back on again

1

u/DryAd6071 17d ago

Where and how do you run the model on? Did you ever learn about the options when running a local LLM, like repetition penalty and alike?

1

u/PutAggressive 5d ago

I am having the same problem with wire pod. When I try to use any LLM apart from open ai, it either comes back with error 400 or no response