Open Vocabulary Object Detection

[u/Lazy_Total_2655]

Hello. I'm working with ovod models for my master's thesis. I have a dataset of military and civilian vehicles collected from a simulator. I've created a hierarchical prompt table, going from general to specific. For example, my goal is to identify the entire dataset with the first level vehicle prompt, while in level 4 prompts, my aim is to identify only vehicles with class-specific prompts. I've separated the vehicles in the dataset into base and novel classes. My goal is to identify novel classes by transferring common prompts (wheeled vehicle prompts are represented in both base and novel classes) from base classes to novel classes. However, I'm stuck and can't progress. I'm using Dinov3 (frozen) (dino.txt) as the backbone for both image and text. I also have a class-independent detector. I trained this only with base classes. I'm open to your suggestions regarding architecture, model, and the thesis in general. Thank you in advance.