Try Fuyu-8B or CogVLM. Failing that, there’s always the GPT-4V API. There are also other non-LLM solutions for image captioning / tagging (e.g. what the smartphone vendors do), but I’m less familiar with those.
back
1 comments
+1 on CogVLM.
https://github.com/THUDM/CogVLM
Recent discussions: https://github.com/ggerganov/llama.cpp/discussions/4350
It is the best open source vision language model out there that I'm aware of that's most comparable to gpt4v. Beats the pants off Llava1.5 and variants like bakllava.
There's a demo here http://36.103.203.44:7861/
i have been watching this subthread in hope that something interesting might come out of it and you just delivered. this demo is amazing. i am now dying to apply this to my photo collection.
on that note, some time ago i came across an image management tool that uses machine learning in some form. i don't have time to look for it now, but i just wanted to mention that someone is working on something like that.