Ollama LLaVA vision model describing the Freebsd boot screen

[NapoleonWils0n]

I just installed LLaVa vision model with ollama
and tested it with the Freebsd boot sceen

llava

🌋 LLaVA is a novel end-to-end trained large multimodal model that combines a vision encoder and Vicuna for general-purpose visual and language understanding. Updated to version 1.6.

ollama.com

pull the model

ollama pull llava:7b

i downloaded an image from this forum of the boot screen and named it freebsd.png

run the prompt

ollama run llava "describe this image: ./freebsd.png"

response

The image shows a computer screen with the title "FreeBSD" prominently displayed at the top. Below this, there is a window open with a
command prompt interface. On the command line, there is text that appears to be executing a shell script or a command related to FreeBSD.
The script includes commands such as "git pull origin master", "make && make install", and "echo 'Successfully Installed'".

In the bottom left corner of the window, there is an icon resembling a devil's head with a red tongue. This image is commonly associated
with Linux, particularly the Red Hat Enterprise Linux (RHEL) distribution, which uses the Fedora Project's logo as its mascot. The logo
includes the text "Red Hat" and the Fedora symbol.

At the bottom of the screen, there is a status bar that shows the progress of the script or command being executed. It indicates that 5 out
of 6 steps have been completed, with no errors detected.

I didnt know that Freebsd was actually Fedora and made by Red Hat

 

[LibreQuest]

This whole time I was associating that image with FreeBSD. Must have been the prominently displayed "FreeBSD" that confused me.

 

[NapoleonWils0n]

i tried LLaVa with a couple of other images

it got some stuff right in the images,
but it also just made up stuff that wasnt in the image at all

 

[drr]

I am trying to find that hidden text and symbol on my boot screen

 

[NapoleonWils0n]

its like Where's Waldo for boot screens

 

[SirDice]

On the command line, there is text that appears to be executing a shell script or a command related to FreeBSD.

I get why it would "think"[*] it's seeing this.

The script includes commands such as "git pull origin master", "make && make install", and "echo 'Successfully Installed'".

But this seems utterly random. Maybe because it's a dark background with light colored letters on it? And it made a connection to similar white on black text screens that are commonly used by developers?

In the bottom left corner of the window, there is an icon resembling a devil's head with a red tongue. This image is commonly associated
with Linux, particularly the Red Hat Enterprise Linux (RHEL) distribution, which uses the Fedora Project's logo as its mascot.

So it's clearly been trained on the RH Logo, but not FreeBSD's. It kind of looks the same, if you squint hard enough. And flip it upside down.

[*] Think? Does an AI really think? Or does it infer, deduce. What the heck does it do, really?

 

[atax1a]

What the heck does it do, really?

"produces some statistically-likely text", largely.