Embed Notice

HTML Code

<blockquote style="position: relative; padding-left: 55px;"><section><a href="https://fedi.simonwillison.net/users/simon/statuses/113712054668796382">Simon Willison (simon@fedi.simonwillison.net)'s status on Friday, 27-Dec-2024 04:22:37 JST</a><a href="https://fedi.simonwillison.net/@simon" title="simon@fedi.simonwillison.net"><img src="https://gnusocial.jp/avatar/18625-48-20221108165340.webp" width="48" height="48" alt="Simon Willison" style="position: absolute; left: 0; top: 0;">Simon Willison</a><div><a href="https://fedi.simonwillison.net/@simon/113710007106243529" rel="in-reply-to">in reply to</a></div></section><article><p>I got QvQ running on my (M2 64GB) laptop!</p><p>uv run --with 'numpy&lt;2.0' --with mlx-vlm python \<br>  -m mlx_vlm.generate \<br>    --model mlx-community/QVQ-72B-Preview-4bit \<br>    --max-tokens 10000 \<br>    --temp 0.0 \<br>    --prompt "describe this" \<br>    --image pelicans-on-bicycles-veo2.jpg</p><p><a href="https://simonwillison.net/2024/Dec/24/qvq/#with-mlx-vlm" rel="nofollow noreferrer">https://simonwillison.net/2024/Dec/24/qvq/#with-mlx-vlm</a></p></article><footer><a rel="bookmark" href="https://gnusocial.jp/conversation/4260068#notice-8325460">In conversation</a><time datetime="2024-12-27T04:22:37+09:00" title="Friday, 27-Dec-2024 04:22:37 JST">about 23 days ago</time> <span>from <span><a href="https://fedi.simonwillison.net/@simon/113712054668796382" rel="external" title="Sent from fedi.simonwillison.net via ActivityPub">fedi.simonwillison.net</a></span></span><a href="https://fedi.simonwillison.net/@simon/113712054668796382">permalink</a><h4>Attachments</h4><ol><li><label><a rel="external" href="https://gnusocial.jp/attachment/3781471">Image: ['pelicans-on-bicycles-veo2.jpg'] Prompt: &lt;|im_start|&gt;systemYou are a helpful and harmless assistant. You are Qwen developed by Alibaba. You should think step-by-step.&lt;|im_end|&gt;&lt;|im_start|&gt;userdescribe this&lt;|vision_start|&gt;&lt;|image_pad|&gt;&lt;|vision_end|&gt;&lt;|im_end|&gt;&lt;|im_start|&gt;assistantAlright, I've got this "Text to Video" tool to explore. It seems pretty advanced, allowing me to turn text descriptions into actual videos. The interface looks user-friendly, with a dark theme that's easy on the eyes. On the left side, there's a panel where I can input my text prompt. It already has an example filled in: "A pelican riding a bicycle along a coastal path overlooking a harbor."</a></label><br><a href="https://cdn.masto.host/fedisimonwillisonnet/media_attachments/files/113/712/054/445/643/600/original/29b71bc8e707b240.png" rel="external">https://cdn.masto.host/fedisimonwillisonnet/media_attachments/files/113/712/054/445/643/600/original/29b71bc8e707b240.png</a></li></ol></footer></blockquote>

Corresponding Notice

Embed this notice
Simon Willison (simon@fedi.simonwillison.net)'s status on Friday, 27-Dec-2024 04:22:37 JST Simon Willison
in reply to
I got QvQ running on my (M2 64GB) laptop!
uv run --with 'numpy<2.0' --with mlx-vlm python \
-m mlx_vlm.generate \
--model mlx-community/QVQ-72B-Preview-4bit \
--max-tokens 10000 \
--temp 0.0 \
--prompt "describe this" \
--image pelicans-on-bicycles-veo2.jpg
https://simonwillison.net/2024/Dec/24/qvq/#with-mlx-vlm
In conversationabout 23 days ago from fedi.simonwillison.netpermalink
Attachments
1. Image: ['pelicans-on-bicycles-veo2.jpg'] Prompt: <|im_start|>system You are a helpful and harmless assistant. You are Qwen developed by Alibaba. You should think step-by-step.<|im_end|> <|im_start|>user describe this<|vision_start|><|image_pad|><|vision_end|><|im_end|> <|im_start|>assistant Alright, I've got this "Text to Video" tool to explore. It seems pretty advanced, allowing me to turn text descriptions into actual videos. The interface looks user-friendly, with a dark theme that's easy on the eyes. On the left side, there's a panel where I can input my text prompt. It already has an example filled in: "A pelican riding a bicycle along a coastal path overlooking a harbor."
  https://cdn.masto.host/fedisimonwillisonnet/media_attachments/files/113/712/054/445/643/600/original/29b71bc8e707b240.png

Public

Embed Notice

HTML Code

Corresponding Notice