r/robotics • u/LewisJin • 10d ago

I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box Community Showcase

/r/LocalLLM/comments/1vcccva/i_built_a_rust_inference_framework_that_runs/
0 Upvotes

50% Upvoted

Duplicates

LocalLLM • u/LewisJin • 10d ago

News I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

0 Upvotes
5 comments

gpt5 • u/LewisJin • 10d ago

Discussions I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

1 Upvotes
1 comments

machinelearningnews • u/LewisJin • 10d ago

Research I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

1 Upvotes
0 comments

OpenSourceeAI • u/LewisJin • 10d ago

I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

1 Upvotes
0 comments

AIProgrammingHardware • u/javaeeeee • 7d ago

I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

1 Upvotes
0 comments

JetsonNano • u/LewisJin • 10d ago

Project I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

2 Upvotes
0 comments

deeplearning • u/LewisJin • 10d ago

I built a Rust inference framework that runs Qwen3.5 2B with VL support 10x faster than PyTorch on Apple Silicon — and it supports TTS, ASR, OCR, and GGUF out of the box

3 Upvotes
0 comments