Saw this new open-source VLM from OpenBMB and the on-device numbers caught my attention. MiniCPM-V 4.7 35B-A3B reportedly runs at: 🚀 17+ tok/s on iPad Pro M4 (16GB) 📱 13+ tok/s on iPhone 17 Pro Max 💾 ~3GB memory usage The interesting part is their new LES (Lookahead Expert Scheduling) technique for MoE models — predicting and preloading experts to reduce inference stalls (claimed up to 5× speedup with identical outputs). Other highlights: 34 multimodal benchmarks (OCR, STEM, video understanding, etc.) 90.4 OCRBench with 16× visual compression New 1B lightweight VLM for easier deployment Self-Replay Fine-Tuning for cheaper customization Support for Apple, Intel, AMD, Arm, Rockchip Feels like another step toward actually useful local multimodal AI on everyday devices . Curious how it compares with other open VLMs in real-world use. submitted by /u/ondevicedev
Originally posted by u/ondevicedev on r/ArtificialInteligence