Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MNN LLM Multimodal Conversations iOS Application #3234

Merged
merged 24 commits into from
Feb 17, 2025
Merged

Conversation

Yogayu
Copy link
Contributor

@Yogayu Yogayu commented Feb 13, 2025

MNN LLM iOS Application

中文文档

Introduction

This project is an iOS application based on the MNN engine, supporting local large-model multimodal conversations.

It operates fully offline with high privacy. Once the models are downloaded to the device, all conversations occur locally without any network uploads or processing.

Features

  1. Model List

    • Browse models supported by MNN.
    • Manage models: download and delete models.
    • Search for models locally.
  2. Multimodal Chat

    • Text-to-text conversation.
    • Audio-to-text conversation.
    • Image-to-text conversation: capture images via camera or select from the gallery.
  3. Chat History

    • View conversation history, with the ability to restore previous chat sessions.

Video Introduction

image

Click here to download the original introduction video

Application Preview:

image

Additionally, the app supports edge-side usage of DeepSeek with Think mode:

image

Notes

Due to memory limitations on iPhones, it is recommended to use models with 7B parameters or fewer to avoid memory-related crashes.

@CLAassistant
Copy link

CLAassistant commented Feb 13, 2025

CLA assistant check
All committers have signed the CLA.

@@ -361,3 +361,6 @@ pymnn_build/

# mnncompress generated
MNN_compression_pb2.py
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

工程目录和 android 一样,移到 project/ios/apps/MNNLLM 里面吧

@jxt1234 jxt1234 merged commit a2da538 into alibaba:master Feb 17, 2025
1 check passed
jxt1234 added a commit that referenced this pull request Feb 17, 2025
MNN LLM Multimodal Conversations iOS Application
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants