LinguaLinked: Distributed Large Language Model Inference on Mobile Devices

Junchen Zhao, Yurun Song, Simeng Liu, Ian G. Harris, Sangeetha Abdu Jyothi. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations). 2024.

Topic Modeling Data Quality and Management Natural Language Processing Techniques Computer Science Linguistics

View graph Source

Paper

The full text of this publication is not hosted on 44B due to licensing.

Read it at OpenAlex

MNN-LLM: A Generic Inference Engine for Fast Large Language Model Deployment on Mobile DevicesZhaode Wang, Jingbang Yang, Xinyu Qian et al.2024 In Library

MNN-LLM: A Generic Inference Engine for Fast Large Language Model Deployment on Mobile DevicesZhaode Wang, Jingbang Yang, Xinyu Qian et al.2024 · MMAsia Workshops · 16 citations In Library

Joint Semantic Communication and Output Length Prediction for Efficient Large Language Model InferenceYanliang Jin, Juncheng She, Shengli Liu et al.2025 In Library

Model-Distributed Inference for Large Language Models at the EdgeDavide Macario, Hülya Seferoğlu, Erdem Koyuncu2025 · arXiv (Cornell University) · 6 citations In Library

Model-Distributed Inference for Large Language Models at the EdgeDavide Macario, Hülya Seferoğlu, Erdem Koyuncu2025 In Library

Large Language Models on Mobile Devices: Measurements, Analysis, and InsightsXiang Li, Zhenyan Lu, Dongqi Cai et al.2024 · EdgeFM@MobiSys · 38 citations In Library

PowerInfer-2: Fast Large Language Model Inference on a SmartphoneZhenliang Xue, Yixin Song, Zeyu Mi et al.2024 · arXiv (Cornell University) · 125 citations In Library

Distributed Inference and Fine-tuning of Large Language Models Over The InternetAlexander Borzunov, Max Ryabinin, A. Chumachenko et al.2023 · Neural Information Processing Systems · 95 citations In Library

Porting Large Language Models to Mobile Devices for Question AnsweringHannes Fassold2024 · arXiv (Cornell University) · 3 citations In Library

Patents near this paper

METHODS AND SYSTEMS FOR PROVIDING UNIVERSAL PORTABILITY IN MACHINE LEARNINGUS 9,836,450 · IDIBON, INC. · 2017 Distributed natural language understanding and processing using local data sourcesUS 9,171,066 · NUANCE COMMUNICATIONS, INC. · 2015 MODULAR APPROACH TO BUILDING LARGE LANGUAGE MODELSUS 7,774,197 · BBN TECHNOLOGIES CORP. · 2010 LANGUAGE PROCESSING RESOURCES FOR AUTOMATED MOBILE LANGUAGE TRANSLATIONUS 9,183,197 · MICROSOFT CORPORATION · 2015 ENCODING AND ADAPTIVE, SCALABLE ACCESSING OF DISTRIBUTED MODELSUS 10,089,304 · GOOGLE INC. · 2018

Source of record

OpenAlex

LinguaLinked: Distributed Large Language Model Inference on Mobile Devices

Paper

Similar papers

Patents near this paper

Welcome.

Patents near this paper