Combining Cloud and Mobile Computing for Machine Learning

Although the computing power of mobile devices is increasing, machine learning models are also growing in size. This trend creates problems for mobile devices due to limitations like their memory capacity and battery life. While many services, like ChatGPT and Midjourney, run all the inferences in the cloud, we believe a flexible and fine-grained task distribution is more desirable. In this work, we consider model segmentation as a solution to improving the user experience, dividing the computation between mobile devices …

battery capacity chatgpt cloud computing computing power cs.ai cs.dc cs.lg devices inferences life limitations machine machine learning machine learning models memory midjourney mobile mobile computing mobile devices power services trend