关键词： Mobile edge computing   energy harvesting   reinforcement learning   Internet of Things   computation offloading  

摘要： Internet of Things (IoT) devices can apply mobile edge computing (MEC) and energy harvesting (EH) to provide high-level experiences for computational intensive applications and concurrently to prolong the lifetime of the battery. In this paper, we propose a reinforcement learning (RL) based offloading scheme for an IoT device with EH to select the edge device and the offloading rate according to the current battery level, the previous radio transmission rate to each edge device, and the predicted amount of the harvested energy. This scheme enables the IoT device to optimize the offloading policy without knowledge of the MEC model, the energy consumption model, and the computation latency model. Further, we present a deep RL-based offloading scheme to further accelerate the learning speed. Their performance bounds in terms of the energy consumption, computation latency, and utility are provided for three typical offloading scenarios and verified via simulations for an IoT device that uses wireless power transfer for energy harvesting. Simulation results show that the proposed RL-based offloading scheme reduces the energy consumption, computation latency, and task drop rate, and thus increases the utility of the IoT device in the dynamic MEC in comparison with the benchmark offloading schemes.

关键词： Mobile edge computing   Partial offloading   NOMA   Joint uplink and downlink   Joint communication and computation resource allocation   Task scheduling  

摘要： Mobile edge computing (MEC) is a new paradigm that brings the computation capabilities closer to the edge of wireless networks. In doing so, the computation tasks of users can be offloaded to the network edge for remote executing. Since both the computing and transmission delays in uplink and downlink of each task offloading operation affect the total task execution delays, it is necessary to utilize the physical layer transmission opportunities in the task allocation algorithms. In this regard, we develop an efficient algorithm to minimize the total execution delay of users in a single-cell power-domain non-orthogonal multiple access (PD-NOMA) based MEC system with multiple users and single MEC server. Hence the computation task of each user can be partitioned into two separated parts, one for offloading to the network edge and another for locally computing. In the considered partial offloading scheme, we jointly obtain subcarrier and transmit power allocation policies for both the uplink and downlink transmissions with task scheduling and computation resource allocation at both the users and the MEC server. Numerical results demonstrate that when the communication and computation resources are jointly optimized at the task allocation algorithms, the network performance is improved nearly 30% compared to the existing joint computation and task allocation approach in which both the downlink and uplink data rates are assumed to be fixed. (C) 2018 Elsevier B.V. All rights reserved.

关键词： Mobile edge computing   computation offloading   stochastic control   Markov decision process   dynamic programming  

摘要： Due to densification of wireless networks, there exist abundance of idling computation resources at (network) edge helpers (e.g., base stations and handheld computers). These resources can be scavenged by offloading heavy computation tasks from small Internet-of-Things (IoT) devices (e.g., sensors and wearable computing devices) in proximity, thereby overcoming their limitations and lengthening their battery lives. However, unlike dedicated servers, the spare resources offered by edge helpers are random and intermittent. Thus, it is essential to intelligently control a user (IoT device) the amounts of data for offloading and local computing so as to ensure that a computation task can be finished in time-consuming minimum energy. In this paper, we design energy-efficient control policies in a computation offloading system with a random channel and a helper with a dynamically loaded CPU (due to the primary service). Specifically, the policy adopted by the helper aims at determining the sizes of offloaded and locally computed data for a given task in different slots such that the total energy consumption for transmission and local CPU is minimized under a task-deadline constraint. As the result, the polices endow an offloading user robustness against channel-and-helper randomness besides balancing offloading and local computing. By modeling the channel and helper CPU as Markov chains, the problem of offloading control is converted into a Markov decision process. Though dynamic programming (DP) for numerically solving the problem does not yield the optimal policies in closed form, we leverage the procedure to quantify the optimal policy structure and apply the result to design optimal or sub-optimal policies. For three cases ranging from zero, small to large helper buffers, the low complexity of the policies overcomes the "curse of dimensionality" in DP arising from joint consideration of channel, helper CPU, and buffer states.

关键词： Internet of Things   mobile edge computing   cloud computing   consensus problem   interactive consistency problem  

摘要： Driven by the vision of the Internet of Things (IoT), there has been a dramatic shift in mobile computing in recent years from centralized mobile cloud computing (MCC) to mobile edge computing (MEC). The main features of MECs are to promote mobile computing, network control, and storage to the edge of the network in order to achieve computationally intensive and latency-critical applications on resource-constrained mobile devices. Therefore, MEC is proposed to enable computing directly at the edge of the network, which can deliver new applications and services, especially for the IoT. In order to provide a highly flexible and reliable platform for the IoT, a MEC-based IoT platform (MIoT) is proposed in this study. Through the MIoT, the information asymmetrical symmetry between the consumer and producer can be reduced to a certain extent. Because of the IoT platform, fault tolerance is an important research topic. In order to deal with the impact of a faulty component, it is important to reach an agreement in the event of a failure before performing certain special tasks. For example, the initial time of all devices and the time stamp of all applications should be the same in a smart city before further processing. However, previous protocols for distributed computing were not sufficient for MIoT. Therefore, in this study, a new polynomial time and optimal algorithm is proposed to revisit the agreement problem. The algorithm makes all fault-free nodes decide on the same initial value with minimal rounds of message exchanges and tolerate the maximal number of allowable faulty components in the MIoT.

关键词： Computation offloading   mobile edge computing   resource allocation   stochastic optimization   vehicular networks  

摘要： The proliferation of smart vehicular terminals (VTs) and their resource hungry applications impose serious challenges to the processing capabilities of VTs and the delivery of vehicular services. Mobile Edge Computing (MEC) offers a promising paradigm to solve this problem by offloading VT applications to proximal MEC servers, while TV white space (TVWS) bands can be used to supplement the bandwidth for computation offloading. In this paper, we consider a cognitive vehicular network that uses the TVWS band, and formulate a dual-side optimization problem, to minimize the cost of VTs and that of the MEC server at the same time. Specifically, the dual-side cost minimization is achieved by jointly optimizing the offloading decision and local CPU frequency on the VT side, and the radio resource allocation and server provisioning on the server side, while guaranteeing network stability. Based on Lyapunov optimization, we design an algorithm called DDORV to tackle the joint optimization problem, where only current system states, such as channel states and traffic arrivals, are needed. The closed-form solution to the VT-side problem is obtained easily by derivation and comparing two values. For MEC server side optimization, we first obtain server provisioning independently, and then devise a continuous relaxation and Lagrangian dual decomposition based iterative algorithm for joint radio resource and power allocation. Simulation results demonstrate that DDORV converges fast, can balance the cost-delay tradeoff flexibly, and can obtain more performance gains in cost reduction as compared with existing schemes.

关键词： Mobile cloud computing   Mobile edge computing   User mobility   Synchronization   Distributed computing   Cloud-based mobile application execution  

摘要： Mobile cloud computing (MCC) and mobile edge computing (MEC) facilitate the mobile devices to augment their capabilities by utilizing the resources and services offered by Cloud and Edge Cloud, respectively. However, due to mobility, network connection becomes unstable that causes application execution disruption. Such disruption increases the execution time and in some cases restrain the mobile devices from getting execution results from the cloud. This research work analyzes the impact of user mobility on the execution of cloud-based mobile applications. We propose a Process State Synchronization (PSS)based execution management to solve the aforementioned problem. We analytically compute a sufficient condition on synchronization interval that ensure reduction in mobile application execution time under PSS in case of disconnection. Similarly, we compute the upper bound on synchronization interval whereby a larger synchronization interval did not result in significant benefits in terms of execution time for the mobile application. The analytical results were confirmed by the sample implementation of PSS with the computed synchronization intervals. Moreover, we also compare the performance of proposed solution with the state-of-the-art solutions. The results show that the PSS-based execution outperforms the other contemporary solutions. (C) 2018 Elsevier B.V. All rights reserved.

关键词： Internet of Things   edge computing   mobile edge computing   offloading algorithms   mathematical models  

摘要： Mobile devices supporting the "Internet of` Things" often have limited capabilities in computation, battery energy, and storage space, especially to support resource-intensive applications involving virtual reality, augmented reality, multimedia delivery, and artificial intelligence, which could require broad bandwidth, low response latency, and large computational power. Edge cloud or edge computing is an emerging topic and a technology that can tackle the deficiencies of the currently centralized-only cloud computing model and move the computation and storage resources closer to the devices in support of the above-mentioned applications. To make this happen, efficient coordination mechanisms and "offloading" algorithms are needed to allow mobile devices and the edge cloud to work together smoothly. In this survey article, we investigate the key issues, methods, and various state-of-the-art efforts related to the offloading problem. We adopt a new characterizing model to study the whole process of offloading from mobile devices to the edge cloud. Through comprehensive discussions, we aim to draw an overall "big picture" on the existing efforts and research directions. Our study also indicates that the offloading algorithms in the edge cloud have demonstrated profound potentials for future technology and application development.

关键词： resource allocation   wireless power transfer   mobile edge computing   Internet of Things  

摘要： Wireless devices in Internet of Things (IoT) applications, such as wireless sensors and Radio Frequency Identifications (RFIDs), are faced with challenges of heavy computation tasks and limited energy, which can be solved by the importation of mobile edge computing (MEC) and wireless power transfer (WPT) techniques. As MEC can effectively enhance computation capability, and the wireless power transfer can ensure a sustainable supply of energy, it has drawn significant research interest in IoT applications. In this paper, we will study the resource allocation problem in the wireless-powered MEC system for IoT applications with one access point (AP) and many other wireless devices, and propose a Stackelberg dynamic game model to obtain the optimal allocated resource for the nodes in the IoT environment. The AP is a wireless power source that can charge wireless devices based on wireless power transfer techniques. The AP is also integrated with a MEC server that can carry out computation tasks that offload from wireless devices. The wireless devices can use the harvested energy to execute and offload computation tasks to the AP. Based on the proposed game model, the AP and wireless devices can control their optimal transmit power for energy transfer, and computation tasks offloading to the AP, respectively. The numerical simulation results show the correctness and effectiveness of the proposed model.

关键词： Bandit convex optimization (BCO)   Internet of Things (IoT)   mobile edge computing   online learning   saddle-point method  

摘要： This paper deals with online convex optimization involving both time-varying loss functions, and time-varying constraints. The loss functions are not fully accessible to the learner, and instead only the function values (also known as bandit feedback) are revealed at queried points. The constraints are revealed after making decisions, and can be instantaneously violated, yet they must be satisfied in the long term. This setting fits nicely the emerging online network tasks such as fog computing in the Internet-of-Things, where online decisions must flexibly adapt to the changing user preferences (loss functions), and the temporally unpredictable availability of resources (constraints). Tailored for such human-in-the-loop systems where the loss functions are hard to model, a family of online bandit saddle-point (BanSaP) schemes are developed, which adaptively adjust the online operations based on (possibly multiple) bandit feedback of the loss functions, and the changing environment. Performance here is assessed by: 1) dynamic regret that generalizes the widely used static regret and 2) fit that captures the accumulated amount of constraint violations. Specifically, BanSaP is proved to simultaneously yield sublinear dynamic regret and fit, provided that the best dynamic solutions vary slowly over time. Numerical tests in fog computation offloading tasks corroborate that our proposed BanSaP approach offers competitive performance relative to existing approaches that are based on gradient feedback.

关键词： Mobile edge computing  

摘要： In this paper, we consider a mobile edge computing system that provides computing services by cloud server and edge server collaboratively. The mobile edge computing can both reduce service delay and ease the load on the core network. We model the problem of maximizing the average system revenues with the average delay constraints for different priority service as a constrained semi-Markov decision process (SMDP). We propose an actor-critic algorithm with eligibility traces to solve the constrained SMDP. We use neural networks to train the policy parameters and the state value function’s parameters to continuously improve the system performance. Copyright © 2019, The Authors. All rights reserved.