require re-training again to adapt to the new environment. On the other hand,
fully decentralized agents can continue the learning throughout their
deployment but need to communicate more often to reason about their joint
action. Otherwise, learning can be challenging and might diverge [310]. A
natural goal is to design adaptable methods yet communicate conservatively,
which is the main motivation behind scheduling in learned communication. Thus,
more work is needed to address the question of adaptable and communication-
cognizant MARL.

####  VII-D5 MARL under networking constraints

Several communication characteristics have not been investigated under the MDP
and POMG settings. For example, while delay, noise, failure, and time-varying
topologies are vital factors in today’s practical networks, they were not
considered in most of MARL papers. These factors were, however, considered in
other optimization frameworks like multi-agent (distributed) convex
optimization [311]. Some of the works surveyed here started to study bandwidth
and multiple-access aspects [273, 276]. Yet, it is important to study the
performance of emerging policies of MARL under realistic networking
constraints.

##  VIII Conclusion

Recently, AI and pervasive computing have drawn the attention of academia and
industrial verticals, as their confluence has proved a high efficiency to
enhance human’s productivity and lifestyle. Particularly, the computing
capacities offered by the massive number of ubiquitous devices open up an
attractive opportunity to fuel the continuously advancing and pervasive IoT
services, transforming all aspects of our modern life. In this survey, we
presented a comprehensive review of the resource allocation and communication
challenges of pervasive AI systems, enabling to support a plethora of latency-
sensitive applications. More specifically, we first presented the fundamentals
of AI networks, applications and performance metrics, and the taxonomy of
pervasive computing and its intersection with AI. Then, we summarized the
resource management algorithms for the distributed inference, training, and
online learning. In this context, partitioning strategies, architectures, and
communication issues and solutions were extensively reviewed. Additionally,
relevant use cases were described and futuristic applications were discussed.

Multiple challenges remain to be addressed, to further improve the
performance, as well as the resource management, privacy, and avant-garde
applications. Therefore, we presented our vision of technical challenges and
directions that may emerge in the future, along with some opportunities for
innovation. We hope that this survey will elicit fruitful discussion and
inspire new promising ideas.

## Acknowledgment

This work was made possible by NPRP grant # NPRP12S-0305-190231 from the Qatar
National Research Fund (a member of Qatar Foundation). The findings achieved
herein are solely the responsibility of the authors.

## References

  * [1] M. Luong, H. Pham, and C. D. Manning, “Effective approaches to attention-based neural machine translation,” _CoRR_ , vol. abs/1508.04025, 2015.
  * [2] A. Y. Hannun, C. Case, J. Casper, B. Catanzaro, G. Diamos, E. Elsen, R. Prenger, S. Satheesh, S. Sengupta, A. Coates, and A. Y. Ng, “Deep speech: Scaling up end-to-end speech recognition,” _CoRR_ , vol. abs/1412.5567, 2014\.
  * [3] K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in _Proceedings of the IEEE conference on computer vision and pattern recognition_ , 2016, pp. 770–778.
  * [4] A. I. Chen, M. L. Balter, T. J. Maguire, and M. L. Yarmush, “Deep learning robotic guidance for autonomous vascular access,” _Nature Machine Intelligence_ , vol. abs/1811.03604, p. 104–115, 2020.
  * [5] J. Bughin and J. Seong, _Assessing the economic impact of artificial intelligence_. ITUTrends Issue Paper, 2018, vol. 1.
  * [6] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in _Proceedings of the IEEE conference on computer vision and pattern recognition_ , 2016, pp. 2818–2826.
  * [7] K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” 2015.
  * [8] _Prepare to succeed with the Internet of Things_. Cisco white paper, 2017. [Online]. Available: http://docs.media.bitpipe.com/io_13x/io_138814/item_1588083/Prepare%20to%20Succeed%20with%20the%20IoT.pdf
  * [9] M. Mohammadi, A. Al-Fuqaha, S. Sorour, and M. Guizani, “Deep learning for iot big data and streaming analytics: A survey,” _IEEE Communications Surveys & Tutorials_, vol. 20, no. 4, pp. 2923–2960, 2018.
  * [10] M. K. Abdel-Aziz, C. Liu, S. Samarakoon, M. Bennis, and W. Saad, “Ultra-reliable low-latency vehicular networks: Taming the age of information tail,” _CoRR_ , vol. abs/1811.03981, 2018.
  * [11] S.-C. Lin, Y. Zhang, C.-H. Hsu, M. Skach, M. E. Haque, L. Tang, and J. Mars, “The architectural implications of autonomous driving: Constraints and acceleration,” _SIGPLAN Not._ , vol. 53, no. 2, p. 751–766, 2018.
  * [12] J. Park and M. Bennis, “Urllc-embb slicing to support vr multimodal perceptions over wireless cellular systems,” in _2018 IEEE Global Communications Conference (GLOBECOM)_ , 2018, pp. 1–7.
  * [13] A. Fotouhi, H. Qiang, M. Ding, M. Hassan, L. G. Giordano, A. Garcia-Rodriguez, and J. Yuan, “Survey on uav cellular communications: Practical aspects, standardization advancements, regulation, and security challenges,” _IEEE Communications Surveys & Tutorials_, vol. 21, no. 4, pp. 3417–3442, 2019.
  * [14] M. Satyanarayanan, “The emergence of edge computing,” _Computer_ , vol. 50, no. 1, pp. 30–39, 2017.
  * [15] D. Swinhoe, _The 15 biggest data breaches of the 21st century_. CSO, 2021. [Online]. Available: https://www.csoonline.com/article/2130877/the-biggest-data-breaches-of-the-21st-century.html
  * [16] A. Barredo Arrieta, N. Díaz-Rodríguez, J. Del Ser, A. Bennetot, S. Tabik, A. Barbado, S. Garcia, S. Gil-Lopez, D. Molina, R. Benjamins, R. Chatila, and F. Herrera, “Explainable artificial intelligence (xai): Concepts, taxonomies, opportunities and challenges toward responsible ai,” _Information Fusion_ , vol. 58, pp. 82–115, 2020.
  * [17] A. A. Abdellatif, A. Mohamed, C. F. Chiasserini, M. Tlili, and A. Erbad, “Edge computing for smart health: Context-aware approaches, opportunities, and challenges,” _IEEE Network_ , vol. 33, no. 3, pp. 196–203, 2019.
  * [18] A. A. Abdellatif, A. Mohamed, C. F. Chiasserini, A. Erbad, and M. Guizani, “Edge computing for energy-efficient smart health systems: Data and application-specific approaches,” in _Energy Efficiency of Medical Devices and Healthcare Applications_. Elsevier, 2020, pp. 53–67.
  * [19] F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, “Squeezenet: Alexnet-level accuracy with 50x fewer parameters and ¡0.5mb model size,” 2016.
  * [20] A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” _CoRR_ , vol. abs/1704.04861, 2017\.
  * [21] G. cloud. Edge tpu. [Online]. Available: https://cloud.google.com/edge-tpu
  * [22] A. Logvinenko. (2018) Apple a12 bionic processor running ml algorithms 9 times faster — a myth or reality? [Online]. Available: https://cloud.google.com/edge-tpu
  * [23] A. Hard, K. Rao, R. Mathews, F. Beaufays, S. Augenstein, H. Eichner, C. Kiddon, and D. Ramage, “Federated learning for mobile keyboard prediction,” _CoRR_ , vol. abs/1811.03604, 2018.
  * [24] M. McClellan, C. Cervelló-Pastor, and S. Sallent, “Deep learning at the mobile edge: Opportunities for 5g networks,” _Applied Sciences_ , vol. 10, no. 14, p. 4735, 2020.
  * [25] D. C. Nguyen, P. Cheng, M. Ding, D. Lopez-Perez, P. N. Pathirana, J. Li, A. Seneviratne, Y. Li, and H. V. Poor, “Enabling ai in future wireless networks: A data life cycle perspective,” _IEEE Communications Surveys Tutorials_ , vol. 23, no. 1, pp. 553–595, 2021.
  * [26] A. Marchisio, M. A. Hanif, F. Khalid, G. Plastiras, C. Kyrkou, T. Theocharides, and M. Shafique, “Deep learning for edge computing: Current trends, cross-layer optimizations, and open research challenges,” in _2019 IEEE Computer Society Annual Symposium on VLSI (ISVLSI)_. IEEE, 2019, pp. 553–559.
  * [27] X. Wang, Y. Han, V. C. Leung, D. Niyato, X. Yan, and X. Chen, “Convergence of edge computing and deep learning: A comprehensive survey,” _IEEE Communications Surveys & Tutorials_, vol. 22, no. 2, pp. 869–904, 2020.
  * [28] J. Chen and X. Ran, “Deep learning with edge computing: A review.” _Proceedings of the IEEE_ , vol. 107, no. 8, pp. 1655–1674, 2019.
  * [29] Z. Zhou, X. Chen, E. Li, L. Zeng, K. Luo, and J. Zhang, “Edge intelligence: Paving the last mile of artificial intelligence with edge computing,” _Proceedings of the IEEE_ , vol. 107, no. 8, pp. 1738–1762, 2019.
  * [30] M. G. S. Murshed, C. Murphy, D. Hou, N. Khan, G. Ananthanarayanan, and F. Hussain, “Machine learning at the network edge: A survey,” _arXiv preprint arXiv:1908.00080_ , 2020.
  * [31] S. Deng, H. Zhao, W. Fang, J. Yin, S. Dustdar, and A. Y. Zomaya, “Edge intelligence: the confluence of edge computing and artificial intelligence,” _IEEE Internet of Things Journal_ , vol. 7, no. 8, pp. 7457–7469, 2020.
  * [32] S. Voghoei, N. H. Tonekaboni, J. G. Wallace, and H. R. Arabnia, “Deep learning at the edge,” in _2018 International Conference on Computational Science and Computational Intelligence (CSCI)_. IEEE, 2018, pp. 895–901.
  * [33] T. T. Nguyen, N. D. Nguyen, and S. Nahavandi, “Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications,” _IEEE transactions on cybernetics_ , vol. 50, no. 9, pp. 3826–3839, 2020\.
  * [34] Y. Rizk, M. Awad, and E. W. Tunstel, “Decision making in multiagent systems: A survey,” _IEEE Transactions on Cognitive and Developmental Systems_ , vol. 10, no. 3, pp. 514–529, 2018.
  * [35] D. Lee, N. He, P. Kamalaruban, and V. Cevher, “Optimization for reinforcement learning: From a single agent to cooperative agents,” _IEEE Signal Processing Magazine_ , vol. 37, no. 3, pp. 123–135, 2020.
  * [36] L. Lei, Y. Tan, K. Zheng, S. Liu, K. Zhang, and X. Shen, “Deep reinforcement learning for autonomous internet of things: Model, applications and challenges,” _IEEE Communications Surveys & Tutorials_, vol. 22, no. 3, pp. 1722–1760, 2020.
  * [37] A. Feriani and E. Hossain, “Single and multi-agent deep reinforcement learning for ai-enabled wireless networks: A tutorial,” _arXiv preprint arXiv:2011.03615_ , 2020.
  * [38] J. Park, S. Samarakoon, M. Bennis, and m. Debbah, “Wireless network intelligence at the edge,” _Proceedings of the IEEE_ , vol. 107, 09 2019\.
  * [39] Y. Shi, K. Yang, T. Jiang, J. Zhang, and K. B. Letaief, “Communication-efficient edge ai: Algorithms and systems,” _IEEE Communications Surveys & Tutorials_, vol. 22, no. 4, pp. 2167–2191, 2020.
  * [40] C. Zhang, P. Patras, and H. Haddadi, “Deep learning in mobile and wireless networking: A survey,” _IEEE Communications surveys & tutorials_, vol. 21, no. 3, pp. 2224–2287, 2019.
  * [41] M. Aledhari, R. Razzak, R. M. Parizi, and F. Saeed, “Federated learning: A survey on enabling technologies, protocols, and applications,” _IEEE Access_ , vol. 8, pp. 140 699–140 725, 2020.
  * [42] S. A. Rahman, H. Tout, H. Ould-Slimane, A. Mourad, C. Talhi, and M. Guizani, “A survey on federated learning: The journey from centralized to distributed on-site learning and beyond,” _IEEE Internet of Things Journal_ , 2020.
  * [43] L. U. Khan, W. Saad, Z. Han, E. Hossain, and C. S. Hong, “Federated learning for internet of things: Recent advances, taxonomy, and open challenges,” _arXiv preprint arXiv:2009.13012_ , 2020.
  * [44] W. Y. B. Lim, N. C. Luong, D. T. Hoang, Y. Jiao, Y.-C. Liang, Q. Yang, D. Niyato, and C. Miao, “Federated learning in mobile edge networks: A comprehensive survey,” _IEEE Communications Surveys & Tutorials_, vol. 22, no. 3, pp. 2031–2063, 2020.
  * [45] Z. Du, C. Wu, T. Yoshinaga, K.-L. A. Yau, Y. Ji, and J. Li, “Federated learning for vehicular internet of things: Recent advances and open issues,” _IEEE Open Journal of the Computer Society_ , vol. 1, pp. 45–61, 2020.
  * [46] E. Nieuwdorp, “The pervasive discourse: an analysis,” _Computers in Entertainment (CIE)_ , vol. 5, no. 2, p. 13, 2007.
  * [47] F. Colace, M. De Santo, V. Moscato, A. Picariello, F. A. Schreiber, and L. Tanca, _Pervasive Systems Architecture and the Main Related Technologies_. Springer International Publishing, 2015, pp. 19–42.
  * [48] E. Baccour, S. Foufou, R. Hamila, and Z. Tari, “Achieving energy efficiency in data centers with a performance-guaranteed power aware routing,” _Computer Communications_ , vol. 109, pp. 131–145, 2017.
  * [49] F. Haouari, E. Baccour, A. Erbad, A. Mohamed, and M. Guizani, “Qoe-aware resource allocation for crowdsourced live streaming: A machine learning approach,” in _ICC 2019 - 2019 IEEE International Conference on Communications (ICC)_ , 2019, pp. 1–6.
  * [50] E. Baccour, A. Erbad, A. Mohamed, F. Haouari, M. Guizani, and M. Hamdi, “Rl-opra: Reinforcement learning for online and proactive resource allocation of crowdsourced live videos,” _Future Generation Computer Systems_ , vol. 112, pp. 982–995, 2020.
  * [51] E. Baccour, S. Foufou, and R. Hamila, “Ptnet: A parameterizable data center network,” in _2016 IEEE Wireless Communications and Networking Conference_ , 2016, pp. 1–6.
  * [52] F. Haouari, E. Baccour, A. Erbad, A. Mohamed, and M. Guizani, “Transcoding resources forecasting and reservation for crowdsourced live streaming,” in _2019 IEEE Global Communications Conference (GLOBECOM)_ , 2019, pp. 1–7.
  * [53] E. Baccour, A. Erbad, A. Mohamed, and M. Guizani, “Ce-d2d: Dual framework chunks caching and offloading in collaborative edge networks with d2d communication,” in _2019 15th International Wireless Communications Mobile Computing Conference (IWCMC)_ , 2019, pp. 1550–1556.
  * [54] E. Baccour, A. Erbad, A. Mohamed, M. Guizani, and M. Hamdi, “Collaborative hierarchical caching and transcoding in edge network with ce-d2d communication,” _Journal of Network and Computer Applications_ , vol. 172, p. 102801, 2020.
  * [55] ——, “Ce-d2d: Collaborative and popularity-aware proactive chunks caching in edge networks,” in _2020 International Wireless Communications and Mobile Computing (IWCMC)_ , 2020, pp. 1770–1776.
  * [56] M. Satyanarayanan, P. Bahl, R. Caceres, and N. Davies, “The case for vm-based cloudlets in mobile computing,” _IEEE Pervasive Computing_ , vol. 8, no. 4, pp. 14–23, 2009.
  * [57] M. Aazam and E. Huh, “Fog computing micro datacenter based dynamic resource estimation and pricing model for iot,” in _2015 IEEE 29th International Conference on Advanced Information Networking and Applications_ , 2015, pp. 687–694.
  * [58] K. Bilal, O. Khalid, A. Erbad, and S. U. Khan, “Potentials, trends, and prospects in edge technologies: Fog, cloudlet, mobile edge, and micro data centers,” _Computer Networks_ , vol. 130, pp. 94–120, 2018.
  * [59] Y. Roh, G. Heo, and S. E. Whang, “A survey on data collection for machine learning: A big data - ai integration perspective,” _IEEE Transactions on Knowledge and Data Engineering_ , vol. 33, no. 4, pp. 1328–1347, 2021.
  * [60] I. Goodfellow, Y. Bengio, A. Courville, and Y. Bengio, _Deep learning_. MIT press Cambridge, 2016, vol. 1, no. 2.
  * [61] L. Bottou, “Large-scale machine learning with stochastic gradient descent,” in _Proceedings of COMPSTAT’2010_. Springer, 2010, pp. 177–186.
  * [62] D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” 2017.
  * [63] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein _et al._ , “Imagenet large scale visual recognition challenge,” _International journal of computer vision_ , vol. 115, no. 3, pp. 211–252, 2015.
  * [64] A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” _Advances in neural information processing systems_ , vol. 25, pp. 1097–1105, 2012.
  * [65] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” 2014.
  * [66] C. Szegedy, S. Ioffe, V. Vanhoucke, and A. Alemi, “Inception-v4, inception-resnet and the impact of residual connections on learning,” 2016.
  * [67] J. Mao, X. Chen, K. W. Nixon, C. Krieger, and Y. Chen, “Modnn: Local distributed mobile computing system for deep neural network,” in _Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017_. IEEE, 2017, pp. 1396–1401.
  * [68] S. Hochreiter and J. Schmidhuber, “Long short-term memory,” _Neural computation_ , vol. 9, no. 8, pp. 1735–1780, 1997.
  * [69] S. Xie, A. Kirillov, R. Girshick, and K. He, “Exploring randomly wired neural networks for image recognition,” 2019.
  * [70] A. Khan, A. Sohail, U. Zahoora, and A. S. Qureshi, “A survey of the recent architectures of deep convolutional neural networks.” _Artificial Intelligence Review_ , vol. 53, p. 5455–5516, 2020.
  * [71] S. H. Hasanpour, M. Rouhani, M. Fayyaz, and M. Sabokrou, “Lets keep it simple, using simple architectures to outperform deeper and more complex architectures,” 2018.
  * [72] D. Rumelhart, G. Hinton, and R. Williams, “Learning representations by back-propagating errors.” _Nature_ , vol. 323, pp. 533–536, 1986.
  * [73] G. E. Hinton and R. R. Salakhutdinov, “Reducing the dimensionality of data with neural networks,” _Science_ , vol. 313, no. 5786, pp. 504–507, 2006\.
  * [74] I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative adversarial networks,” 2014.
  * [75] A. Slivkins, “Introduction to Multi-Armed Bandits,” _Foundations and Trends® in Machine Learning_ , vol. 12, no. 1-2, pp. 1–286, 2019. [Online]. Available: http://dx.doi.org/10.1561/2200000068
  * [76] V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, “Playing atari with deep reinforcement learning,” 2013.
  * [77] M. S. Allahham, A. A. Abdellatif, A. Mohamed, A. Erbad, E. Yaacoub, and M. Guizani, “I-see: Intelligent, secure and energy-efficient techniques for medical data transmission using deep reinforcement learning,” _IEEE Internet of Things Journal_ , pp. 1–1, 2020.
  * [78] D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot _et al._ , “Mastering the game of go with deep neural networks and tree search,” _nature_ , vol. 529, no. 7587, pp. 484–489, 2016.
  * [79] V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski _et al._ , “Human-level control through deep reinforcement learning,” _nature_ , vol. 518, no. 7540, pp. 529–533, 2015.
  * [80] J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” 2017.
  * [81] V. Mnih, A. P. Badia, M. Mirza, A. Graves, T. Lillicrap, T. Harley, D. Silver, and K. Kavukcuoglu, “Asynchronous methods for deep reinforcement learning,” in _International conference on machine learning_. PMLR, 2016, pp. 1928–1937.
  * [82] H. Van Hasselt, A. Guez, and D. Silver, “Deep reinforcement learning with double q-learning,” in _Proceedings of the AAAI Conference on Artificial Intelligence_ , vol. 30, no. 1, 2016.
  * [83] Z. Wang, T. Schaul, M. Hessel, H. Hasselt, M. Lanctot, and N. Freitas, “Dueling network architectures for deep reinforcement learning,” in _International conference on machine learning_. PMLR, 2016, pp. 1995–2003.
  * [84] T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” _arXiv preprint arXiv:1509.02971_ , 2015.
  * [85] S. Han, J. Pool, J. Tran, and W. Dally, “Learning both weights and connections for efficient neural network,” in _Advances in Neural Information Processing Systems_ , C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett, Eds., vol. 28. Curran Associates, Inc., 2015. [Online]. Available: https://proceedings.neurips.cc/paper/2015/file/ae0eb3eed39d2bcef4622b2499a05fe6-Paper.pdf
  * [86] M. Courbariaux, Y. Bengio, and J.-P. David, “Binaryconnect: Training deep neural networks with binary weights during propagations,” in _Advances in Neural Information Processing Systems_ , C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett, Eds., vol. 28. Curran Associates, Inc., 2015. [Online]. Available: https://proceedings.neurips.cc/paper/2015/file/3e15cc11f979ed25912dff5b0669f2cd-Paper.pdf
  * [87] N. Papernot, P. McDaniel, I. Goodfellow, S. Jha, Z. B. Celik, and A. Swami, “Practical black-box attacks against machine learning,” in _Proceedings of the 2017 ACM on Asia conference on computer and communications security_ , 2017, pp. 506–519.
  * [88] Z. He, T. Zhang, and R. B. Lee, “Model inversion attacks against collaborative inference,” in _Proceedings of the 35th Annual Computer Security Applications Conference_. New York, NY, USA: Association for Computing Machinery, 2019, p. 148–162. [Online]. Available: https://doi.org/10.1145/3359789.3359824
  * [89] V. Tolpegin, S. Truex, M. E. Gursoy, and L. Liu, “Data poisoning attacks against federated learning systems,” in _European Symposium on Research in Computer Security_. Springer, 2020, pp. 480–501.
  * [90] R. Shokri, M. Stronati, C. Song, and V. Shmatikov, “Membership inference attacks against machine learning models,” in _2017 IEEE Symposium on Security and Privacy (SP)_. IEEE, 2017, pp. 3–18.
  * [91] K. Eykholt, I. Evtimov, E. Fernandes, B. Li, A. Rahmati, C. Xiao, A. Prakash, T. Kohno, and D. Song, “Robust physical-world attacks on deep learning visual classification,” in _Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition_ , 2018, pp. 1625–1634.
  * [92] “Autonomio Talos [Computer software] ,” http://github.com/autonomio/talos, 2019, [Online; Available].
  * [93] M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viégas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, and X. Zheng, “TensorFlow: Large-scale machine learning on heterogeneous systems,” 2015, software available from tensorflow.org.
  * [94] “Tensorflowlite,” https://www.tensorflow.org/lite, 2021, [Online; Available].
  * [95] “Caffe3,” https://caffe2.ai/, 2021, [Online; Available].
  * [96] “Pytorch,” https://pytorch.org, 2021, [Online; Available].
  * [97] “Core ML,” https://developer.apple.com/documentation/coreml, 2021, [Online; Available].
  * [98] A. Tveit, T. Morland, and T. B. Røst, “Deeplearningkit - an gpu optimized deep learning framework for apple’s ios, os x and tvos developed in metal and swift,” 2016.
  * [99] “Jetson Nano Developer Kit,” https://developer.nvidia.com/embedded/jetson-nano-developer-kit, 2021, [Online; Available].
  * [100] S. Yao, Y. Zhao, A. Zhang, L. Su, and T. Abdelzaher, “Deepiot: Compressing deep neural network structures for sensing systems with a compressor-critic framework,” in _Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems_ , 2017, pp. 1–14.
  * [101] X. Wang, Y. Ma, Y. Wang, W. Jin, X. Wang, J. Tang, C. Jia, and J. Yu, “Traffic flow prediction via spatial temporal graph neural network,” in _Proceedings of The Web Conference 2020_ , 2020, pp. 1082–1092.
  * [102] X. Ma, H. Yu, Y. Wang, and Y. Wang, “Large-scale transportation network congestion evolution prediction using deep learning theory,” _PloS one_ , vol. 10, no. 3, p. e0119044, 2015.
  * [103] A. B. Said and A. Erradi, “Spatiotemporal tensor completion for improved urban traffic imputation,” _IEEE Transactions on Intelligent Transportation Systems_ , pp. 1–14, 2021.
  * [104] A. Ben Said and A. Erradi, “A probabilistic approach for maximizing travel journey wifi coverage using mobile crowdsourced services,” _IEEE Access_ , vol. 7, pp. 82 297–82 307, 2019.
  * [105] M. Bojarski, D. D. Testa, D. Dworakowski, B. Firner, B. Flepp, P. Goyal, L. D. Jackel, M. Monfort, U. Muller, J. Zhang, X. Zhang, J. Zhao, and K. Zieba, “End to end learning for self-driving cars,” 2016.
  * [106] D. Cireşan, U. Meier, J. Masci, and J. Schmidhuber, “Multi-column deep neural network for traffic sign classification,” _Neural Networks_ , vol. 32, pp. 333–338, 2012. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0893608012000524
  * [107] T. Zhang, G. Kahn, S. Levine, and P. Abbeel, “Learning deep control policies for autonomous aerial vehicles with mpc-guided policy search,” in _2016 IEEE international conference on robotics and automation (ICRA)_. IEEE, 2016, pp. 528–535.
  * [108] Y. Zhu, R. Mottaghi, E. Kolve, J. J. Lim, A. Gupta, L. Fei-Fei, and A. Farhadi, “Target-driven visual navigation in indoor scenes using deep reinforcement learning,” in _2017 IEEE international conference on robotics and automation (ICRA)_. IEEE, 2017, pp. 3357–3364.
  * [109] “Prime-air,” https://www.amazon.com/Amazon-Prime-Air/b?ie=UTF8&node=8037720011, 2021, [Online; Available].
  * [110] “Uber self-driving cars,” https://www.cnbc.com/2020/01/28/ubers-self-driving-cars-are-a-key-to-its-path-to-profitability.html, 2020, [Online; Available].
  * [111] “Smart delivery robots,” https://www.wallexbot.com/, 2021, [Online; Available].
  * [112] Z. Jiao, Y. Zhang, J. Xin, L. Mu, Y. Yi, H. Liu, and D. Liu, “A deep learning based forest fire detection approach using uav and yolov3,” in _2019 1st International Conference on Industrial Artificial Intelligence (IAI)_. IEEE, 2019, pp. 1–5.
  * [113] “Amazon Alexa,” https://en.wikipedia.org/wiki/Amazon_Alexa, 2021, [Online; Available].
  * [114] “Apple Siri,” https://www.apple.com/siri/, 2021, [Online; Available].
  * [115] “Microsoft Cortana,” https://www.microsoft.com/en-us/cortana, 2021, [Online; Available].
  * [116] “Microsoft and Liebherr work together on new generation of smart refrigerators,” https://blog.liebherr.com/appliances/in/microsoft-and-liebherr-work-together-on-new-generation-of-smart-refrigerators/, 2021, [Online; Available].
  * [117] O. Adedeji and Z. Wang, “Intelligent waste classification system using deep learning convolutional neural network,” _Procedia Manufacturing_ , vol. 35, pp. 607–612, 2019.
  * [118] F. Harrou, A. Dairi, Y. Sun, and F. Kadri, “Detecting abnormal ozone measurements with a deep learning-based strategy,” _IEEE Sensors Journal_ , vol. 18, no. 17, pp. 7222–7232, 2018.
  * [119] D. Zhang, X. Han, and C. Deng, “Review on the research and practice of deep learning and reinforcement learning in smart grids,” _CSEE Journal of Power and Energy Systems_ , vol. 4, no. 3, pp. 362–370, 2018.
  * [120] C. Lin, J. Lu, G. Wang, and J. Zhou, “Graininess-aware deep feature learning for robust pedestrian detection,” _IEEE transactions on image processing_ , vol. 29, pp. 3820–3834, 2020.
  * [121] B. Y. Cai, R. Alvarez, M. Sit, F. Duarte, and C. Ratti, “Deep learning-based video system for accurate and real-time parking measurement,” _IEEE Internet of Things Journal_ , vol. 6, no. 5, pp. 7693–7701, 2019.
  * [122] S. Yao, S. Hu, Y. Zhao, A. Zhang, and T. Abdelzaher, “Deepsense: A unified deep learning framework for time-series mobile sensing data processing,” in _Proceedings of the 26th International Conference on World Wide Web_ , 2017, pp. 351–360.
  * [123] C. Liu, Y. Cao, Y. Luo, G. Chen, V. Vokkarane, M. Yunsheng, S. Chen, and P. Hou, “A new deep learning-based food recognition system for dietary assessment on an edge computing service infrastructure,” _IEEE Transactions on Services Computing_ , vol. 11, no. 2, pp. 249–261, 2017.
  * [124] A. Emam, A. A. Abdellatif, A. Mohamed, and K. A. Harras, “Edgehealth: An energy-efficient edge-based remote mhealth monitoring system,” in _2019 IEEE Wireless Communications and Networking Conference (WCNC)_ , 2019, pp. 1–7.
  * [125] C. R. Pereira, S. A. Weber, C. Hook, G. H. Rosa, and J. P. Papa, “Deep learning-aided parkinson’s disease diagnosis from handwritten dynamics,” in _2016 29th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)_. Ieee, 2016, pp. 340–346.
  * [126] A. Ben Said, A. Mohamed, T. El-Fouly, K. Harras, and Z. Wang, “Multimodal deep learning approach for joint eeg-emg data compression and classification,” in _2017 IEEE wireless communications and networking conference (WCNC)_ , 03 2017, pp. 1–6.
  * [127] M. Elgendi, A. Mohamed, and R. Ward, “Efficient ecg compression and qrs detection for e-health applications,” _Scientific reports_ , vol. 7, no. 1, pp. 1–16, 2017.
  * [128] L. Rachakonda, S. P. Mohanty, E. Kougianos, and P. Sundaravadivel, “Stress-lysis: a dnn-integrated edge device for stress level detection in the iomt,” _IEEE Transactions on Consumer Electronics_ , vol. 65, no. 4, pp. 474–483, 2019.
  * [129] A. Clemm, M. T. Vega, H. K. Ravuri, T. Wauters, and F. De Turck, “Toward truly immersive holographic-type communication: Challenges and solutions,” _IEEE Communications Magazine_ , vol. 58, no. 1, pp. 93–99, 2020.
  * [130] S. LaValle, _Virtual reality_. Cambridge University Press, 2017.
  * [131] Y. Wei, F. R. Yu, M. Song, and Z. Han, “Joint optimization of caching, computing, and radio resources for fog-enabled iot using natural actor–critic deep reinforcement learning,” _IEEE Internet of Things Journal_ , vol. 6, no. 2, pp. 2061–2073, 2018.
  * [132] L. Huang, X. Feng, C. Zhang, L. Qian, and Y. Wu, “Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing,” _Digital Communications and Networks_ , vol. 5, no. 1, pp. 10–17, 2019.
  * [133] R. Wang, M. Li, L. Peng, Y. Hu, M. M. Hassan, and A. Alelaiwi, “Cognitive multi-agent empowering mobile edge computing for resource caching and collaboration,” _Future Generation Computer Systems_ , vol. 102, pp. 66–74, 2020.
  * [134] E. Ahvar, A.-C. Orgerie, and A. Lebre, “Estimating energy consumption of cloud, fog and edge computing infrastructures,” _IEEE Transactions on Sustainable Computing_ , 2019.
  * [135] L. Xiao, X. Wan, C. Dai, X. Du, X. Chen, and M. Guizani, “Security in mobile edge caching with reinforcement learning,” _IEEE Wireless Communications_ , vol. 25, no. 3, pp. 116–122, 2018.
  * [136] S. Gupta, A. Agrawal, K. Gopalakrishnan, and P. Narayanan, “Deep learning with limited numerical precision,” in _International conference on machine learning_. PMLR, 2015, pp. 1737–1746.
  * [137] R. Hadidi, J. Cao, M. Woodward, M. S. Ryoo, and H. Kim, “Distributed perception by collaborative robots,” _IEEE Robotics and Automation Letters_ , vol. 3, no. 4, pp. 3709–3716, 2018.
  * [138] Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, “A survey on mobile edge computing: The communication perspective,” _IEEE Communications Surveys & Tutorials_, vol. 19, no. 4, pp. 2322–2358, 2017.
  * [139] S. Disabato, M. Roveri, and C. Alippi, “Distributed deep convolutional neural networks for the internet-of-things,” 2019.
  * [140] Z. Xu, L. Zhao, W. Liang, O. F. Rana, P. Zhou, Q. Xia, W. Xu, and G. Wu, “Energy-aware inference offloading for dnn-driven applications in mobile edge clouds,” _IEEE Transactions on Parallel and Distributed Systems_ , vol. 32, no. 4, pp. 799–814, 2020.
  * [141] C. Alippi, S. Disabato, and M. Roveri, “Moving convolutional neural networks to embedded systems: the alexnet and vgg-16 case,” in _2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)_. IEEE, 2018, pp. 212–223.
  * [142] R. Hadidi, J. Cao, M. S. Ryoo, and H. Kim, “Towards collaborative inferencing of deep neural networks on internet-of-things devices,” _IEEE Internet of Things Journal_ , vol. 7, no. 6, pp. 4950–4960, 2020.
  * [143] R. Stahl, Z. Zhao, D. Mueller-Gritschneder, A. Gerstlauer, and U. Schlichtmann, “Fully distributed deep learning inference on resource-constrained edge devices,” in _International Conference on Embedded Computer Systems_. Springer, 2019, pp. 77–90.
  * [144] Z. Zhao, K. M. Barijough, and A. Gerstlauer, “Deepthings: Distributed adaptive deep learning inference on resource-constrained iot edge clusters,” _IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems_ , vol. 37, no. 11, pp. 2348–2359, 2018.
  * [145] X. Ran, H. Chen, X. Zhu, Z. Liu, and J. Chen, “Deepdecision: A mobile deep learning framework for edge video analytics,” in _IEEE INFOCOM 2018-IEEE Conference on Computer Communications_. IEEE, 2018, pp. 1421–1429.
  * [146] X. Ran, H. Chen, Z. Liu, and J. Chen, “Delivering deep learning to mobile devices via offloading,” in _Proceedings of the Workshop on Virtual Reality and Augmented Reality Network_. New York, NY, USA: Association for Computing Machinery, 2017, p. 42–47. [Online]. Available: https://doi.org/10.1145/3097895.3097903
  * [147] S. Han, H. Shen, M. Philipose, S. Agarwal, A. Wolman, and A. Krishnamurthy, “Mcdnn: An approximation-based execution framework for deep stream processing under resource constraints,” in _Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services_ , 2016, pp. 123–136.
  * [148] “The architecture & implementation of alexnet,” https://medium.com/analytics-vidhya/the-architecture-implementation-of-alexnet-135810a3370#:~:text=The%20AlexNet%20neural%20network%20architecture,a%201000%20channel%20softmax%20layer., 2020, [Online; Available].
  * [149] Y. Kang, J. Hauswald, C. Gao, A. Rovinski, T. Mudge, J. Mars, and L. Tang, “Neurosurgeon: Collaborative intelligence between the cloud and mobile edge,” _ACM SIGARCH Computer Architecture News_ , vol. 45, no. 1, pp. 615–629, 2017.
  * [150] E. Li, Z. Zhou, and X. Chen, “Edge intelligence: On-demand deep learning model co-inference with device-edge synergy,” in _Proceedings of the 2018 Workshop on Mobile Edge Communications_ , 2018, pp. 31–36.
  * [151] S. Teerapittayanon, B. McDanel, and H.-T. Kung, “Branchynet: Fast inference via early exiting from deep neural networks,” in _2016 23rd International Conference on Pattern Recognition (ICPR)_. IEEE, 2016, pp. 2464–2469.
  * [152] L. Zeng, E. Li, Z. Zhou, and X. Chen, “Boomerang: On-demand cooperative deep neural network inference for edge intelligence on the industrial internet of things,” _IEEE Network_ , vol. 33, no. 5, pp. 96–103, 2019.
  * [153] H. Wang, G. Cai, Z. Huang, and F. Dong, “Adda: Adaptive distributed dnn inference acceleration in edge computing environment,” in _2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS)_. IEEE, 2019, pp. 438–445.
  * [154] Y. Jin, J. Xu, Y. Huan, Y. Yan, L. Zheng, and Z. Zou, “Energy-aware workload allocation for distributed deep neural networks in edge-cloud continuum,” in _2019 32nd IEEE International System-on-Chip Conference (SOCC)_. IEEE, 2019, pp. 213–217.
  * [155] J. H. Ko, T. Na, M. F. Amir, and S. Mukhopadhyay, “Edge-host partitioning of deep neural networks with feature space encoding for resource-constrained internet-of-things platforms,” in _2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS)_. IEEE, 2018, pp. 1–6.
  * [156] H. Li, C. Hu, J. Jiang, Z. Wang, Y. Wen, and W. Zhu, “Jalad: Joint accuracy-and latency-aware deep structure decoupling for edge-cloud execution,” in _2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS)_. IEEE, 2018, pp. 671–678.
  * [157] G. Li, L. Liu, X. Wang, X. Dong, P. Zhao, and X. Feng, “Auto-tuning neural network quantization framework for collaborative inference between the cloud and edge,” in _Artificial Neural Networks and Machine Learning – ICANN 2018_ , V. Kůrková, Y. Manolopoulos, B. Hammer, L. Iliadis, and I. Maglogiannis, Eds. Cham: Springer International Publishing, 2018, pp. 402–411.
  * [158] W. Shi, Y. Hou, S. Zhou, Z. Niu, Y. Zhang, and L. Geng, “Improving device-edge cooperative inference of deep learning via 2-step pruning,” _IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)_ , pp. 1–6, 2019.
  * [159] C. Hu, W. Bao, D. Wang, and F. Liu, “Dynamic adaptive dnn surgery for inference acceleration on the edge,” in _IEEE INFOCOM 2019-IEEE Conference on Computer Communications_. IEEE, 2019, pp. 1423–1431.
  * [160] E. Dahlhaus, D. Johnson, C. Papadimitriou, P. Seymour, and M. Yannakakis, “The complexity of multiterminal cuts,” _SIAM J. Comput._ , vol. 23, pp. 864–894, 1994.
  * [161] V. Polishchuk and J. Suomela, “A simple local 3-approximation algorithm for vertex cover,” _Information Processing Letters_ , vol. 109, no. 12, pp. 642–645, 2009.
  * [162] A. E. Eshratifar, M. S. Abrishami, and M. Pedram, “Jointdnn: an efficient training and inference engine for intelligent mobile cloud computing services,” _IEEE Transactions on Mobile Computing_ , 2019.
  * [163] S. Teerapittayanon, B. McDanel, and H.-T. Kung, “Distributed deep neural networks over the cloud, the edge and end devices,” in _2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS)_. IEEE, 2017, pp. 328–339.
  * [164] J.-I. Chang, J.-J. Kuo, C.-H. Lin, W.-T. Chen, and J.-P. Sheu, “Ultra-low-latency distributed deep neural network over hierarchical mobile networks,” in _2019 IEEE Global Communications Conference (GLOBECOM)_. IEEE, 2019, pp. 1–6.
  * [165] P. Ren, X. Qiao, Y. Huang, L. Liu, S. Dustdar, and J. Chen, “Edge-assisted distributed dnn collaborative computing approach for mobile web augmented reality in 5g networks,” _IEEE Network_ , vol. 34, no. 2, pp. 254–261, 2020\.
  * [166] R. Du, S. Magnusson, and C. Fischione, “The internet of things as a deep neural network,” _IEEE Communications Magazine_ , vol. 58, no. 9, pp. 20–25, 2020.
  * [167] Z. Zhang, T. Song, L. Lin, Y. Hua, X. He, Z. Xue _et al._ , “Towards ubiquitous intelligent computing: Heterogeneous distributed deep neural networks,” _IEEE Transactions on Big Data_ , 2018.
  * [168] A. Yousefpour, S. Devic, B. Q. Nguyen, A. Kreidieh, A. Liao, A. M. Bayen, and J. P. Jue, “Guardians of the deep fog: Failure-resilient dnn inference from edge to cloud,” in _Proceedings of the First International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things_ , 2019, pp. 25–31.
  * [169] T. Mohammed, C. Joe-Wong, R. Babbar, and M. Di Francesco, “Distributed inference acceleration with adaptive dnn partitioning and offloading,” in _IEEE INFOCOM 2020-IEEE Conference on Computer Communications_. IEEE, 2020, pp. 854–863.
  * [170] J. Zhou, Y. Wang, K. Ota, and M. Dong, “Aaiot: Accelerating artificial intelligence in iot systems,” _IEEE Wireless Communications Letters_ , vol. 8, no. 3, pp. 825–828, 2019.
  * [171] M. Xu, F. Qian, M. Zhu, F. Huang, S. Pushp, and X. Liu, “Deepwear: Adaptive local offloading for on-wearable deep learning,” _IEEE Transactions on Mobile Computing_ , vol. 19, no. 2, pp. 314–330, 2019.
  * [172] F. Martins Campos de Oliveira and E. Borin, “Partitioning convolutional neural networks to maximize the inference rate on constrained iot devices,” _Future Internet_ , vol. 11, no. 10, p. 209, 2019.
  * [173] H. Z., G. Y., and S. W., “Fundamentals of matching theory,” in _Matching Theory for Wireless Networks. Wireless Networks_. Springer, 2017.
  * [174] P. Ahmed, C. S. Iliopoulos, A. S. Islam, and M. S. Rahman, “The swap matching problem revisited,” _Theoretical Computer Science_ , vol. 557, pp. 34–49, 2014.
  * [175] C.-C. Hsu, C.-K. Yang, J.-J. Kuo, W.-T. Chen, and J.-P. Sheu, “Cooperative convolutional neural network deployment over mobile networks,” in _ICC 2020-2020 IEEE International Conference on Communications (ICC)_. IEEE, 2020, pp. 1–7.
  * [176] F. M. C. de Oliveira and E. Borin, “Partitioning convolutional neural networks for inference on constrained internet-of-things devices,” in _2018 30th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD)_. IEEE, 2018, pp. 266–273.
  * [177] Y. Chang, X. Huang, Z. Shao, and Y. Yang, “An efficient distributed deep learning framework for fog-based iot systems,” in _2019 IEEE Global Communications Conference (GLOBECOM)_. IEEE, 2019, pp. 1–6.
  * [178] S. Sahoo, “Grouped convolutions — convolutions in parallel,” https://towardsdatascience.com/grouped-convolutions-convolutions-in-parallel-3b8cc847e851, 2018, [Online; Available].
  * [179] R. Hadidi, J. Cao, M. Woodward, M. S. Ryoo, and H. Kim, “Musical chair: Efficient real-time recognition using collaborative iot devices,” 2018.
  * [180] ——, “Real-time image recognition using collaborative iot devices,” in _Proceedings of the 1st on Reproducible Quality-Efficient Systems Tournament on Co-designing Pareto-efficient Deep Learning_ , 2018, p. 1.
  * [181] J. Choi, Z. Hakimi, J. Sampson, and V. Narayanan, “Byzantine-tolerant inference in distributed deep intelligent system: Challenges and opportunities,” _IEEE Journal on Emerging and Selected Topics in Circuits and Systems_ , vol. 9, no. 3, pp. 509–519, 2019.
  * [182] C. Zhang, M. Dong, and K. Ota, “Accelerate deep learning in iot: Human-interaction co-inference networking system for edge,” in _2020 13th International Conference on Human System Interaction (HSI)_. IEEE, 2020, pp. 1–6.
  * [183] M. Singhal, V. Raghunathan, and A. Raghunathan, “Communication-efficient view-pooling for distributed multi-view neural networks,” in _2020 Design, Automation & Test in Europe Conference & Exhibition (DATE)_. IEEE, 2020, pp. 1390–1395.
  * [184] C. Li, S. Wang, X. Li, F. Zhao, and R. Yu, “Distributed perception and model inference with intelligent connected vehicles in smart cities,” _Ad Hoc Networks_ , vol. 103, p. 102152, 2020.
  * [185] E. Baccour, A. Erbad, A. Mohamed, M. Hamdi, and M. Guizani, “Distprivacy: Privacy-aware distributed deep neural networks in iot surveillance systems,” 2020\.
  * [186] L. Wei, B. Luo, Y. Li, Y. Liu, and Q. Xu, “I know what you see: Power side-channel attack on convolutional neural network accelerators,” in _Proceedings of the 34th Annual Computer Security Applications Conference_ , 2018, pp. 393–406.
  * [187] S. Narain, T. D. Vo-Huu, K. Block, and G. Noubir, “Inferring user routes and locations using zero-permission mobile sensors,” in _2016 IEEE Symposium on Security and Privacy (SP)_. IEEE, 2016, pp. 397–413.
  * [188] S. Yeom, I. Giacomelli, M. Fredrikson, and S. Jha, “Privacy risk in machine learning: Analyzing the connection to overfitting,” in _2018 IEEE 31st Computer Security Foundations Symposium (CSF)_. IEEE, 2018, pp. 268–282.
  * [189] I. E. Olatunji, W. Nejdl, and M. Khosla, “Membership inference attack on graph neural networks,” 2021.
  * [190] N. Z. Gong and B. Liu, “Attribute inference attacks in online social networks,” _ACM Transactions on Privacy and Security (TOPS)_ , vol. 21, no. 1, pp. 1–30, 2018.
  * [191] Y. Zhang, H. Salehinejad, J. Barfett, E. Colak, and S. Valaee, “Privacy preserving deep learning with distributed encoders,” in _2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP)_. IEEE, 2019, pp. 1–5.
  * [192] S. A. Osia, A. Shahin Shamsabadi, S. Sajadmanesh, A. Taheri, K. Katevas, H. R. Rabiee, N. D. Lane, and H. Haddadi, “A hybrid deep learning architecture for privacy-preserving mobile analytics,” _IEEE Internet of Things Journal_ , vol. 7, no. 5, pp. 4505–4518, 2020.
  * [193] J. Wang, J. Zhang, W. Bao, X. Zhu, B. Cao, and P. S. Yu, “Not just privacy: Improving performance of private deep learning in mobile cloud,” in _Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining_, 2018, pp. 2407–2416.
  * [194] F. Mireshghallah, M. Taram, P. Ramrakhyani, A. Jalali, D. Tullsen, and H. Esmaeilzadeh, “Shredder: Learning noise distributions to protect inference privacy,” in _Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems_ , ser. ASPLOS ’20. Association for Computing Machinery, 2020, p. 3–18.
  * [195] L. Lyu, J. C. Bezdek, J. Jin, and Y. Yang, “Foreseen: Towards differentially private deep inference for intelligent internet of things,” _IEEE Journal on Selected Areas in Communications_ , vol. 38, no. 10, pp. 2418–2429, 2020.
  * [196] L. Gomez, M. Wilhelm, J. Márquez, and P. Duverger, “Security for distributed deep neural networks towards data confidentiality and intellectual property protection,” 2019.
  * [197] J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, “How transferable are features in deep neural networks?” in _Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2_ , ser. NIPS’14. MIT Press, 2014, p. 3320–3328.
  * [198] S. Chopra, R. Hadsell, and Y. LeCun, “Learning a similarity metric discriminatively, with application to face verification,” in _2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05)_ , vol. 1, 2005, pp. 539–546 vol. 1.
  * [199] Z. Yang, E.-C. Chang, and Z. Liang, “Adversarial neural network inversion via auxiliary knowledge alignment,” 2019.
  * [200] S. J. Oh, B. Schiele, and M. Fritz, “Towards reverse-engineering black-box neural networks,” in _Explainable AI: Interpreting, Explaining and Visualizing Deep Learning_. Springer, 2019, pp. 121–144.
  * [201] B. Yang, X. Cao, C. Yuen, and L. Qian, “Offloading optimization in edge computing for deep learning enabled target tracking by internet-of-uavs,” _IEEE Internet of Things Journal_ , 2020.
  * [202] B. Yang, H.-H. Wu, X. Cao, X. Li, T. Kroecker, Z. Han, and L. Qian, “Intelli-eye: An uav tracking system with optimized machine learning tasks offloading,” in _IEEE INFOCOM 2019-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)_. IEEE, 2019, pp. 1–6.
  * [203] S. Chinchali, A. Sharma, J. Harrison, A. Elhafsi, D. Kang, E. Pergament, E. Cidon, S. Katti, and M. Pavone, “Network offloading policies for cloud robotics: a learning-based approach,” 2019.
  * [204] R. Hadidi, J. Cao, M. L. Merck, A. Siqueira, Q. Huang, A. Saraha, C. Jia, B. Wang, D. Lim, L. Liu, and H. Kim, “Understanding the power consumption of executing deep neural networks on a distributed robot system,” 2019.
  * [205] H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. Y. Arcas, “Communication-efficient learning of deep networks from decentralized data,” in _Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS)_ , 2017.
  * [206] J. Kang, Z. Xiong, D. Niyato, S. Xie, and J. Zhang, “Incentive mechanism for reliable federated learning: A joint optimization approach to combining reputation and contract theory,” _IEEE Internet of Things Journal_ , vol. 6, no. 6, pp. 10 700–10 714, 2019.
  * [207] T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated learning: Challenges, methods, and future directions,” _IEEE Signal Processing Magazine_ , vol. 37, no. 3, pp. 50–60, 2020.
  * [208] Y. Liu, X. Yuan, Z. Xiong, J. Kang, X. Wang, and D. Niyato, “Federated learning for 6g communications: Challenges, methods, and future directions,” _China Communications_ , vol. 17, no. 9, pp. 105–118, 2020\.
  * [209] L. U. Khan, M. Alsenwi, Z. Han, and C. S. Hong, “Self organizing federated learning over wireless networks: A socially aware clustering approach,” in _2020 International Conference on Information Networking (ICOIN)_ , 2020, pp. 453–458.
  * [210] M. Chen, Z. Yang, W. Saad, C. Yin, H. V. Poor, and S. Cui, “Performance optimization of federated learning over wireless networks,” in _2019 IEEE Global Communications Conference (GLOBECOM)_ , 2019, pp. 1–6.
  * [211] S. R. Pandey, N. H. Tran, M. Bennis, Y. K. Tun, A. Manzoor, and C. S. Hong, “A crowdsourcing framework for on-device federated learning,” _IEEE Transactions on Wireless Communications_ , vol. 19, no. 5, pp. 3241–3256, 2020\.
  * [212] Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin, and V. Chandra, “Federated Learning with Non-IID Data,” _arXiv:1806.00582 [cs, stat]_ , Jun. 2018, arXiv: 1806.00582. [Online]. Available: http://arxiv.org/abs/1806.00582
  * [213] X. Li, K. Huang, W. Yang, S. Wang, and Z. Zhang, “On the convergence of fedavg on non-IID data,” in _arXiv:1907.02189_ , 2019.
  * [214] S. Wang, T. Tuor, T. Salonidis, K. K. Leung, C. Makaya, T. He, and K. Chan, “Adaptive federated learning in resource constrained edge computing systems,” _IEEE Journal on Selected Areas in Communications_ , vol. 37, no. 6, pp. 1205–1221, 2019.
  * [215] N. H. Tran, W. Bao, A. Zomaya, M. N. H. Nguyen, and C. S. Hong, “Federated learning over wireless networks: Optimization model design and analysis,” in _IEEE INFOCOM 2019 - IEEE Conference on Computer Communications_ , 2019, pp. 1387–1395.
  * [216] T. Nishio and R. Yonetani, “Client selection for federated learning with heterogeneous resources in mobile edge,” _ICC 2019 - 2019 IEEE International Conference on Communications (ICC)_ , pp. 1–7, 2019.
  * [217] H. Wang, Z. Kaplan, D. Niu, and B. Li, “Optimizing Federated Learning on Non-IID Data with Reinforcement Learning,” in _INFOCOM_ , 2020, p. 10.
  * [218] C. Feng, Y. Wang, Z. Zhao, T. Q. S. Quek, and M. Peng, “Joint optimization of data sampling and user selection for federated learning in the mobile edge computing systems,” in _IEEE International Conference on Communications Workshops (ICC Workshops)_ , 2020, pp. 1–6.
  * [219] T. T. Vu, D. T. Ngo, H. Q. Ngo, M. N. Dao, N. H. Tran, and R. H. Middleton, “User selection approaches to mitigate the straggler effect for federated learning on cell-free massive MIMO networks,” _arXiv:2009.02031_ , 2020\. [Online]. Available: https://arxiv.org/abs/2009.02031
  * [220] A. F. Aji and K. Heafield, “Sparse communication for distributed gradient descent,” _arXiv:1704.05021_ , 2017. [Online]. Available: https://arxiv.org/abs/1704.05021
  * [221] F. Sattler, S. Wiedemann, K. R. Müller, and W. Samek, “Robust and communication-efficient federated learning from non-i.i.d. data,” _IEEE Transactions on Neural Networks and Learning Systems_ , vol. 31, no. 9, pp. 3400–3413, 2020.
  * [222] J. Mills, J. Hu, and G. Min, “Communication-efficient federated learning for wireless edge intelligence in iot,” _IEEE Internet of Things Journal_ , vol. 7, no. 7, pp. 5986–5994, 2020.
  * [223] L. Liu, J. Zhang, S. H. Song, and K. B. Letaief, “Client-edge-cloud hierarchical federated learning,” in _IEEE International Conference on Communications (ICC)_ , 2020, pp. 1–6.
  * [224] W. Wu, L. He, W. Lin, and R. Mao, “Accelerating federated learning over reliability-agnostic clients in mobile edge computing systems,” _arXiv:2007.14374 [cs, eess]_ , Jul. 2020, arXiv: 2007.14374. [Online]. Available: http://arxiv.org/abs/2007.14374
  * [225] M. Duan, D. Liu, X. Chen, R. Liu, Y. Tan, and L. Liang, “Self-balancing federated learning with global imbalanced data in mobile systems,” _IEEE Transactions on Parallel and Distributed Systems_ , vol. 32, no. 1, pp. 59–71, 2021.
  * [226] N. Mhaisen, A. Awad, A. Mohamed, A. Erbad, and M. Guizani, “Optimal user-edge assignment in hierarchical federated learning based on statistical properties and network topology constraints,” _IEEE Transactions on Network Science and Engineering_ , pp. 1–1, 2021.
  * [227] A. Krizhevsky, “Learning multiple layers of features from tiny images,” Tech. Rep., 2009.
  * [228] Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” _Proceedings of the IEEE_ , vol. 86, no. 11, pp. 2278–2324, 1998.
  * [229] P. Warden, “Speech commands: A dataset for limited-vocabulary speech recognition,” 2018.
  * [230] L. M. Candanedo, V. Feldheim, and D. Deramaix, “Data driven prediction models of energy use of appliances in a low-energy house,” _Energy and Buildings_ , vol. 140, pp. 81–97, 2017.
  * [231] H. T. Kahraman, S. Sagiroglu, and I. Colak, “The development of intuitive knowledge classifier and the modeling of domain dependent data,” _Know.-Based Syst._ , vol. 37, p. 283–295, 2013.
  * [232] H. Xiao, K. Rasul, and R. Vollgraf, “Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms,” 2017.
  * [233] T. Zeng, O. Semiari, M. Mozaffari, M. Chen, W. Saad, and M. Bennis, “Federated learning in the sky: Joint power allocation and scheduling with uav swarms,” in _ICC 2020 - 2020 IEEE International Conference on Communications (ICC)_ , 2020, pp. 1–6.
  * [234] N. I. Mowla, N. H. Tran, I. Doh, and K. Chae, “Afrl: Adaptive federated reinforcement learning for intelligent jamming defense in fanet,” _Journal of Communications and Networks_ , vol. 22, no. 3, pp. 244–258, 2020\.
  * [235] P. Oscar, P. Carlos, A. Ana, and G. James, “Crawdad dataset,” 2014. [Online]. Available: https://crawdad.org/uportorwthaachen/vanetjamming2014/20140512,https://doi.org/10.15783/C7Q306
  * [236] Y. Wang, Z. Su, N. Zhang, and A. Benslimane, “Learning in the air: Secure federated learning for uav-assisted crowdsensing,” _IEEE Transactions on Network Science and Engineering_ , pp. 1–1, 2020.
  * [237] Y. Liu, J. Nie, X. Li, S. H. Ahmed, W. Y. B. Lim, and C. Miao, “Federated learning in the sky: Aerial-ground air quality sensing framework with uav swarms,” _IEEE Internet of Things Journal_ , pp. 1–1, 2020.
  * [238] Y. Yang, Z. Bai, Z. Hu, Z. Zheng, K. Bian, and L. Song, “Aqnet: Fine-grained 3d spatio-temporal air quality monitoring by aerial-ground wsn,” in _IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)_ , 2018, pp. 1–2.
  * [239] D. Dua and C. Graff, “UCI machine learning repository,” 2017. [Online]. Available: https://archive.ics.uci.edu/ml/datasets/Airfoil+Self-Noise
  * [240] G. Cohen, S. Afshar, J. Tapson, and A. van Schaik, “Emnist: Extending mnist to handwritten letters,” in _2017 International Joint Conference on Neural Networks (IJCNN)_ , 2017, pp. 2921–2926.
  * [241] L. N. Darlow, E. J. Crowley, A. Antoniou, and A. J. Storkey, “Cinic-10 is not imagenet or cifar-10,” 2018.
  * [242] S. Wang, X. Wang, Y. Shen, B. He, X. Zhao, P. W. Cheung, J. P. Y. Cheung, K. D. Luk, and Y. Hu, “An ensemble-based densely-connected deep learning system for assessment of skeletal maturity,” _IEEE Transactions on Systems, Man, and Cybernetics: Systems_ , pp. 1–12, 2020.
  * [243] T. Lattimore and C. Szepesvári, _Bandit algorithms_. Cambridge University Press, 2020.
  * [244] V. Kanade, Z. Liu, and B. Radunovic, “Distributed non-stochastic experts,” in _Advances in Neural Information Processing Systems_ , 2012, pp. 260–268.
  * [245] E. Hillel, Z. S. Karnin, T. Koren, R. Lempel, and O. Somekh, “Distributed exploration in multi-armed bandits,” in _Advances in Neural Information Processing Systems_ , 2013, pp. 854–862.
  * [246] B. Szorenyi, R. Busa-Fekete, I. Hegedus, R. Ormandi, M. Jelasity, and B. Kegl, “Gossip-based distributed stochastic bandit algorithms,” in _Proceedings of the 30th International Conference on Machine Learning_ , ser. Proceedings of Machine Learning Research, S. Dasgupta and D. McAllester, Eds., vol. 28, no. 3. Atlanta, Georgia, USA: PMLR, 17–19 Jun 2013, pp. 19–27.
  * [247] R. K. Kolla, K. Jagannathan, and A. Gopalan, “Collaborative learning of stochastic bandits over a social network,” _IEEE/ACM Transactions on Networking_ , vol. 26, no. 4, pp. 1782–1795, 2018.
  * [248] P. Landgren, V. Srivastava, and N. E. Leonard, “Distributed cooperative decision-making in multiarmed bandits: Frequentist and Bayesian algorithms,” in _2016 IEEE 55th Conference on Decision and Control (CDC)_. IEEE, 2016, pp. 167–172.
  * [249] D. Martinez-Rubio, V. Kanade, and P. Rebeschini, “Decentralized cooperative stochastic bandits,” in _Advances in Neural Information Processing Systems_ , 2019, pp. 4529–4540.
  * [250] P.-A. Wang, A. Proutiere, K. Ariu, Y. Jedra, and A. Russo, “Optimal algorithms for multiplayer multi-armed bandits,” in _International Conference on Artificial Intelligence and Statistics_. PMLR, 2020, pp. 4120–4129.
  * [251] A. Sankararaman, A. Ganesh, and S. Shakkottai, “Social learning in multi agent multi armed bandits,” _Proc. ACM Meas. Anal. Comput. Syst._ , vol. 3, no. 3, Dec. 2019. [Online]. Available: https://doi.org/10.1145/3366701
  * [252] R. Chawla, A. Sankararaman, A. Ganesh, and S. Shakkottai, “The gossiping insert-eliminate algorithm for multi-agent bandits,” in _International Conference on Artificial Intelligence and Statistics_. PMLR, 2020, pp. 3471–3481.
  * [253] M. Agarwal, V. Aggarwal, and K. Azizzadenesheli, “Multi-agent multi-armed bandits with limited communication,” _arXiv preprint arXiv:2102.08462_ , 2021\.
  * [254] Y. Wang, J. Hu, X. Chen, and L. Wang, “Distributed bandit learning: Near-optimal regret with efficient communication,” in _International Conference on Learning Representations_ , 2019.
  * [255] S. Shahrampour, A. Rakhlin, and A. Jadbabaie, “Multi-armed bandits in multi-agent networks,” in _2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)_. IEEE, 2017, pp. 2786–2790.
  * [256] Z. Zhu, J. Zhu, J. Liu, and Y. Liu, “Federated bandit: A gossiping approach,” _Proceedings of the ACM on Measurement and Analysis of Computing Systems_ , vol. 5, no. 1, pp. 1–29, 2021.
  * [257] C. Shi and C. Shen, “Federated multi-armed bandits,” _arXiv preprint arXiv:2101.12204_ , 2021.
  * [258] C. Shi, C. Shen, and J. Yang, “Federated Multi-armed Bandits with Personalization,” in _The 24th International Conference on Artificial Intelligence and Statistics_ , Feb. 2021.
  * [259] Z. Wang, M. K. Singh, C. Zhang, L. D. Riek, and K. Chaudhuri, “Stochastic multi-player bandit learning from player-dependent feedback,” in _ICML Workshop on Real World Experiment Design and Active Learning_ , 2020.
  * [260] P. Hernandez-Leal, B. Kartal, and M. E. Taylor, “A survey and critique of multiagent deep reinforcement learning,” _Autonomous Agents and Multi-Agent Systems_ , vol. 33, no. 6, pp. 750–797, 2019.
  * [261] T. T. Nguyen, N. D. Nguyen, and S. Nahavandi, “Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications,” _IEEE Transactions on Cybernetics_ , vol. 50, no. 9, pp. 3826–3839, 2020.
  * [262] E. A. Hansen, D. S. Bernstein, and S. Zilberstein, “Dynamic programming for partially observable stochastic games,” in _AAAI_ , vol. 4, 2004, pp. 709–715.
  * [263] R. S. Sutton and A. G. Barto, _Reinforcement learning: An introduction_. MIT press, 2018.
  * [264] K. Arulkumaran, M. P. Deisenroth, M. Brundage, and A. A. Bharath, “Deep reinforcement learning: A brief survey,” _IEEE Signal Processing Magazine_ , vol. 34, no. 6, pp. 26–38, 2017.
  * [265] F. A. Oliehoek, M. T. Spaan, and N. Vlassis, “Optimal and approximate q-value functions for decentralized pomdps,” _Journal of Artificial Intelligence Research_ , vol. 32, pp. 289–353, 2008.
  * [266] P. Sunehag, G. Lever, A. Gruslys, W. M. Czarnecki, V. F. Zambaldi, M. Jaderberg, M. Lanctot, N. Sonnerat, J. Z. Leibo, K. Tuyls _et al._ , “Value-decomposition networks for cooperative multi-agent learning based on team reward,” in _AAMAS_ , 2018.
  * [267] T. Rashid, M. Samvelyan, C. Schroeder, G. Farquhar, J. Foerster, and S. Whiteson, “Qmix: Monotonic value function factorisation for deep multi-agent reinforcement learning,” in _International Conference on Machine Learning_. PMLR, 2018, pp. 4295–4304.
  * [268] K. Son, D. Kim, W. J. Kang, D. E. Hostallero, and Y. Yi, “Qtran: Learning to factorize with transformation for cooperative multi-agent reinforcement learning,” in _International Conference on Machine Learning_. PMLR, 2019, pp. 5887–5896.
  * [269] R. Lowe, Y. Wu, A. Tamar, J. Harb, P. Abbeel, and I. Mordatch, “Multi-agent actor-critic for mixed cooperative-competitive environments,” in _Proceedings of the 31st International Conference on Neural Information Processing Systems_ , 2017, pp. 6382–6393.
  * [270] J. Foerster, G. Farquhar, T. Afouras, N. Nardelli, and S. Whiteson, “Counterfactual multi-agent policy gradients,” in _Proceedings of the AAAI Conference on Artificial Intelligence_ , vol. 32, no. 1, 2018.
  * [271] S. Iqbal and F. Sha, “Actor-attention-critic for multi-agent reinforcement learning,” in _International Conference on Machine Learning_. PMLR, 2019, pp. 2961–2970.
  * [272] R. E. Wang, M. Everett, and J. P. How, “R-maddpg for partially observable environments and limited communication,” _RL4RealLife Workshop in the 36th International Conference on Machine Learning_ , 2020.
  * [273] R. Wang, X. He, R. Yu, W. Qiu, B. An, and Z. Rabinovich, “Learning Efficient Multi-agent Communication: An Information Bottleneck Approach,” in _Proceedings of the 37th International Conference on Machine Learning_ , ser. Proceedings of Machine Learning Research, H. D. III and A. Singh, Eds., vol. 119. PMLR, Jul. 2020, pp. 9908–9918.
  * [274] J. Jiang and Z. Lu, “Learning attentional communication for multi-agent cooperation,” _Advances in Neural Information Processing Systems_ , vol. 31, pp. 7254–7264, 2018.
  * [275] A. Singh, T. Jain, and S. Sukhbaatar, “Learning when to communicate at scale in multiagent cooperative and competitive tasks,” in _International Conference on Learning Representations_ , 2018.
  * [276] H. Mao, Z. Zhang, Z. Xiao, Z. Gong, and Y. Ni, “Learning Agent Communication under Limited Bandwidth by Message Pruning,” _Proceedings of the AAAI Conference on Artificial Intelligence_ , vol. 34, no. 04, pp. 5142–5149, Apr. 2020.
  * [277] S. Omidshafiei, J. Pazis, C. Amato, J. P. How, and J. Vian, “Deep decentralized multi-task multi-agent reinforcement learning under partial observability,” in _International Conference on Machine Learning_. PMLR, 2017, pp. 2681–2690.
  * [278] K. Zhang, Z. Yang, H. Liu, T. Zhang, and T. Basar, “Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents,” in _Proceedings of the 35th International Conference on Machine Learning_ , ser. Proceedings of Machine Learning Research, J. Dy and A. Krause, Eds., vol. 80. Stockholmsmässan, Stockholm Sweden: PMLR, Jul. 2018, pp. 5872–5881.
  * [279] Y. Lin, K. Zhang, Z. Yang, Z. Wang, T. Başar, R. Sandhu, and J. Liu, “A communication-efficient multi-agent actor-critic algorithm for distributed reinforcement learning,” in _2019 IEEE 58th Conference on Decision and Control (CDC)_ , 2019, pp. 5562–5567.
  * [280] T. Chen, K. Zhang, G. B. Giannakis, and T. Başar, “Communication-efficient distributed reinforcement learning,” _arXiv preprint arXiv:1812.03239_ , 2018.
  * [281] J. N. Foerster, Y. M. Assael, N. de Freitas, and S. Whiteson, “Learning to communicate with deep multi-agent reinforcement learning,” in _Proceedings of the 30th International Conference on Neural Information Processing Systems_ , 2016, pp. 2145–2153.
  * [282] D. Kim, S. Moon, D. Hostallero, W. J. Kang, T. Lee, K. Son, and Y. Yi, “Learning to schedule communication in multi-agent reinforcement learning,” in _International Conference on Learning Representations_ , 2019.
  * [283] K. Wang, D. Zhang, Y. Li, R. Zhang, and L. Lin, “Cost-effective active learning for deep image classification,” _IEEE Trans. on Circuits and Systems for Video Technology_ , vol. 27, no. 12, pp. 2591–2600, 2017\.
  * [284] S. Huang, R. Jin, and Z. Zhou, “Active learning by querying informative and representative examples,” _IEEE Trans. on Pattern Analysis and Machine Intell._ , vol. 36, no. 10, pp. 1936–1949, 2014.
  * [285] L. Lin, K. Wang, D. Meng, W. Zuo, and L. Zhang, “Active self-paced learning for cost-effective and progressive face identification,” _IEEE Trans. on Pattern Analysis and Machine Intell._ , vol. 40, no. 1, pp. 7–19, 2018\.
  * [286] A. A. Abdellatif, C. F. Chiasserini, and F. Malandrino, “Active learning-based classification in automated connected vehicles,” in _IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)_ , 2020, pp. 598–603.
  * [287] T. Liu and D. Tao, “Classification with noisy labels by importance reweighting,” _IEEE Trans. on Pattern Analysis and Machine Intell._ , vol. 38, no. 3, pp. 447–461, 2016.
  * [288] B. van Rooyen, A. Menon, and R. C. Williamson, “Learning with symmetric label noise: The importance of being unhinged,” _NIPS_ , pp. 10–18, 2015.
  * [289] J. Chen, Y. Zhou, A. Zipf, and H. Fan, “Deep learning from multiple crowds: A case study of humanitarian mapping,” _IEEE Trans. on Geoscience and Remote Sensing_ , vol. 57, no. 3, pp. 1713–1722, 2019.
  * [290] J. Zhang, X. Wu, and V. S. Shengs, “Active learning with imbalanced multiple noisy labeling,” _IEEE Trans. on Cybernetics_ , vol. 45, no. 5, pp. 1095–1107, 2015.
  * [291] M. Fang, T. Zhou, J. Yin, Y. Wang, and D. Tao, “Data subset selection with imperfect multiple labels,” _IEEE Trans. on Neural Networks and Learning Syst._ , vol. 30, no. 7, pp. 2212–2221, 2019.
  * [292] G. Hua, C. Long, M. Yang, and Y. Gao, “Collaborative active visual recognition from crowds: A distributed ensemble approach,” _IEEE Transactions on Pattern Analysis and Machine Intelligence_ , vol. 40, no. 3, pp. 582–594, 2018.
  * [293] Y. Liu and M. Liu, “An online learning approach to improving the quality of crowd-sourcing,” _IEEE/ACM Trans. on Networking_ , vol. 25, no. 4, pp. 2166–2179, 2017.
  * [294] Y. Huang, Z. Liu, M. Jiang, X. Yu, and X. Ding, “Cost-effective vehicle type recognition in surveillance images with deep active learning and web data,” _IEEE Trans. on Intell. Transp. Syst._ , pp. 1–8, 2019.
  * [295] R. Wang, T. Liu, and D. Tao, “Multiclass learning with partially corrupted labels,” _IEEE Trans. on Neural Networks and Learning Systems_ , vol. 29, no. 6, pp. 2568–2580, 2018.
  * [296] L. Wang, K. Wang, C. Pan, W. Xu, N. Aslam, and L. Hanzo, “Multi-agent deep reinforcement learning-based trajectory planning for multi-uav assisted mobile edge computing,” _IEEE Transactions on Cognitive Communications and Networking_ , vol. 7, no. 1, pp. 73–84, 2021.
  * [297] “openai/multiagent-particle-envs,” Apr. 2021, original-date: 2017-08-17T19:39:05Z. [Online]. Available: https://github.com/openai/multiagent-particle-envs
  * [298] O. Vinyals, I. Babuschkin, W. M. Czarnecki, M. Mathieu, A. Dudzik, J. Chung, D. H. Choi, R. Powell, T. Ewalds, P. Georgiev _et al._ , “Grandmaster level in starcraft ii using multi-agent reinforcement learning,” _Nature_ , vol. 575, no. 7782, pp. 350–354, 2019.
  * [299] A. B. said, M. F. Al-Sa’D, M. Tlili, A. A. Abdellatif, A. Mohamed, T. Elfouly, K. Harras, and M. D. O’Connor, “A deep learning approach for vital signs compression and energy efficient delivery in mhealth systems,” _IEEE Access_ , vol. 6, pp. 33 727–33 739, 2018.
  * [300] A. A. Abdellatif, C. F. Chiasserini, F. Malandrino, A. Mohamed, and A. Erbad, “Active learning with noisy labelers for improving classification accuracy of connected vehicles,” _IEEE Transactions on Vehicular Technology_ , pp. 1–1, 2021.
  * [301] Z. Zheng, S. Xie, H. Dai, X. Chen, and H. Wang, “An overview of blockchain technology: Architecture, consensus, and future trends,” in _2017 IEEE International Congress on Big Data (BigData Congress)_ , 2017, pp. 557–564.
  * [302] C. G. Akcora, M. Kantarcioglu, and Y. R. Gel, “Blockchain data analytics,” in _2018 IEEE International Conference on Data Mining (ICDM)_ , 2018, pp. 6–6.
  * [303] A. Adadi and M. Berrada, “Peeking inside the black-box: A survey on explainable artificial intelligence (xai),” _IEEE Access_ , vol. 6, pp. 52 138–52 160, 2018.
  * [304] E. Tjoa and C. Guan, “A survey on explainable artificial intelligence (xai): Toward medical xai,” _IEEE Transactions on Neural Networks and Learning Systems_ , pp. 1–21, 2020.
  * [305] N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: A simple way to prevent neural networks from overfitting,” _Journal of Machine Learning Research_ , vol. 15, no. 56, pp. 1929–1958, 2014\.
  * [306] A. Yousefpour, B. Q. Nguyen, S. Devic, G. Wang, A. Kreidieh, H. Lobel, A. M. Bayen, and J. P. Jue, “Resilinet: Failure-resilient inference in distributed neural networks,” 2020.
  * [307] E. Baccour, A. Erbad, A. Mohamed, M. Hamdi, and M. Guizani, “Rl-pdnn: Reinforcement learning for privacy-aware distributed neural networks in iot systems,” _IEEE Access_ , vol. 9, pp. 54 872–54 887, 2021\.
  * [308] E. Egorov, C. Pieters, H. Korach-Rechtman, J. Shklover, and A. Schroeder, “Robotics, microfluidics, nanotechnology and ai in the synthesis and evaluation of liposomes and polymeric drug delivery systems,” _Drug Delivery and Translational Research_ , vol. 11, p. 345–352, 2021.
  * [309] O. Adir, M. Poley, G. Chen, S. Froim, N. Krinsky, J. Shklover, J. Shainsky-Roitman, T. Lammers, and A. Schroeder, “Integrating artificial intelligence and nanotechnology for precision cancer medicine,” _Advanced Materials_ , vol. 32, no. 13, p. 1901989, 2020.
  * [310] W. Du and S. Ding, “A survey on multi-agent deep reinforcement learning: from the perspective of challenges and applications,” _Artificial Intelligence Review_ , pp. 1–24, 2020.
  * [311] A. H. Sayed, “Adaptation, learning, and optimization over networks,” _Foundations and Trends® in Machine Learning_ , vol. 7, no. 4-5, pp. 311–801, 2014. [Online]. Available: http://dx.doi.org/10.1561/2200000051

|  Emna Baccour received the Ph.D. degree in computer Science from the
University of Burgundy, France, in 2017. She was a postdoctoral fellow at
Qatar University on a project covering the interconnection networks for
massive data centers and then on a project covering video caching and
processing in mobile edge computing networks. She currently holds a
postdoctoral position at Hamad Ben Khalifa University. Her research interests
include data center networks, cloud, edge and mobile computing as well as
distributed systems. She is also interested in distributed machine learning
and reinforcement learning with application to IoT systems.
---|---
|  Naram Mhaisen obtained a B.Sc. degree in Computer Engineering, with
excellence, from Qatar University (QU), and an M.Sc. in Computing from the
same institution in 2017 and 2020, respectively. Since 2017, he has worked as
a researcher on several funded projects at the Department of Computer Science
and Engineering, QU. Currently, he is pursuing a Ph.D. at Delft University of
Technology. (TU Delft). His research interests include the design and
optimization of networked (learning) systems with applications to IoT.
---|---
|  Alaa Awad Abdellatif received his Ph.D. in 2018 from Politecnico di Torino.
He is currently a Postdoctoral researcher in Qatar University. He received his
B.Sc. and M.Sc. degrees with honors in Electronics and Electrical
Communications Engineering from Cairo University, in 2009 and 2012,
respectively. He also worked as a Senior Research Assistant and Research
Assistant at Qatar University, from 2013 till 2015, and at Cairo University,
from 2009 till 2012, respectively. Dr. Alaa Abdellatif has authored or co-
authored over 35 refereed journal, magazine, and conference papers in
reputable international journals and conferences. He has served as a technical
reviewer for many international journals and magazines. His research interests
include Edge computing, Blockchain, machine learning and resources
optimization for wireless heterogeneous networks, smart-health, IoT
applications, and vehicular networks. He was the recipient of the Graduate
Student Research Award (GSRA) from Qatar National Research Fund, and the Best
Paper Award from Wireless Telecommunications Symposium 2018, in USA, in
addition to the Quality Award from Politecnico di Torino in 2018.
---|---
|  Aiman Erbad is an Associate Professor at the College of Science and
Engineering at Hamad Bin Khalifa University (HBKU). Dr. Erbad obtained a PhD
in Computer Science from the University of British Columbia (Canada), and a
Master of Computer Science in Embedded Systems and Robotics from the
University of Essex (UK). Dr. Erbad received the Platinum award from H.H. The
Emir Sheikh Tamim bin Hamad Al Thani at the Education Excellence Day 2013 (PhD
category). Dr. Erbad received the 2020 best research paper award from the
Computer Communications journal, IWCMC 2019 best paper award, and IEEE CCWC
2017 best paper award. Dr. Erbad is an editor in KSII Transactions on Internet
and Information Systems and was a guest editor in IEEE Networks. Dr. Erbad
research interests span cloud computing, edge computing, IoT, private and
secure networks, and multimedia systems.
---|---
|  Amr Mohammed (S’ 00, M’ 06, SM’ 14) received his M.S. and Ph.D. in
electrical and computer engineering from the University of British Columbia,
Vancouver, Canada, in 2001, and 2006 respectively. He has worked as an
advisory IT specialist in IBM Innovation Centre in Vancouver from 1998 to
2007, taking a leadership role in systems development for vertical industries.
He is currently a professor in the college of engineering at Qatar University
and the director of the Cisco Regional Academy. He has over 25 years of
experience in wireless networking research and industrial systems development.
He holds 3 awards from IBM Canada for his achievements and leadership, and 4
best paper awards from IEEE conferences. His research interests include
wireless networking, and edge computing for IoT applications. Dr. Amr Mohamed
has authored or co-authored over 160 refereed journal and conference papers,
textbook, and book chapters in reputable international journals, and
conferences. He has served as a technical program committee (TPC) co-chair for
workshops in IEEE WCNC’16. He has served as a co-chair for technical symposia
of international conferences, including Globecom’16, Crowncom’15, AICCSA’14,
IEEE WLN’11, and IEEE ICT’10. He has served on the organization committee of
many other international conferences as a TPC member, including the IEEE ICC,
GLOBECOM, WCNC, LCN and PIMRC, and a technical reviewer for many international
IEEE, ACM, Elsevier, Springer, and Wiley journals.
---|---
|  Mounir Hamdi received the B.S. degree (Hons.) in electrical engineering
(computer engineering) from the University of Louisiana, in 1985, and the M.S.
and Ph.D. degrees in electrical engineering from the University of Pittsburgh,
in 1987 and 1991, respectively. He was a Chair Professor and a Founding Member
of The Hong Kong University of Science and Technology (HKUST), where he was
the Head of the Department of Computer Science and Engineering. From 1999 to
2000, he held visiting professor positions at Stanford University and the
Swiss Federal Institute of Technology. He is currently the Founding Dean of
the College of Science and Engineering, Hamad Bin Khalifa University (HBKU).
His area of research is in high-speed wired/wireless networking, in which he
has published more than 360 publications, graduated more 50 M.S./Ph.D.
students, and awarded numerous research grants. In addition, he has frequently
consulted for companies and governmental organizations in the USA, Europe, and
Asia. He is a Fellow of the IEEE for his contributions to design and analysis
of high-speed packet switching, which is the highest research distinction
bestowed by IEEE. He is also a frequent keynote speaker in international
conferences and forums. He is/was on the editorial board of more than ten
prestigious journals and magazines. He has chaired more than 20 international
conferences and workshops. In addition to his commitment to research and
academic/professional service, he is also a dedicated teacher and a quality
assurance educator. He received the Best 10 Lecturer Award and the
Distinguished Engineering Teaching Appreciation Award from HKUST. He is
frequently involved in higher education quality assurance activities as well
as engineering programs accreditation all over the world.
---|---
|  Mohsen Guizani (S’85–M’89–SM’99–F’09) received the B.S. (with distinction)
and M.S. degrees in electrical engineering, the M.S. and Ph.D. degrees in
computer engineering from Syracuse University, Syracuse, NY, USA, in 1984,
1986, 1987, and 1990, respectively. He is currently a Professor at the
Computer Science and Engineering Department in Qatar University, Qatar.
Previously, he served in different academic and administrative positions at
the University of Idaho, Western Michigan University, University of West
Florida, University of Missouri-Kansas City, University of Colorado-Boulder,
and Syracuse University. His research interests include wireless
communications and mobile computing, computer networks, mobile cloud
computing, security, and smart grid. He is currently the Editor-in-Chief of
the IEEE Network Magazine, serves on the editorial boards of several
international technical journals and the Founder and Editor-in-Chief of
Wireless Communications and Mobile Computing journal (Wiley). He is the author
of nine books and more than 500 publications in refereed journals and
conferences. He guest edited a number of special issues in IEEE journals and
magazines. He also served as a member, Chair, and General Chair of a number of
international conferences. Throughout his career, he received three teaching
awards and four research awards. He also received the 2017 IEEE Communications
Society WTC Recognition Award as well as the 2018 AdHoc Technical Committee
Recognition Award for his contribution to outstanding research in wireless
communications and Ad-Hoc Sensor networks. He was the Chair of the IEEE
Communications Society Wireless Technical Committee and the Chair of the TAOS
Technical Committee. He served as the IEEE Computer Society Distinguished
Speaker and is currently the IEEE ComSoc Distinguished Lecturer. He is a
Fellow of IEEE and a Senior Member of ACM.
---|---