Ayyaz Hussain is currently working as Professor of Computer Science at Quaid-i-Azam University Islamabad. From 2010 to 2020 he was Associate Professor and Chair of the Department of Computer Science & Software Engineering at International Islamic University Islamabad. He worked as Research Professor at Gwangju Institute of Science and Technology South Korea from 2013-2014. During 2000 to 2010 he served as Software Engineer at National Engineering and Scientific Commission. Dr. Hussain received his PhD from National University of Computer and Emerging Sciences (NUCES-FAST) in 2009. His research interests include Image processing, computer vision, machine learning and deep learning. He has published more than 40 journal articles along with a number of conference papers. He has supervised more than 12 PhD and 25 MS students
Abstract: Deep learning is being applied to a wide variety of real world applications domains. Deeper networks can solve complex real world problems however, they are resource intensive in terms of memory and computation. Therefore, deploying those heavy networks on resource constrained edge devices is still a challenge. Knowledge distillation is used to transfer knowledge from heavy models to lighter models having smaller memory and computation requirements and can be used in resource constrained devices.
Bahria University, Johar Town, Lahore, Pakistan
© 2025 All rights reserved by Bahria University