{"id":313,"date":"2019-09-20T17:13:06","date_gmt":"2019-09-21T00:13:06","guid":{"rendered":"https:\/\/dfan.engineering.asu.edu\/?page_id=313"},"modified":"2025-12-04T18:59:32","modified_gmt":"2025-12-04T18:59:32","slug":"deep-learning-neural-network","status":"publish","type":"page","link":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/","title":{"rendered":"Efficient Edge AI Algorithm"},"content":{"rendered":"\n<p>Deep Neural Network (DNN) is the state-of-the-art neural network computing model that successfully achieves close-to or better than human performance in many large scale cognitive applications, like computer vision, speech recognition, nature language processing, object recognition, etc. The most successful DNN is deep convolutional neural network consisting of multiple types of layers including convolution, activation, pooling and fully-connected layers. Typically, a DNN may have tens to thousands of layers to achieve optimized inference accuracy for practical applications, which makes it heavily memory (tens of GB working memory) and computing intensive (needs powerful CPU, GPU, FPGA, ASIC, etc.). Our research focus on:\u00a0<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Explore automated and general methodologies to simultaneously reduce DNN model size and computing complexity, while maintaining state-of-the-art accuracy<\/li>\n\n\n\n<li>Explore how to design and deploy hardware-efficient DNN model in low power and resource limited mobile system, embedded system, IoT, edge devices for various applications, such as pattern recognition, object tracking\/detection, etc.<\/li>\n\n\n\n<li>Explore memory- and computing-efficient on-device continual learning algorithm and system design<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-2 wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"871\" height=\"328\" data-id=\"335\" src=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5.jpg\" alt=\"\" class=\"wp-image-335\" srcset=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5.jpg 871w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5-300x113.jpg 300w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5-768x289.jpg 768w\" sizes=\"auto, (max-width: 871px) 100vw, 871px\" \/><figcaption class=\"wp-element-caption\">weight ternarization<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"473\" data-id=\"336\" src=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture6-1024x473.png\" alt=\"\" class=\"wp-image-336\" srcset=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture6-1024x473.png 1024w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture6-300x138.png 300w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture6-768x355.png 768w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture6.png 1133w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">binary depthwise convolution neural network<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"294\" data-id=\"350\" src=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture8-1024x294.png\" alt=\"\" class=\"wp-image-350\" srcset=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture8-1024x294.png 1024w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture8-300x86.png 300w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture8-768x220.png 768w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture8-1536x440.png 1536w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture8.png 1950w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">sample FPGA implementation of real-time object tracking based on the proposed compressed DNN<\/figcaption><\/figure>\n<\/figure>\n\n\n\n<div class=\"wp-block-media-text alignwide has-media-on-the-right\" style=\"grid-template-columns:auto 37%\"><div class=\"wp-block-media-text__content\">\n<p>Real-time object tracking in an IoT FPGA based on the developed compressed deep neural network.  <\/p>\n\n\n\n<p>720P video, ~2W power, ~11FPS  <\/p>\n<\/div><figure class=\"wp-block-media-text__media\"><video controls src=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/demo_FPGA_cut.mp4\"><\/video><\/figure><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"474\" src=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture-2-1024x474.jpg\" alt=\"\" class=\"wp-image-1019\" srcset=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture-2-1024x474.jpg 1024w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture-2-300x139.jpg 300w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture-2-768x355.jpg 768w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture-2-1536x711.jpg 1536w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture-2.jpg 1891w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"489\" src=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture2-1-1024x489.jpg\" alt=\"\" class=\"wp-image-1020\" srcset=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture2-1-1024x489.jpg 1024w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture2-1-300x143.jpg 300w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture2-1-768x367.jpg 768w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture2-1-1536x733.jpg 1536w, https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2022\/02\/Capture2-1.jpg 1898w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Related publications&nbsp;:<\/strong><\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li>[<strong>WACV\u201925<\/strong>] Yongjae Lee, Li Yang, and Deliang Fan, \u201cMFNeRF: Memory Efficient NeRF with Mixed-Feature Hash Table\u201d&nbsp;IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV), Tucson, Arizona,&nbsp;USA, 2025&nbsp;<a href=\"https:\/\/arxiv.org\/abs\/2304.12587\">[pdf]<\/a>&nbsp;[<a href=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2025\/01\/2025-2-wacv25-0999.mp4\">video<\/a>]<\/li>\n\n\n\n<li>[<strong>ASPDAC\u201925<\/strong>] Asmer Hamid Ali, Fan Zhang, Li Yang and Deliang Fan, \u201cLearning to Prune and Low-Rank Adaptation for Compact Language Model Deployment\u201d&nbsp;30th Asia and South Pacific Design Automation Conference (ASPDAC), Tokyo, Japan, 2025 [<a href=\"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3658617.3697648\">pdf<\/a>]<\/li>\n\n\n\n<li>[<strong>NeurIPS\u201924<\/strong>] Zhaoliang Zhang, Tianchen Song, Yongjae Lee, Li Yang, Cheng Peng, Rama Chellappa, and Deliang Fan, \u201cLP-3DGS: Learning to Prune 3D Gaussian Splatting,\u201d&nbsp;<em>Thirty-Eighth Conference on Neural Information Processing Systems (NeurIPS)<\/em>, Vancouver, Canada, Dec 16, 2024, Dec. 2024&nbsp;<a href=\"https:\/\/arxiv.org\/abs\/2405.18784\">[pdf]<\/a> (accept)<\/li>\n\n\n\n<li>[<strong>NeurIPS\u201923<\/strong>] Jian Meng, Li Yang, Kyungmin Lee, Jinwoo Shin, Deliang Fan, and Jae-sun Seo, \u201cSlimmed Asymmetrical Contrastive Learning and Cross Distillation for Lightweight Model Training,\u201d&nbsp;<em>Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS)<\/em>, New Orleans, LA, Dec. 2023&nbsp;<a href=\"https:\/\/neurips.cc\/virtual\/2023\/poster\/70554\" target=\"_blank\" rel=\"noreferrer noopener\">[pdf]<\/a><\/li>\n\n\n\n<li>[<strong>NeurIPS\u201922<\/strong>] Li Yang*, Jian Meng*, Jae-sun Seo, and Deliang Fan, \u201cGet More at Once: Alternating Sparse Training with Gradient Correction,\u201d&nbsp;<em>Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS)<\/em>, New Orleans, LA, Nov.29 \u2013 Dec.1, 2022 (* The first two authors contribute equally)&nbsp;<a href=\"https:\/\/openreview.net\/forum?id=lYZQRpqLesi\" target=\"_blank\" rel=\"noreferrer noopener\">[pdf]<\/a><\/li>\n\n\n\n<li>[<strong>NeurIPS\u201922<\/strong>] Sen Lin, Li Yang, Deliang Fan, and Junshan Zhang, \u201cBeyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer,\u201d&nbsp;<em>Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS)<\/em>, New Orleans, LA, Nov.29 \u2013 Dec.1, 2022&nbsp;<a href=\"https:\/\/openreview.net\/forum?id=diV1PpaP33\">[pdf]<\/a> <\/li>\n\n\n\n<li>[<strong>CVPR\u201922<\/strong>] Li Yang, Adnan Siraj Rakin, and Deliang Fan, \u201cRep-Net: Efficient On-Device Learning via Feature Reprogramming\u201d&nbsp;<em>IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)<\/em>, New Orleans, Louisiana, June 19-24, 2022&nbsp;<a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2022\/html\/Yang_Rep-Net_Efficient_On-Device_Learning_via_Feature_Reprogramming_CVPR_2022_paper.html\">[pdf]<\/a><\/li>\n\n\n\n<li>[<strong>CVPR\u201922<\/strong>] Jian Meng, Li Yang, Jinwoo Shin, Deliang Fan, and Jae-sun Seo, \u201cContrastive Dual Gating: Learning Sparse Features With Contrastive Learning\u201d&nbsp;<em>IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)<\/em>, New Orleans, Louisiana, June 19-24, 2022&nbsp;<a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2022\/html\/Meng_Contrastive_Dual_Gating_Learning_Sparse_Features_With_Contrastive_Learning_CVPR_2022_paper.html\">[pdf]<\/a><\/li>\n\n\n\n<li>[<strong>CVPR-ECV\u201922<\/strong>] Li Yang, Adnan Siraj Rakin, and Deliang Fan, \u201cDA3 : Dynamic Additive Attention Adaption for Memory-Efficient On-Device Learning\u201d&nbsp;<em>Efficient Deep Learning for Computer Vision CVPR Workshop,&nbsp;<\/em>, New Orleans, Louisiana, June 19-24, 2022&nbsp;<a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2022W\/ECV\/papers\/Yang_DA3_Dynamic_Additive_Attention_Adaption_for_Memory-Efficient_On-Device_Multi-Domain_Learning_CVPRW_2022_paper.pdf\">[pdf]<\/a> <\/li>\n\n\n\n<li> [<strong>ICLR\u201922<\/strong>] Sen Li, Li Yang, Deliang Fan, and Junshan Zhang, \u201cTRGP: Trust Region Gradient Projection for Continual Learning,\u201d&nbsp;<em>The Tenth International Conference on Learning Representations,<\/em>&nbsp;(ICLR), Apr. 25- 29th , 2022&nbsp; &nbsp;<a href=\"https:\/\/openreview.net\/pdf?id=iEvAf8i6JjO\">[pdf]&nbsp;<\/a> <strong>(-spotlight-)<\/strong> <\/li>\n\n\n\n<li>[<strong>CVPR\u201921<\/strong>] Li Yang, Zhezhi He, Junshan Zhang and Deliang Fan, \u201cKSM: Fast Multiple Task Adaption via Kernel-wise Soft Mask Learning\u201d&nbsp;<em>IEEE\/CVF Computer Vision and Pattern Recognition (CVPR)<\/em>, June 19-25, 2021&nbsp;<a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2021\/html\/Yang_KSM_Fast_Multiple_Task_Adaption_via_Kernel-Wise_Soft_Mask_Learning_CVPR_2021_paper.html\">[pdf]<\/a> <\/li>\n\n\n\n<li>[<strong>AAAI&#8217;20<\/strong>] Li Yang, Zhezhi He and Deliang Fan, \u201cHarmonious Coexistence of Structured Weight Pruning and Ternarization for Deep Neural Networks,\u201d <em>Thirty-Fourth AAAI Conference on Artificial Intelligence<\/em> (AAAI), Feb. 7-12 2020, New York, USA  &nbsp;<a href=\"https:\/\/aaai.org\/ojs\/index.php\/AAAI\/article\/view\/6138\">[pdf]<\/a>  <strong>(spotlight)<\/strong>   <\/li>\n\n\n\n<li> [<strong>AAAI\u201922<\/strong>] Jingbo Sun, Li Yang, Jiaxin Zhang, Frank Liu, Mahantesh Halappanavar, Deliang Fan, and Yu Cao, \u201cGradient-based Novelty Detection Boosted by Self-supervised Binary Classification,\u201d&nbsp;<em>Thirty-Six AAAI Conference on Artificial Intelligence<\/em>&nbsp;(AAAI), Feb. 22-March 1, 2022, Vancouver, BC, Canada&nbsp;<a href=\"https:\/\/arxiv.org\/abs\/2112.09815\">[Archived version]<\/a> <\/li>\n\n\n\n<li><strong>[CVPR\u201919]<\/strong>&nbsp;Zhezhi He and Deliang Fan, \u201cSimultaneously Optimizing Weight and Quantizer of Ternary Neural Network using Truncated Gaussian Approximation,\u201d&nbsp;<em>Conference on Computer Vision and Pattern Recognition (CVPR)<\/em>, June 16-20, 2019, Long Beach, CA, USA&nbsp;<a href=\"http:\/\/openaccess.thecvf.com\/content_CVPR_2019\/papers\/He_Simultaneously_Optimizing_Weight_and_Quantizer_of_Ternary_Neural_Network_Using_CVPR_2019_paper.pdf\">[pdf]<\/a><\/li>\n\n\n\n<li> <strong>[CVPR\u201919]<\/strong>&nbsp;Zhezhi He*, Adnan Siraj Rakin* and Deliang Fan, \u201cParametric Noise Injection: Trainable Randomness to Improve Deep Neural Network Robustness against Adversarial Attack,\u201d&nbsp;<em>Conference on Computer Vision and Pattern Recognition (CVPR)<\/em>, June 16-20, 2019, Long Beach, CA, USA (* The first two authors contributed equally)&nbsp;<a href=\"http:\/\/openaccess.thecvf.com\/content_CVPR_2019\/papers\/He_Parametric_Noise_Injection_Trainable_Randomness_to_Improve_Deep_Neural_Network_CVPR_2019_paper.pdf\">[pdf]<\/a>&nbsp;<a href=\"https:\/\/github.com\/elliothe\/CVPR_2019_PNI\">[code in GitHub]<\/a> <\/li>\n\n\n\n<li><strong>[TNNLS\u201922]<\/strong>&nbsp; Li Yang, Zhezhi He, Yu Cao, and Deliang Fan, \u201cA Progressive Sub-network Searching Framework for Dynamic Inference,\u201d&nbsp;<em>IEEE Transactions on Neural Networks and Learning Systems (TNNLS)&nbsp;<\/em>, 2022, DOI: 10.1109\/TNNLS.2022.3199703&nbsp;<a href=\"https:\/\/ieeexplore.ieee.org\/document\/9877887\">[pdf]<\/a> <\/li>\n\n\n\n<li><strong>[TPAMI\u201921]<\/strong>&nbsp; Adnan Siraj Rakin, Zhezhi He, Jingtao Li, Fan Yao, Chaitali Chakrabarti and Deliang Fan, \u201cT-BFA: Targeted Bit-Flip Adversarial Weight Attack,\u201d&nbsp;<em>IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)<\/em>, 2021&nbsp;<a href=\"https:\/\/ieeexplore.ieee.org\/abstract\/document\/9540274\">[pdf]<\/a> <\/li>\n\n\n\n<li> [<strong>TNNLS\u201921<\/strong>] Xiaolong Ma, Sheng Lin, Shaokai Ye, Zhezhi He, Linfeng Zhang, Geng Yuan, Sia Huat Tan, Zhenggang Li, Deliang Fan, Xuehai Qian, Xue Lin, Kaisheng Ma, and Yanzhi Wang, \u201cNon-Structured DNN Weight Pruning \u2013 Is It Beneficial in Any Platform?,\u201d&nbsp;<em>IEEE Transactions on Neural Networks and Learning Systems (TNNLS),<\/em>&nbsp; DOI: 10.1109\/TNNLS.2021.3063265, 2021  <a href=\"https:\/\/ieeexplore.ieee.org\/document\/9381660\">[pdf]<\/a> <\/li>\n\n\n\n<li> <strong>[USENIX Security\u201920]<\/strong>&nbsp; Fan Yao, Adnan Siraj Rakin and Deliang Fan, \u201cDeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flips,\u201d&nbsp;<em>In 29th USENIX Security Symposium (USENIX Security 20)<\/em>, August 12-14, 2020, Boston, MA, USA&nbsp;   <a href=\"https:\/\/www.usenix.org\/system\/files\/sec20-yao.pdf\">[pdf]&nbsp;<\/a>&nbsp; <\/li>\n\n\n\n<li> <strong>[WACV\u201919]<\/strong>&nbsp;Zhezhi He, Boqing Gong, Deliang Fan, \u201cOptimize Deep Convolutional Neural Network with Ternarized Weights and High Accuracy,\u201d&nbsp;<em>IEEE Winter Conference on Applications of Computer Vision<\/em>, January 7-11, 2019, Hawaii, USA&nbsp;<a href=\"https:\/\/ieeexplore.ieee.org\/document\/8658565\">[pdf]<\/a><a href=\"https:\/\/github.com\/elliothe\/Ternarized_Neural_Network\">[code in GitHub]<\/a> <\/li>\n\n\n\n<li>[<strong>ASPDAC\u201921<\/strong>]&nbsp; Li Yang, and Deliang Fan, \u201cDynamic Neural Network to Enable Run-Time Trade-off between Accuracy and Latency,\u201d&nbsp;<em>26th Asia and South Pacific Design Automation Conference (ASPDAC)<\/em>, Jan. 18-21, 2021 (invited)  <a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3394885.3431628\">[pdf]<\/a> <\/li>\n\n\n\n<li>[<strong>SOCC\u201920<\/strong>]&nbsp; Li Yang, Zhezhi He, Shaahin Angizi and Deliang Fan, \u201cProcessing-In-Memory Accelerator for Dynamic Neural Network with Run-Time Tuning of Accuracy, Power and Latency,\u201d&nbsp;<em>33rd IEEE International System-on-Chip Conference (SOCC)<\/em>, September 8-11, 2020 (invited)  <a href=\"https:\/\/ieeexplore.ieee.org\/document\/9524770\">[pdf]<\/a> <\/li>\n\n\n\n<li> [<strong>DAC\u201920<\/strong>] Li Yang, Zhezhi He, Yu Cao and Deliang Fan. \u201cNon-uniform DNN Structured Subnets Sampling for Dynamic Inference\u201d.&nbsp;<em>In: 57th Design Automation Conference (DAC)<\/em>, San Francisco, CA, July 19-23, 2020   <a href=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2020\/08\/2020_07_DAC_dynamic-NN.pdf\">[pdf]<\/a> <\/li>\n\n\n\n<li> <strong>[ASPDAC\u201920]<\/strong>&nbsp;Li Yang, Shaahin Angizi, Deliang Fan, \u201cA Flexible Processing-in-Memory Accelerator for Dynamic Channel-Adaptive Deep Neural Networks,\u201d Asia and South Pacific Design Automation Conference (ASP-DAC), Jan. 13-16, 2020, Beijing, China&nbsp; <a href=\"https:\/\/ieeexplore.ieee.org\/document\/9045166\">[pdf]&nbsp;<\/a>&nbsp; <\/li>\n\n\n\n<li><strong>[ISVLSI\u201919]<\/strong>&nbsp;Shaahin Angizi, Zhezhi He, Dayane Reis, Xiaobo Sharon Hu, Wilman Tsai, Shy Jay Lin and Deliang Fan, \u201cAccelerating Deep Neural Networks in Processing-in-Memory Platforms: Analog or Digital Approach?,\u201d IEEE Computer Society Annual Symposium on VLSI, 15 \u2013 17 July 2019, Miami, Florida, USA (invited)  <a href=\"https:\/\/ieeexplore.ieee.org\/document\/8839490\">[pdf]<\/a> <\/li>\n\n\n\n<li><strong>[GLSVLSI\u201919]<\/strong>&nbsp;Li Yang, Zhezhi He and Deliang Fan, \u201cBinarized Depthwise Separable Neural Network for Object Tracking in FPGA,\u201d ACM&nbsp;<em>Great Lakes Symposium on VLSI(GLSVLSI)<\/em>, May 9-11, 2019, Washington, D.C. USA&nbsp;<a href=\"https:\/\/dl.acm.org\/citation.cfm?id=3318034\">[pdf]<\/a><\/li>\n\n\n\n<li><strong>[ICCD\u201918]<\/strong>&nbsp;Adnan Siraj Rakin, Shaahin Angizi, Zhezhi He and Deliang Fan, \u201cPIM-TGAN: A Processing-in-Memory Accelerator for Ternary Generative Adversarial Networks,\u201d&nbsp;<em>IEEE International Conference on Computer Design (ICCD)&nbsp;<\/em>, Oct. 7-10, 2018, Orlando, FL, USA&nbsp;<a href=\"https:\/\/ieeexplore.ieee.org\/abstract\/document\/8615698\">[pdf]<\/a><\/li>\n\n\n\n<li><strong>[ICCAD\u201918]<\/strong>&nbsp;Shaahin Angizi, Zhezhi He and Deliang Fan, \u201cDIMA: A Depthwise CNN In-Memory Accelerator,\u201d&nbsp;<em>IEEE\/ACM International Conference on Computer Aided Design<\/em>, Nov. 5-8, 2018, San Diego, CA, USA&nbsp;<a href=\"https:\/\/dl.acm.org\/citation.cfm?id=3240799\">[pdf]<\/a><\/li>\n\n\n\n<li><strong>[ISLPED\u201918]<\/strong>&nbsp;Li Yang, Zhezhi He and Deliang Fan, \u201cA Fully Onchip Binarized Convolutional Neural Network FPGA Implementation with Accurate Inference,\u201d&nbsp;<em>ACM\/IEEE International Symposium on Low Power Electronics and Design<\/em>, July 23-25, 2018, Bellevue, Washington, USA&nbsp;<a href=\"https:\/\/dl.acm.org\/citation.cfm?id=3218615\">[pdf]<\/a><\/li>\n\n\n\n<li><strong>[ISVLSI\u201918]<\/strong>&nbsp;Zhezhi He, Shaahin Angizi, Adnan Siraj Rakin and Deliang Fan, \u201cBD-NET: A Multiplication-less DNN with Binarized Depthwise Separable Convolution,\u201d&nbsp;<em>IEEE Computer Society Annual Symposium on VLSI<\/em>, July 9-11, 2018, Hong Kong, CHINA&nbsp;<a href=\"https:\/\/ieeexplore.ieee.org\/abstract\/document\/8429354\/\">[pdf]<\/a>&nbsp;(<a href=\"http:\/\/www.eecs.ucf.edu\/~dfan\/Award\/BPA_ISVLSI2018.pdf\">&nbsp;<strong>Best Paper Award<\/strong><\/a>)<\/li>\n\n\n\n<li><strong>[DAC\u201918]<\/strong>&nbsp;Shaahin Angizi*, Zhezhi He*, Adnan Siraj Rakin and Deliang Fan, \u201cCMP-PIM: An Energy-Efficient Comparator-based Processing-In-Memory Neural Network Accelerator,\u201d&nbsp;<em>IEEE\/ACM Design Automation Conference&nbsp;<\/em>(DAC), June 24-28, 2018, San Francisco, CA, USA (* The first two authors contributed equally)&nbsp;<a href=\"https:\/\/dl.acm.org\/citation.cfm?id=3196009\">[pdf]<\/a><\/li>\n\n\n\n<li><strong>[WACV\u201918]<\/strong>&nbsp;Y. Ding, L. Wang, D. Fan and B. Gong \u201cA Semi-Supervised Two-Stage Approach to Learning from Noisy Labels,\u201d&nbsp;<em>IEEE Winter Conference on Applications of Computer Vision<\/em>, March 12-14, 2018, Stateline, NV, USA&nbsp;<a href=\"https:\/\/arxiv.org\/pdf\/1802.02679.pdf\">[pdf]<\/a><\/li>\n\n\n\n<li>[<strong>JETC&#8217;20<\/strong>] Zhezhi He, Li Yang, Shaahin Angizi, Adnan Siraj Rakin and Deliang Fan, \u201cSparse BD-Net: A Multiplication-Less DNN with Sparse Binarized Depth-wise Separable Convolution,\u201d <em>ACM Journal on Emerging Technologies in Computing Systems,<\/em>  January 2020 Article No.: 15 https:\/\/doi.org\/10.1145\/3369391&nbsp;<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3369391\">[pdf]<\/a> <\/li>\n<\/ol>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p class=\"mb-2\">Deep Neural Network (DNN) is the state-of-the-art neural network computing model that successfully achieves close-to or better than human performance in many large scale cognitive applications, like computer vision, speech recognition, nature language processing, object recognition, etc. The most successful DNN is deep convolutional neural network consisting of multiple types of layers including convolution, activation,&#8230;<\/p>\n","protected":false},"author":381,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-313","page","type-page","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Efficient Edge AI Algorithm - Deliang Fan<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Efficient Edge AI Algorithm - Deliang Fan\" \/>\n<meta property=\"og:description\" content=\"Deep Neural Network (DNN) is the state-of-the-art neural network computing model that successfully achieves close-to or better than human performance in many large scale cognitive applications, like computer vision, speech recognition, nature language processing, object recognition, etc. The most successful DNN is deep convolutional neural network consisting of multiple types of layers including convolution, activation,...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/\" \/>\n<meta property=\"og:site_name\" content=\"Deliang Fan\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-04T18:59:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"871\" \/>\n\t<meta property=\"og:image:height\" content=\"328\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/\",\"url\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/\",\"name\":\"Efficient Edge AI Algorithm - Deliang Fan\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/wp-content\\\/uploads\\\/sites\\\/201\\\/2019\\\/09\\\/Picture5.jpg\",\"datePublished\":\"2019-09-21T00:13:06+00:00\",\"dateModified\":\"2025-12-04T18:59:32+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/#primaryimage\",\"url\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/wp-content\\\/uploads\\\/sites\\\/201\\\/2019\\\/09\\\/Picture5.jpg\",\"contentUrl\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/wp-content\\\/uploads\\\/sites\\\/201\\\/2019\\\/09\\\/Picture5.jpg\",\"width\":871,\"height\":328},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/deep-learning-neural-network\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Efficient Edge AI Algorithm\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/#website\",\"url\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/\",\"name\":\"Deliang Fan\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/faculty.engineering.asu.edu\\\/dfan\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Efficient Edge AI Algorithm - Deliang Fan","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/","og_locale":"en_US","og_type":"article","og_title":"Efficient Edge AI Algorithm - Deliang Fan","og_description":"Deep Neural Network (DNN) is the state-of-the-art neural network computing model that successfully achieves close-to or better than human performance in many large scale cognitive applications, like computer vision, speech recognition, nature language processing, object recognition, etc. The most successful DNN is deep convolutional neural network consisting of multiple types of layers including convolution, activation,...","og_url":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/","og_site_name":"Deliang Fan","article_modified_time":"2025-12-04T18:59:32+00:00","og_image":[{"width":871,"height":328,"url":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/","url":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/","name":"Efficient Edge AI Algorithm - Deliang Fan","isPartOf":{"@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/#website"},"primaryImageOfPage":{"@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/#primaryimage"},"image":{"@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/#primaryimage"},"thumbnailUrl":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5.jpg","datePublished":"2019-09-21T00:13:06+00:00","dateModified":"2025-12-04T18:59:32+00:00","breadcrumb":{"@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/#primaryimage","url":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5.jpg","contentUrl":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-content\/uploads\/sites\/201\/2019\/09\/Picture5.jpg","width":871,"height":328},{"@type":"BreadcrumbList","@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/deep-learning-neural-network\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/faculty.engineering.asu.edu\/dfan\/"},{"@type":"ListItem","position":2,"name":"Efficient Edge AI Algorithm"}]},{"@type":"WebSite","@id":"https:\/\/faculty.engineering.asu.edu\/dfan\/#website","url":"https:\/\/faculty.engineering.asu.edu\/dfan\/","name":"Deliang Fan","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/faculty.engineering.asu.edu\/dfan\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-json\/wp\/v2\/pages\/313","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-json\/wp\/v2\/users\/381"}],"replies":[{"embeddable":true,"href":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-json\/wp\/v2\/comments?post=313"}],"version-history":[{"count":0,"href":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-json\/wp\/v2\/pages\/313\/revisions"}],"wp:attachment":[{"href":"https:\/\/faculty.engineering.asu.edu\/dfan\/wp-json\/wp\/v2\/media?parent=313"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}