Dr. Zhu is currently the Herbert G. Kayser Professor of Computer Science, at The City College of New York and The CUNY Graduate Center. He is Director of  the City College Visual Computing Laboratory (CcvcL), and Co-Director of  the Master’s Program in Data Science and Engineering, Grove School of Engineering at CCNY. Previously he has been an Associate Professor at Tsinghua University and a Senior Research Fellow at the University of Massachusetts, Amherst. From 1997 to 1999 he was Director of the Information Processing and Application Division in the Computer Science Department at Tsinghua University. 

Dr. Zhu's research expertise spans the areas of 3D computer vision, machine learning, human-computer interaction (HCI), augmented reality, video representations, multimodal sensing and processing, and various applications in education, environment, robotics, surveillance, transportation, security inspection, art analysis and assistive technologies. He has published over 190 peer-reviewed technical papers in the related fields. Currently he is mainly working with various research issues and applications of human and computer vision and multimodal sensing, supported by AFOSR, AFRL, ARO, DHS, NSF, ODNI  as well as industry.

In 2012 Dr. Zhu is named Herbert G. Kayser Chair Professor of Computer Science, a distinction "in recognition of his outstanding achievement as a faculty member in the Grove School of Engineering" at The City College of New York. In May 2013 Professor Zhigang Zhu received President's Award for Excellence, The City College of New York, in the inaugural year of the President's Awards. He is the recipient of CUNY "Certificate of Recognition" yearly from 2004 to now, "Science and Technology Achievement Award" (second prize winner) from Ministry of Electronic Industry China in 1996, "Outstanding Young Teacher in Beijing" in 1997, and "C. C. Lin Applied Mathematics Scholarship" (first prize winner) at Tsinghua in 1997. His Ph.D. thesis " On Environment Modeling for Visual Navigation" was selected in 1999 as a special award in the top 100 dissertations in China over the previous three years, and a book based on his Ph.D. thesis was published by China Higher Education Press in December 2001.

Dr. Zhu is a senior member of the IEEE, a senior member of the ACM, an Associate Editor of the Machine Vision and Applications Journal (2006 - now), and was a Technical Editor, IEEE/ASME Transactions on Mechatronics (09/2010 - 09/2014). He was Co-General Chair of the 2013 IEEE/NSF Workshop on Multimodal and Alternative Perception for Visually Impaired People (MAP4VIP) July 15th, 2013, San Jose, USA, Co-General Chair (with Prof. Thomas S. Huang) of the 2007 IEEE Workshop on Multimodal Sentient Computing, in conjunction with CVPR 2007 in Minneapolis, Minnesota, and Co-Guest Editor (with Prof. Takeo Kanade) of Special Issue on Modeling and Representations of Large Scale 3D Scenes, International Journal of Computer Vision.

• Postdoc (CS), University of Massachusetts at Amherst, 1998-2000
• Ph.D. (CS, with honor ), Tsinghua University, China, 1997
• M.E (CS), Tsinghua University, China, 1991
• B.E. (CS, with honor), Tsinghua University, China, 1988  

• CSC I6716 Computer Vision
• CSC 21200  Data Structures
• CSc 74030 / CNS 80300 Computer Vision and Image Processing, CUNY Graduate Center
• CSc 59866/7 Capstone I/II - BEAT: Branding and Entrepreneurship of Assistive Technology for Social Good
• DSE I9800  & DSE I9900 Data Science and Engineering Master’s Capstone Project/Thesis
• CSc80000 Seminar, 3D Computer Vision and Video Computing, CUNY Graduate Center
• CSc 59866/7 Capstone I/II: CS/CpE/EE Joint Senior Design on Smart Living and Assistive Technologies for People in Need
• CSc 83200  Seminar in Vision, Brain and Assistive Technologies, CUNY Graduate Center

Dr. Zhu's research interests are in the areas of 3D computer vision, human-computer interaction (HCI), augmented and virtual reality, video manipulation, multimodal sensing/processing, and their various applications in education, environment, robotics, surveillance, transportation, security inspection, art analysis and assistive technologies. His most recent research activities include:

• Multimodal (EO/IR/acoustic) target detection/identification and adaptive multimodal sensor designs;
• Design and evaluation of wearable sensing and display systems for people with disabilities;
• Deep learning models and applications in facial computing, crowd analysis and human emotion and brain understanding;
• Smart and Accessible Transportation Hub.

Recent Peer-Reviewed Journal Publications:

( A complete list of papers can be found at the CcvcL Publication Page)

1. Z. Zhu, J. Chen, L. Zhang, Y. Chang, T. Franklin, H. Tang and A. Ruci. iASSIST: An iPhone-Based Multimedia Information System for Indoor Assistive Navigation. International Journal of Multimedia Data Engineering and Management (IJMDEM). Volume 11, Issue 4, November 2020

2. V. Nair, G. Olmschenk, W. H. Seiple, Z. Zhu. ASSIST: Evaluating the Usability and Performance of an Indoor Navigation Assistant for Blind and Visually Impaired People. Assistive Technology, The Official Journal of RESNA. Accepted August 04; Published Online September 02, 2020 (https://doi.org/10.1080/10400435.2020.1809553).

3. G. Olmschenk, Z. Zhu, and H. Tang. Generalizing semi-supervised generative adversarial networks to regression using feature contrasting. Computer Vision and Image Understanding, vol 186,  Elsevier, September 2019 (https://doi.org/10.1016/j.cviu.2019.06.004)

4. Jie Wei, Chi-Him Liu, Zhigang Zhu, Lindsay R. Cain, Vincent J. Velten. Vehicle Engine Classification Using Normalized Tone-Pitch Indexing and Neural Computing on Short Remote Vibration Sensing Data. Expert Systems With Applications (ESWA), Elsevier, Vol 115, Jan 2019, pp 276-286

5. W. Li, F. Abtahi, Z. Zhu and L. Yin, EAC-Net: Deep Nets with Enhancing and Cropping for Facial Action Unit Detection. Special Issue on Computational Face, IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume PP, Issue 99, 10 January 2018 (DOI: 10.1109/TPAMI.2018.2791608).

6. W. Li,  C. Tsangouri, F. Abtahi & Z. Zhu. A Recursive Framework for Expression Recognition: From Web Images to Deep Models to Game Dataset. Machine Vision and Applications. First Online: 12 February 2018. https://doi.org/10.1007/s00138-017-0904-9

7. V. Nair, C. Tsangouri, B. Xiao, G. Olmschenk, W. H. Seiple and Z. Zhu, A Hybrid Indoor Positioning System for Blind and Visually Impaired Using Bluetooth and Google Tango. Journal on Technology and Persons with Disabilities, Volume 6, March 2018, pp 61-81.

8. C. Colena, N. Kashyap, D. Yau, Z. Zhu and C. Cavalluzzi. Panoramik: Finding and Locating Objects via Panoramic Camera Techniques. Journal on Technology and Persons with Disabilities, Volume 6, March 2018, pp 18-31.

9. J. Settineri, F. Shahollari, A. Samdaria, Z. Zhu and C. Cavalluzzi. VR for ASD: Therapeutic Environments for Individuals on the Autism Spectrum. Journal on Technology and Persons with Disabilities, Volume 6, March 2018, pp 1-17.

10. M. Goldberg, Z. Zhu and Z. Zhang. How do We Aid Visually Impaired People Safely Manage Unfamiliar Environments? Journal on Technology and Persons with Disabilities, Volume 6, March 2018, pp 261-272.

11. F. Hu, Z. Zhu, J. Mejia, H. Tang and J. Zhang. Real-time indoor assistive localization with mobile omnidirectional vision and cloud GPU acceleration, AIMS Electronics and Electronic Engineering, December, 2017, 1(1), 74-99.

12. Tang, H., Amuneke, T., Zou, H., Zhu, Z. Indoor Map Learning for the Visually Impaired, Journal on Technology and Persons with Disabilities, V5. June 2017

13. M. Vincent, H. Tang, W. L. Khoo, Z. Zhu, T. Ro. Shape Discrimination using the Tongue: Implications for a Visual-to-Tactile Sensory Substitution Device. Multisensory Research, 29(8), October 2016, pp. 773-798. DOI: 10.1163/22134808-00002542

14. W. L. Khoo, Z. Zhu, Multimodal and Alternative Perception for the Visually Impaired: A Survey, Journal of Assistive Technologies, Vol. 10 Iss: 1, pp.11-26, 2016. http://dx.doi.org/10.1108/JAT-04-2015-0014

15. F. Hu, N. Tsering, H. Tang, and Z. Zhu. Indoor Localization for the Visually Impaired Using a 3D Sensor. Journal on Technology and Persons with Disabilities. Vol. 4. Nov. 2016.

16. H. Tang, N. Tsering, F. Hu, and Z. Zhu. Automatic Pre-Journey Indoor Map Generation Using AutoCAD Floor Plan. Journal on Technology and Persons with Disabilities. Vol. 4. Oct. 2016

17. E. Molina and Z. Zhu, Persistent Aerial Video Registration and Fast Multi-view Mosaicing, IEEE Transactions on Image Processing, 23 (2014), no. 5, pp.2184-2192

18. E. Molina, A. Diallo, Z. Zhu, Visual Noun Navigation Framework for the Blind, Journal of Assistive Technologies, Vol. 7 Iss: 2, 2013, pp.118 - 130

19. W. L. Khoo, F. Plamer, J. Knapp, Z. Zhu, T. Ro, Designing and Testing Wearable Range-Vibrotactile Devices, Journal of Assistive Technologies, Vol. 7 Iss: 2, 2013, pp.102 - 117

20. T. Wang, Z. Zhu and C. Taylor, A multimodal temporal panorama approach for moving vehicle detection, reconstruction and classification, Computer Vision and Image Understanding, Special Issue on Machine Vision Beyond Visible Spectrum, vol 117, Iss 12, December 2013, pp 1724–1735. http://dx.doi.org/10.1016/j.cviu.2013.02.011.

21. H. Tang and Z. Zhu, Content-Based 3D Mosaics for Representing Videos of Dynamic Urban Scenes, IEEE Transactions on Circuits and Systems for Video Technology, 22(2), 295-308, 2012. DOI: 10.1109/TCSVT.2011.2178729 .

22. R. Li, N. Madampoulos, Z. Zhu, and L. Xie, Performance comparison of an all-fiber-based laser Doppler vibrometer for remote acoustical signal detection using short and long coherence length lasers, Applied Optics, Vol. 51, Issue 21, pp. 5011-5018 (2012). http://dx.doi.org/10.1364/AO.51.005011

23. R. Li, T. Wang, Z. Zhu, and W. Xiao, Vibration Characteristics of Various Surfaces Using an LDV for Long-Range Voice Acquisition, IEEE Sensor Journal, vol 11, no 6, June 2011, pp 1415 - 1422

24. Y. Qu, T. Wang and Z. Zhu, Vision-aided Laser Doppler Vibrometry for Remote Automatic Voice Detection, IEEE/ASME Transactions on Mechatronics, vol 16, no 6.December 2011, pp. 1110-1119

25. T. Wang, Z. Zhu, E. Blasch, Bio-Inspired Adaptive Hyperspectral Imaging for Target Tracking, IEEE Sensors Journal, Special issue on Enhancement Algorithms, Methodologies & Technology for Spectral Sensing, vol 10, no 3, March 2010,  pp. 647-654.

26. D. R. Karuppiah, R. A. Grupen, Z. Zhu and A. R. Hanson, Automatic Resource Allocation in a Distributed Camera Network, Machine Vision and Applications, Volume 21, Issue 4 (2010), Page 517-528, http://dx.doi.org/10.1007/s00138-008-0182-7

27. Z. Zhu, Y.-C. Hu and L. Zhao, Gamma/X-Ray Linear Pushbroom Stereo for 3D Cargo Inspection, Machine Vision and Applications, Volume 21, Issue 4 (2010), Page 413-425, http://dx.doi.org/10.1007/s00138-008-0173-8

28. Z. Zhu and T. Kanade, Editorial: Modeling and Representations of Large-Scale 3D Scenes, International Journal of Computer Vision, Volume 78, Numbers 2-3 / July, 2008, pp 119-120. http://dx.doi.org/ 10.1007/s11263-008-0128-6

29. Z.  Zhu, A. R. Hanson, Mosaic-based 3D scene representation and rendering, Signal Processing: Image Communication, Special Issue on Interactive Representation of Still and Dynamic Scenes,  Elsevier, vol 21, no 6, Oct, 2006, pp. 739-754. doi:10.1016/j.image.2006.08.002.

30. Z. Zhu. G. Xu, E. Riseman and A. Hanson, Fast Construction of Dynamic and Multi-Resolution 360-degree Panoramas from Video Sequences. Image & Vision Computing Journal, Volume 24, Issue 1, 1 January 2006, pp 13-26.

31. Z. Zhu, E. M. Riseman, A. R. Hanson and H. Schultz, An Efficient Method for Geo-Referenced Video Mosaicing for Environmental Monitoring.  Machine Vision Applications Journal, Springer-Verlag, 16(4): 203-216, 2005.

32. Z. Zhu, G. Xu and X. Lin, Efficient Fourier-Based Approach for Detecting Orientations and Occlusions in Epipolar Plane Images for 3D Scene Modeling, International Journal of Computer Vision, 61 (3): 233-258, February - March, 2005.

33. Z. Zhu, and A. R. Hanson, LAMP: 3D Layered, Adaptive-Resolution and Multi-Perspective Panorama - a New Scene Representation, Computer Vision and Image Understanding, Special Issue on Model-based and Image-based 3D Scene Representation for Interactive Visualization, 96 (3), December 2004, pp 294–326

34. Z. Zhu, D. R. Karuppiah, E. M. Riseman and A. R. Hanson, Keep Smart, Omnidirectional Eyes on You - Adaptive Panoramic Stereo Vision for Human Tracking with Cooperative Mobile Robots.  Robotics and Automation Magazine, Special Issue on Panoramic Robots, vol 14, no 11, December 2004, pp 69-78

35. Z. Zhu, D. Karuppiah, E. M. Riseman and A. R. Hanson, Dynamic Mutual Calibration and View Planning for Cooperative Mobile Robots with Panoramic Virtual Stereo Vision, Computer Vision and Image Understanding, 95 (3), September 2004, pp 261-286.

36. Z. Zhu, E. M. Riseman, A. R. Hanson, Generalized Parallel-Perspective Stereo Mosaics from Airborne Videos, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 2, Feb 2004, pp 226-237.

37. J. S. Jin, Z. Zhu, G. Xu, Digital Video Sequence Stabilization Based on 2.5D Motion Estimation and Inertial Motion Filtering, Real-Time Imaging Journal, Vol. 7, No. 4, August 2001, Academic Press, pp. 357-365

38. Z. Zhu, G. Xu, B. Yang, D. Shi, X. Lin, VISATRAM: A real-time vision system for automatic traffic monitoring, Image and Vision Computing Journal, 18(10), July 2000: pp 781-794.

39. J. S. Jin, Z. Zhu, G. Xu, A stable vision system for moving vehicles, IEEE Transactions on Intelligent Transportation Systems, vol. 1, no. 1, March 2000, pp 32-39.