| | | | | | | |

SEAN K. BANERJEE

Assistant Professor, Department of Computer Science
Clarkson University, Potsdam, NY
Email: sbanerje "symbolthatisat" clarkson "symbolthatisdot" edu

Co-Director Terascale All-sensing Research Studio (TARS)
Studio Website: http://tars.clarkson.edu

RESEARCH

Funding:
PI on NSF CRI II-NEW: IIS: Omniview Multi-modal Sensor Laboratory for Understanding Human Interactions in Ubiquitous Environments, $746,916 (2017).
Co-PI on NSF CITeR Single-shot contact-less fingerprints, $20,000 (2017).
Co-PI on Acumen Detection LLC Validation of Biometric Identification of Dairy Cows based on Udder Vein Images, $40,000 (2017).
Co-PI on Acumen Detection LLC Biometric Identification of Dairy Cows based on Udder Vein Images Pilot Study, $14,950 (2016).

The democratization of technologies such as the Internet, social media, smart consumer devices, and sensors has enabled the generation of vast quantities of data on human behavior in a variety of forms such as text, video, and audio in online and real-world environments, enabling the use of this data for a large range of applications. My research spans the fields of human-computer interaction, linguistics, and machine learning, and uses both human and sensor data to provide automation in fields such as software engineering, robotics, biometrics, and physical therapy. I co-direct the Terascale All-sensing Research Studio (TARS) at Clarkson University with Dr. Natasha Banerjee.

PUBLICATIONS:

  1. A. Kupin, B. Moeller, Y. Jiang, N. K. Banerjee, S. Banerjee, "Task-Driven Biometric Authentication of Users in Virtual Reality (VR) Environments", 25th International Conference on Multimedia Modeling (MMM 2019), 2019. (Best Paper Candidate)
  2. J. Ryan, S. Inzerillo, J. Helmick, A. Boolani, N. K. Banerjee, S. Banerjee, "Predicting If Older Adults Perform Cognitive Tasks Using Body Joint Movements From RGB-D Videos", 11th International Conference on eHealth, Telemedicine, and Social Medicine (eTELEMED 2019), 2019.
  3. Y. Jiang, S. Banerjee, N. K. Banerjee, "Predicting Human Grasp Locations on Cup Handles by Using Deep Neural Networks to Infer Heat Signatures from Depth Data", International Conference on Multimedia and Expo Workshop (ICMEW 2019), 2019.
  4. Y. Jiang, E. Schenck, S. Kranz, S. Banerjee, N. K. Banerjee, "CNN-Based Non-Contact Detection of Food Level in Bottles from RGB Images", 25th International Conference on Multimedia Modeling (MMM 2019), 2019.
  5. Z. Syed, J. Helmick, S. Banerjee, B. Cukic, "Touch Gesture-based Authentication on Mobile Devices: A Study of the Effects of User Posture, Device Size, Configuration, and Inter-session Variability", Journal of Systems and Software, 2019.
  6. H. Joo, T. Simon, X. Li, H. Liu, L. Tan, L. Gui, S. Banerjee, T. Godisart, B. Nabbe, I. Matthews, T. Kanade, S. Nobuhara, and Y. Sheikh, "Panoptic Studio: A Massively Multiview System for Social Interaction Capture”, Transactions on Pattern Analysis and Machine Intelligence, 2019.
  7. D. Gwinn, J. Helmick, N. K. Banerjee, S. Banerjee, "Optimal Estimation of Census Block Group Clusters to Improve the Computational Efficiency of Drive Time Calculations", 4th International Conference on Geographical Information Systems Theory, Applications and Management (GISTAM), 2018.
  8. Y. Jiang, D. Russell, T. Godisart, N. K. Banerjee, and S. Banerjee, "Hardware Synchronization of Multiple Kinects and Microphones for 3D Audiovisual Spatiotemporal Data Capture", International Conference on Multimedia and Expo (ICME 2018), 2018.
  9. L. Guo, H. Quant, N. Lamb, B. Lowit, N. K. Banerjee, and S. Banerjee, "Multi-Camera Microenvironment to Capture Multi-view Time-lapse Videos for 3D Analysis of Aging Objects", 24th International Conference on Multimedia Modeling (MMM 2018), 2018.
  10. N. Lamb, N. K. Banerjee, and S. Banerjee, "Programmatic 3D Printing of a Revolving Camera Track to Automatically Capture Dense Images for 3D Scanning of Objects", 24th International Conference on Multimedia Modeling (MMM 2018), 2018.
  11. T. Dunn, S. Banerjee, N. K. Banerjee, "User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction", 20th International Workshop on Multimedia Signal Processing (MMSP 2018), 2018. (Top 5% Paper Award)
  12. Y. Jiang, M. Luo, S. Banerjee, N. K. Banerjee, "When Will Breakfast Be Ready: Temporal Prediction of Food Readiness Using Deep Convolutional Neural Networks on Thermal Videos", International Conference on Multimedia and Expo Workshop (ICMEW 2018), 2018.
  13. H. Quant, S. Banerjee, and N. K. Banerjee, "A Virtual Reality Interface for Interactions with Spatiotemporal 3D Data", 24th International Conference on Multimedia Modeling (MMM 2018), 2018.
  14. L. Guo, H. Quant, N. Lamb, B. Lowit, S. Banerjee, and N. K. Banerjee, "Spatiotemporal 3D Models of Aging Fruit from Multi-View Time-Lapse Videos", 24th International Conference on Multimedia Modeling (MMM 2018), 2018.
  15. B. Schilling, K. Bahmani, B. Li, S. Banerjee, J. S. Smith, T. Moshier, S. Schuckers, "Validation of Biometric Identification of Dairy Cows based on Udder NIR Images", 9th International Conference on Biometrics: Theory, Applications, and Systems (BTAS 2018), 2018.
  16. S. Banerjee, Z. Syed, J. Helmick, M. Culp, K. Ryan, B. Cukic, "Automated triaging of very large bug repositories", Journal of Information and Software Technology, 2017.
  17. N. K. Banerjee, M. Simms, S. Banerjee, "Image-based Keyword Search and Activity Retrieval for Social Media Forensics", Annual Symposium on Information Assurance (ASIA 2017), 2017
  18. Z. Syed, S. Banerjee, B. Cukic, "Normalizing Variations in Feature Vector Structure in Keystroke-dynamics Authentication Systems", Software Quality Journal, 2016.
  19. T. Fanelli, S. Simons, S. Banerjee, "A Systematic Framework for Modernizing Legacy Application Systems", 23rd International. Conference of Sofware Analysis, Evolution, and Reengineering - Industry Track (SANER 2016), 2016.
  20. Y. Gao, D. Hou, N. K. Banerjee, S. Banerjee, "Water Fixture Identification in Smart Housing: A Domain Knowledge Based Case Study", 15th International Conference on Machine Learning and Applications (ICMLA 2016), 2016.
  21. Y. Gao, D. Hou, S. Banerjee, "Fixture Identification from Aggregated Hot Water Consumption Data", 2nd International Smart Cities Conference (ISC2 2016), 2016.
  22. T. Dunn, N. K. Banerjee, S. Banerjee, "GPU Acceleration of Document Similarity Measures for Automated Bug Triaging", 1st International Workshop on Software Faults (co-located with 27th International Symposium on Software Reliability Engineering) (IWSF 2016), 2016.
  23. N. Palaskar, Z. Syed, S. Banerjee, C. Tang, "Empirical Techniques to Detect and Mitigate the Effects of Irrevocably Evolving User Profiles in Touch-based Authentication Systems", IEEE International High Assurance Systems Engineering Symposium (HASE 2016), 2016.
  24. H. Joo, T. Simon, X. Li, H. Liu, L. Tan, L. Gui, S. Banerjee, T. Godisart, B. Nabbe, I. Matthews, T. Kanade, S. Nobuhara, and Y. Sheikh, "Panoptic Studio: A Massively Multiview System for Social Interaction Capture", 2nd Workshop on Advancements in Social Signal Processing for Multimodal Interaction (co-located with 18th ACM International Conference on Multimodal Interaction) (ASSP4MI2016), 2016.
  25. S. Banerjee, B. Cukic, "On the cost of mining very large open source repositories", 1st International. Workshop on Big Data Software Engineering (co-located with 37th International Conference on Software Engineering) (BIGDSE 2015), 2015.
  26. S. Banerjee, J. Helmick, Z. Syed, B. Cukic, "Eclipse vs. Mozilla: A Comparison of Two Large-Scale Open Source Problem Report Repositories", IEEE International High Assurance Systems Engineering Symposium (HASE 2015), 2015.
  27. Z. Syed, J. Helmick, S. Banerjee, B. Cukic, "Effect of User Posture and Device Size on the Performance of Touch-based Authentication Systems", IEEE International High Assurance Systems Engineering Symposium (HASE 2015), 2015.
  28. S. Banerjee, Z. Syed, N. Kalka, B. Cukic, "Keystroke Recognition”, Encyclopedia of Biometrics 2nd Edition, 2014.
  29. Z. Syed, S. Banerjee, B. Cukic, "Leveraging variations in event sequences in keystroke-dynamics authentication systems", IEEE International High Assurance Systems Engineering Symposium (HASE 2014), 2014.
  30. Z. Syed, S. Banerjee, B. Cukic, "Continual Authentication", Biometrics Technology Today, 2014.
  31. Z. Syed, S. Banerjee, B. Cukic, "Pointer-based Recognition", Encyclopedia of Biometrics 2nd Edition, 2014.
  32. S. Banerjee, Z. Syed, J. Helmick, B. Cukic, "A Fusion Approach For Classifying Duplicate Problem Reports", International Symposium on Software Reliability Engineering (ISSRE 2013), 2013.
  33. H. Srikanth, S. Banerjee, L. Williams, J. Osborne, "Towards the prioritization of system test cases", Software Testing, Verification and Reliability, June 2013.
  34. H. Srikanth, S. Banerjee, "Improving test efficiency through system test prioritization", Journal of Systems and Software, May 2012.
  35. S. Banerjee, B. Cukic, D. Adjeroh, "Automated Duplicate Bug Report Classification using Subsequence Matching", IEEE International High Assurance Systems Engineering Symposium (HASE 2012), 2012.
  36. S. Banerjee, J. Musgrove, B. Cukic, "Handling Language Variations in Open Source Bug Reporting Systems",2nd International. Workshop on Open Systems Dependability: Adaptation to Changing World (WOSD 2012), 2012.
  37. S. Banerjee, H. Srikanth, B. Cukic, "Challenges for creating highly dependable service based systems", IEEE International Workshop on Object/component/service-oriented Real-time Networked Ultra-dependable Systems (WORNUS 2011), 2011.
  38. T. Prifti, S. Banerjee, B. Cukic, "Detecting Bug Duplicate Reports through Locality of Reference", International Conference on Predictive Models in Software Engineering (PROMISE 2011), 2011.
  39. Z. Syed, S. Banerjee, Q. Cheng, B. Cukic, "Effects of user habituation in keystroke dynamics on password security policy", IEEE International High Assurance Systems Engineering Symposium (HASE 2011), 2011 (Best Paper Award).
  40. S. Banerjee, H. Srikanth, B. Cukic, "Log-based analysis of software as a service (SaaS)", International Symposium on Software Reliability Engineering (ISSRE 2010), 2010.

TEACHING:

Spring 2019: CS 141 - Introduction to Computer Science I
Spring 2019: CS 350 - Software Design and Development
Spring 2019: CS 459/559 - Human Computer Interaction

Fall 2018: CS 141 - Introduction to Computer Science I
Fall 2018: CS 350 - Software Design and Development

Spring 2018: CS 141 - Introduction to Computer Science I
Spring 2018: CS 459/559 - Human Computer Interaction

Fall 2017: CS 141 - Introduction to Computer Science I
Fall 2017: CS 350 - Software Design and Development

Spring 2017: EE 368/563 - Software Engineering

Fall 2016: EE 261 - Introduction to Programming and Software Design
Fall 2016: EE 418 - Software Engineering Senior Design

Spring 2016: EE 575 - Empirical Methods in Software Engineering

Fall 2015: EE 261 - Introduction to Programming and Software Design
Fall 2015: EE 360 - Microprocessors (co-taught with Dr. Abul Khondker)

STUDENTS

I co-advise several students with Natasha Banerjee

Postdoctoral Associate:
Dr. SOUMYABRATA DEY, Ph.D. Computer Science from University of Central Florida

PhD Students:
YIJUN JIANG, Computer Science
COREY PENTASUGLIA, Computer Science
GENNADY STASKEVICH, Computer Science

MS Students:
MIAO LUO, Computer Science

BS Students:
ALEX KUPIN, Computer Science
ASHWIN AJIT, Clarkson School, Computer Science
BEN MOELLER, Computer Science
BEN MYRICK, Computer Science / Mathematics CHANDLER KENT, Computer Engineering
DAMON GWINN, Computer Science
DAVID RUSSELL, Honors Program, Computer Science
DOMINICK MILLER, Computer Science
EMMANUEL ESPARZA, Electrical Engineering
HANNAH DEFAZIO, Honors Program, Computer Science / Mathematics
HARRISON WALKER, Clarkson School, Mechanical Engineering
HEET DAVE, Computer Science
JACOB GATELY, Honors Program, Computer Science / Computer Engineering
JENNA RYAN, Honors Program, Computer Science / Mathematics
JOSH GILLETTE, Computer Science
JUSTIN OPINI, Honors Program, Computer Science
KYLE FITZGERALD, Honors Program, Mechanical Engineering
MATT RODMAN, Electrical Engineering
NICK PASCUA, Mechanical Engineering
NIKOLAS LAMB, Computer Science
REED WATSON, Mechanical Engineering
RYAN MARSHALL, Computer Science / Mathematics
SARAH INZERILLO, Honors Program, Computer Science
THOMAS KING, Honors Program, Computer Science
TIM DUNN, Honors Program, Computer Science / Electrical Engineering
ZACHARY CHAPMAN, Electrical Engineering

Former Students:
MARC BISHOP, AFRL
MATTHEW INKAWHICH, PhD student at Duke
BENJAMIN LOWIT, Epic Systems
GUS NAUGHTON, GE
SCOTT STRAW, Ensign-Bickford Aerospace & Defense Company

Student accomplishments:
Nikolas Lamb: 2019 National Science Foundation (NSF) Graduate Research Fellowship (GRF) award winner. First Clarkson University Department of Computer Science student to win the award while still an undergraduate at Clarkson University. Nikolas will be starting his Ph.D. at Lehigh University under the guidance of Dr. Mooi Choo Chuah

Alex Kupin and Ben Moeller: Best Paper Candidate at the 2019 International Conference on Multimedia Modeling (co-advised with Dr. Natasha Banerjee)

Tim Dunn: Top 5% Paper Award at the 2018 Workshop on Multimedia Signal Processing (co-advised with Dr. Natasha Banerjee)

David Russell: 2018 Goldwater Scholar (co-advised with Dr. Natasha Banerjee)

Tim Dunn: 2017 Goldwater Scholar (co-advised with Dr. Natasha Banerjee)


2018 Summer RAPS Conference
Jenna Ryan: Best Presentation in the Human Movement Session
Hannah DeFazio and Laith Shamieh: Honorable Mention in the Computer Science and Engineering Poster Session

2017 Spring RAPS Conference
Damon Gwinn: Best Presentation in the Computer Science and Software Engineering I Session
Eric Sognefest and Jared Heidt: Best Presentation in the Computer Science and Software Engineering I Session
Nikolas Lamb and Andrew Davis: Best Presentation in the Computer Science and Software Engineering II Session
Adam Scott: Best Presentation in the Computer Science and Software Engineering II Session
Hunter Quant and Jack Broderick: Best Presentation in the Computer Vision and Biometrics I Session
Yijun Jiang: Best Presentation in the Computer Vision and Biometrics II Session

2016 Summer SURE Conference
David Russell: Best Presentation in the Imaging Session
Tim Dunn: Best Poster in the Electrical Engineering, Computer Science and Signal Processing Session
David Russell: Runner Up in the Imaging Systems Poster Session
Tim Dunn: Honorable Mention in the Applied Mathematics and Data Processing Presentation Session
David Skufca: Honorable Mention in the Computer Science Presentation Session
Robert Newman: Honorable Mention in the Computer Science Presentation Session

2016 Spring SURE Conference
David Skufca: Best Presentation Award in the Math and Computer Science Session

SERVICE

Institutional:
Senate Member, Arts and Sciences

Program Committee:
International Symposium on Software Reliability Engineering (ISSRE), 2018
High Assurance Systems Engineering Symposium (HASE), 2015, 2017, 2019
Software Quality Assurance (SQA), 2015

Reviewer:
Software Testing, Verification, and Reliability (STVR), 2018
ACM Multimedia Conference (ACMMM), 2015
Journal of Systems and Software (JSS), 2012, 2014
IET Software, 2013
Symposium on Reliable, Dependable Systems (SRDS), 2013, 2014
Fundamental Approaches to Software Engineering (FASE), 2013
International Symposium on Software Reliability Engineering (ISSRE), 2010-2014, 2018
Dependable Systems and Networks (DSN), 2011-2013
Predictive Models in Software Engineering (PROMISE), 2011
High Assurance Systems Engineering Symposium (HASE), 2011-2015

Support Staff:
International Symposium on Software Reliability Engineering (ISSRE), 2013 - WebEX Team
Predictive Models in Software Engineering (PROMISE), 2009 – Website

TALKS

SUNY ALBANY SEMINAR SERIES, Understanding and Using Interactions of People in Real and Virtual Environments, May 2019
AIR FORCE RESEARCH LABORATORY, Understanding and Using Interactions of People in Real and Virtual Environments, February 2019
GRIFFISS INSTITUTE DINE AND DEVELOPMENT SERIES, Understanding and Using Interactions of People in Real and Virtual Environments, October 2018
RIT CENTER FOR IMAGING SCIENCE SEMINAR, Collecting Large Quantities of Data using Dense Multi-sensor Environments, Apr 2017
CLARKSON UNIVERSITY FALL OPEN HOUSE, Research and Careers in Software Engineering, Oct 2016
NORWOOD/NORFOLK HIGH SCHOOL: Careers in Software Engineering, May 2016
CLARKSON UNIVERSITY SPRING OPEN HOUSE, Research and Careers in Software Engineering, Apr 2016
POTSDAM CENTRAL HIGH SCHOOL: Bugs and Interfaces, Feb 2016
HUMAN COMPUTER INTERACTION: Deadly Interfaces, Jan 2016
SUNY POTSDAM: Human Centric Approaches to Improving Software Engineering Methodologies, Nov 2015
GRADUATE RESEARCH SYMPOSIUM: Panel on navigating the academic job market, Oct 2015

PRESS

Potsdam couple offers 3D models, North Country Now, November 2016
Student groups discuss alternative fuels, emissions, The Daily Athenaeum, October 2010.

BIOGRAPHY

Dr. Sean Banerjee is an Assistant Professor at Clarkson University in Potsdam, New York. At Clarkson he is co-founder and co-director of the Terascale All-sensing Research Studio. Prior to coming to Clarkson, Sean was a post-doctoral researcher at the Robotics Institute in Carnegie Mellon University in Pittsburgh, Pennsylvania. He received his Ph.D, M.S. and B.S. from West Virginia University in 2014, 2006 and 2004 respectively. His research lies at the intersection of software engineering, machine learning, natural language processing and human-machine interaction. He was a co-author on the MMSP 2018 Top 5% Paper titled "User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction", MMM 2019 Best Paper Candidate titled "Task-Driven Biometric Authentication of Users in Virtual Reality (VR) Environments" and the HASE 2011 Best Paper titled "Effects of user habituation in keystroke dynamics on password security policy". During his free time Sean is usually found building something with his spouse and research partner Dr. Natasha Kholgade Banerjee. From 2005 to 2011, Sean actively competed in regional and national level autocrosses, time trials, and karting. He enjoyed success at the regional level, winning the GS championship in the Southern WV region in 2006 and the STS2 championship in Steel Cities region in 2008. In 2008, Sean set the track record in STS2 at the Wilson Circuit Time Trial. In 2011, he obtained his SCCA Novice Racing License. Sean was also crew chief, data analyst and crew member for several sprint and endurance racing teams which won several amateur motorsport championships.