Top

ABOUT TARS

DIRECTORS

Natasha Banerjee
Associate Professor
Computer Science
Sean Banerjee
Associate Professor
Computer Science

At the Terascale All-sensing Research Studio (TARS) at Clarkson University, we perform research in human-driven artificial intelligence using capture and analysis of dense multi-person interactions in online and real-world environments. Our studio houses a dense multi-modal sensing space consisting of 16 Kinect sensors, 240 226-FPS color cameras, 16 thermal cameras, and 16 sEMG sensors. It also houses several multi-Raspberry Pi camera microenvironments, six VR systems, two 3D scanners (one laser scanner and one photogrammetry-based scanner 3D-printed by us in-house), and five 3D printers (four Cartesian dual-extrusion 3D printer and a Delta 3D printer assembled by us from a kit). The studio contains multiple servers and a 160 TB in-house data center. Our research spans computer vision, deep learning, robotics, linguistics, computer graphics, human-computer interaction, and software engineering. The studio is funded through multiple NSF grants.

Our students have received the NSF GRF and Goldwater Scholarships, and have won several awards at international conferences, Clarkson Computer Science and School of Arts and Sciences, and the Clarkson SURE and RAPS conferences. They have done REUs and PhDs at renowned academic institutions within the US and internationally, and have had internships, co-ops, and full-time positions at a wide range of companies. Scroll through to see the research areas we work on. We are actively hiring graduate and undergraduate researchers of high caliber to perform research at the studio. Contact either Dr. Sean Banerjee (sbanerje a clarkson d edu) or Dr. Natasha Banerjee (nbanerje a clarkson d edu) to determine research opportunities with the studio, or to schedule a visit.

PUBLICATIONS

VR / AR. R. Miller, N. K. Banerjee, and S. Banerjee (2020). Within-System and Cross-System Behavior-Based Biometric Authentication in Virtual Reality. IEEE Conference on Virtual Reality and 3D User Interfaces Workshops (VRW), Atlanta, Georgia.

[PDF]

VR / AR. J. Gately, Y. Liang, M. K. Wright, N. K. Banerjee, S. Banerjee, and S. Dey (2020). Automatic Material Classification Using Thermal Finger Impression. International Conference on Multimedia Modeling (MMM), Daejeon, Korea.

[PDF]

VR / AR. R. Miller, A. Ajit, N. K. Banerjee, and S. Banerjee (2019). Realtime Behavior-Based Continual Authentication of Users in Virtual Reality Environments. IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), San Diego, California.

[PDF]  [Video]

VR / AR. A. Ajit, N. K. Banerjee, and S. Banerjee (2019). Combining Pairwise Feature Matches from Device Trajectories for Biometric Authentication in Virtual Reality Environments. IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), San Diego, California [Best Student Paper].

[PDF]

3D PRINTING + SCANNING. N. Lamb, S. Banerjee, and N. K. Banerjee (2019). Automated Reconstruction of Smoothly Joining 3D Printed Restorations to Fix Broken Objects. ACM Symposium on Computational Fabrication (SCF), Pittsburgh, Pennsylvania.

[PDF]  [Presentation]  [Video]

ASSISTIVE AI. Y. Jiang, S. Banerjee, and N. K. Banerjee (2019). Predicting Human Grasp Locations on Cup Handles by Using Deep Neural Networks to Infer Heat Signatures from Depth Data. IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Shanghai, China.

[PDF]

ASSISTIVE AI. J. Ryan, S. Inzerillo, J. Helmick, A. Boolani, N. K. Banerjee, and S. Banerjee (2019). Predicting If Older Adults Perform Cognitive Tasks Using Body Joint Movements From RGB-D Videos. The Eleventh International Conference on eHealth, Telemedicine, and Social Medicine (eTELEMED), Athens, Greece.

[PDF]

VR / AR. A. Kupin, B. Moeller, N. K. Banerjee, and S. Banerjee (2019). Task-Driven Biometric Authentication of Users in Virtual Reality (VR) Environments. International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece [Best Paper Candidate].

[PDF]

ASSISTIVE AI. Y. Jiang, E. Schenck, S. Kranz, S. Banerjee, and N. K. Banerjee (2019). CNN-Based Non-Contact Detection of Food Level in Bottles from RGB Images. International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece.

[PDF]

ASSISTIVE AI. Y. Jiang, M. Luo, S. Banerjee, and N. K. Banerjee (2018). When Will Breakfast Be Ready: Temporal Prediction of Food Readiness Using Deep Convolutional Neural Networks on Thermal Videos. IEEE Intl. Conf. on Multimedia and Expo Workshops (ICMEW), San Diego, CA.

[PDF]

VR / AR. T. Dunn, S. Banerjee, and N. K. Banerjee (2018). User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction. International Workshop on Multimedia Signal Processing (MMSP), Vancouver, Canada [Top 5% Paper Award].

[PDF]

MULTI-SENSOR SYSTEMS. Y. Jiang, D. Russell, T. Godisart, N. K. Banerjee, and S. Banerjee (2018). Hardware Synchronization of Multiple Kinects and Microphones for 3D Audiovisual Spatiotemporal Data Capture. IEEE International Conference on Multimedia and Expo (ICME), San Diego, California.

[PDF]

MULTI-SENSOR SYSTEMS. L. Guo, H. Quant, N. Lamb, B. Lowit, N. K. Banerjee, and S. Banerjee (2018). Multi-Camera Microenvironment to Capture Multi-view Time-lapse Videos for 3D Analysis of Aging Objects. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]  [Video]

MULTI-SENSOR SYSTEMS. L. Guo, H. Quant, N. Lamb, B. Lowit, S. Banerjee, and N. K. Banerjee (2018). Spatiotemporal 3D Models of Aging Fruit from Multi-View Time-Lapse Videos. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]

3D PRINTING + SCANNING. N. Lamb, N. K. Banerjee, and S. Banerjee (2018). Programmatic 3D Printing of a Revolving Camera Track to Automatically Capture Dense Images for 3D Scanning of Objects. Intl. Conf. on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]  [Video]

VR / AR. H. Quant, S. Banerjee, and N. K. Banerjee (2018). A virtual reality interface for interactions with spatiotemporal 3D data. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]  [Video]

APPLIED ML. D. Gwinn, J. Helmick, N. K. Banerjee, and S. Banerjee (2018). Optimal Estimation of Census Block Group Clusters to Improve the Computational Efficiency of Drive Time Calculations. Intl. Conf. on Geographical Information Systems Theory, Applications and Management (GISTAM), Madeira, Portugal.

[PDF]

APPLIED ML. T. Dunn, N. K. Banerjee, and S. Banerjee (2016). GPU acceleration of document similarity measures for automated bug triaging. International Workshop on Software Faults (co-located with IEEE International Symposium on Software Reliability Engineering, ISSRE), Ottawa, Canada.

[PDF]

PEOPLE

GRADUATE STUDENTS

Yijun Jiang
PhD
Computer Science
Joseph Judge
PhD
Computer Science
Subhasish Malik
PhD
Computer Science
Robert Miller
MS
Computer Science

COLLABORATORS

Dr. Tracy Lipke-Perry
Assistant Professor
Functional Keyboard, Crane School of Music
Dr. Ajit Achuthan
Associate Professor
Mechanical Engineering, Clarkson University

UNDERGRADUATE STUDENTS

Joshua Beha
Computer Engineering
Colin Braningan
Mechanical Engineering
Rosalina Delwiche
Computer Science
Abigail DeFranco
Computer Science
Austin Dykeman
Computer Science
Nathan Hayes
Computer Science
Cameron Hood
Computer Science
Collin Fitzgerald
Computer Science
Jacob Friz-Trillo
Electrical Engineering
Evan Fuller
Computer Science
Kyle Fuller
Computer Science
Tim Guyer
Software Engineering
Sarah Inzerillo
Computer Science
Alif Jakir
Computer Science
Chandler Kent
Computer Engineering
Peter-John King
Computer Science
Alex Kupin
Computer Science
Jack Lamuraglia
Electrical Engineering
Anthony Lombardi
Computer Science
Ryan Marshall
Computer Science
Holly Rossmann
Computer Science
Jenna Ryan
Computer Science
Cono Sammarco
Electrical Engineering / Physics
Elim Schenck
Computer Engineering / Computer Science
Andrew Shaw
Computer Science
Andrew Stephens
Computer Science
David Teska
Mechanical Engineering
Alaina Tulskie
Computer Science
Tanner Wallis
Mechanical Engineering
Reed Watson
Mechanical Engineering
Devan Weaver
Mechanical Engineering

PRESS

Copyright © Natasha Kholgade Banerjee. All rights reserved.