ANNOUNCEMENTS (scroll for more)

05/21/2019: Our paper (first author Nik) on fixing broken objects using 3D printed restorations has now been accepted to ACM SCF 2019.

05/16/2019: Congrats to our seniors (Nik, Damon, Tim, and Ben) on graduation.

05/06/2019: Congratulations to Nikolas Lamb on receiving the NSF GRF! He is one of 16 students in the Computational Science and Engineering division to receive the award.

05/06/2019: Congratulations to Jenna on her REU at Temple, Sarah Inzerillo for her GE co-op, Nikolas for his Qualcomm internship, and Damon for his SRC internship.

01/31/2019: Soumya is now offering a new course on Image Understanding through TARS on Tuesdays at 5:30 PM.

01/31/2019: Congratulations to Jenna Ryan for a Goldwater Scholarship Nomination, and for having her paper accepted at eTELEMED 2019!

01/31/2019: Congratulations to Alex Kupin, Ben Moeller, Yijun Jiang, and Elim Schenck for their papers being accepted at MMM 2019! Congrats to Alex and Ben for their paper being a Best Paper Candidate!

01/31/2019: Congratulations to Jenna Ryan for her co-op at GE Power, Hannah DeFazio for her co-op at Kitware, Ben Myrick for his summer internship at SRC, and Elim Schenck for his summer internship at CACI.

12/21/2018: Welcome to our post-doctoral associate, Soumyabrata Dey! Soumya has a PhD from University of Central Florida, and has had four years of experience working at Samsung Research and Carl Zeiss.

08/30/2018: Tim Dunn receives the Top 5% Award for his paper "User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction" and presents work at Vancouver, Canada.

08/13/2018: David Russell receives a fall research co-op at Carnegie Mellon's Robotics Institute.

07/29/2018: Excellent job done by all our RAPS presenters (Jenna Ryan, Hannah DeFazio, Sarah Inzerillo, and Justin Opini), and congratulations to Jenna Ryan for winning First Prize, and Hannah DeFazio for winning Honorable Mention.

07/22/2018: Yijun Jiang and David Russell present papers on the 5-Kinect + 2-microphone capture system and on food readiness at the International Conference on Multimedia and Expo in San Diego, CA.

06/01/2018: Nikolas Lamb, David Russell, and Tim Dunn start REUs at Lehigh, Carnegie Mellon's Robotics Institute, and TU Darmstadt (Germany) respectively.

06/01/2018: Damon Gwinn, Ben Moeller, Alex Kupin, Miao Luo start summer internships.

05/31/2018: Matt Inkawhich receives fully-funded PhD offer at Duke University.

05/15/2018: Ben Lowit receives full-time offer at Epic Systems.

04/17/2018: Nikolas Lamb receives the CS Junior Award, and David Russell receives the CS Sophomore Award.

03/15/2018: David Russell receives Goldwater Scholarship.

02/05/2018: Nikolas Lamb and Hunter Quant present demos on 3D printed scanner building, spatiotemporal interactions in VR, and multi-camera object imaging at the International Conference on Multimedia Modeling in Bangkok, Thailand.

01/05/2018: David Russell starts co-op at Kitware.
Top

ABOUT TARS

At the Terascale All-sensing Research Studio (TARS) at Clarkson University, co-directed by Dr. Sean Banerjee and Dr. Natasha Banerjee, we perform research in human-driven artificial intelligence using capture and analysis of dense multi-person interactions in online and real-world environments. Our studio houses a 16-Kinect + two-microphone capture space, three multi-Raspberry Pi camera microenvironments, two VR systems, two 3D scanners (one laser scanner and one photogrammetry-based scanner 3D-printed by us in-house), and three 3D printers (two Cartesian dual-extrusion 3D printer and a Delta 3D printer assembled by us from a kit). Our research spans computer vision, deep learning, robotics, linguistics, computer graphics, human-computer interaction, and software engineering. We have received Clarkson University's first NSF CRI grant in the amount of $746k, and we are currently building a massively dense multi-modal sensor laboratory as part of the studio.

Our students have received the NSF GRF (Nikolas Lamb) and Goldwater Scholarship (David Russell and Tim Dunn), and have won several awards at international conferences, Clarkson Computer Science and School of Arts and Sciences, and the Clarkson SURE and RAPS conferences. They have done REUs at renowned institutions such as Carnegie Mellon (David Russell), Lehigh (Nikolas Lamb), TU Darmstadt (Tim Dunn), and Los Alamos National Lab (Tim Dunn), and have interned at GE (Jenna Ryan), SRC (Damon Gwinn), Rocketbots (Miao Luo), Buffini & Company (Alex Kupin), Kitware (Hannah DeFazio and David Russell), AFRL (Matthew Inkawhich), Team Howard (Ben Moeller), and MedExpress (Damon Gwinn). Our alumni have been placed at Zebra Technologies (Lintao Guo), AFRL (Marc Bishop), GE (Gus Naughton), Epic Systems (Ben Lowit), and Ensign-Bickford (Scott Straw).

Scroll through to see the research areas we work on. We are actively hiring undergraduate and graduate researchers of high caliber to perform research at the studio. Contact either Dr. Sean Banerjee (sbanerje a clarkson d edu) or Dr. Natasha Banerjee (nbanerje a clarkson d edu) to determine research opportunities with the studio, or to schedule a visit.

PUBLICATIONS

3D PRINTING + SCANNING. N. Lamb, S. Banerjee, and N. K. Banerjee (2019). Automated Reconstruction of Smoothly Joining 3D Printed Restorations to Fix Broken Objects. ACM Symposium on Computational Fabrication (SCF), Pittsburgh, Pennsylvania.

[PDF]

ASSISTIVE AI. Y. Jiang, S. Banerjee, and N. K. Banerjee (2019). Predicting Human Grasp Locations on Cup Handles by Using Deep Neural Networks to Infer Heat Signatures from Depth Data. IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Shanghai, China.

[PDF]

ASSISTIVE AI. J. Ryan, S. Inzerillo, J. Helmick, A. Boolani, N. K. Banerjee, and S. Banerjee (2019). Predicting If Older Adults Perform Cognitive Tasks Using Body Joint Movements From RGB-D Videos. The Eleventh International Conference on eHealth, Telemedicine, and Social Medicine (eTELEMED), Athens, Greece.

[PDF]

VR / AR. A. Kupin, B. Moeller, N. K. Banerjee, and S. Banerjee (2019). Task-Driven Biometric Authentication of Users in Virtual Reality (VR) Environments. International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece [Best Paper Candidate].

[PDF]  [Scholar Search / Bibtex]

ASSISTIVE AI. Y. Jiang, E. Schenck, S. Kranz, S. Banerjee, and N. K. Banerjee (2019). CNN-Based Non-Contact Detection of Food Level in Bottles from RGB Images. International Conference on Multimedia Modeling (MMM), Thessaloniki, Greece.

[PDF]  [Scholar Search / Bibtex]

ASSISTIVE AI. Y. Jiang, M. Luo, S. Banerjee, and N. K. Banerjee (2018). When Will Breakfast Be Ready: Temporal Prediction of Food Readiness Using Deep Convolutional Neural Networks on Thermal Videos. IEEE Intl. Conf. on Multimedia and Expo Workshops (ICMEW), San Diego, CA.

[PDF]  [Scholar Search / Bibtex]

VR / AR. T. Dunn, S. Banerjee, and N. K. Banerjee (2018). User-Independent Detection of Swipe Pressure using a Thermal Camera for Natural Surface Interaction. International Workshop on Multimedia Signal Processing (MMSP), Vancouver, Canada [Top 5% Paper Award].

[PDF]  [Scholar Search / Bibtex]

MULTI-SENSOR SYSTEMS. Y. Jiang, D. Russell, T. Godisart, N. K. Banerjee, and S. Banerjee (2018). Hardware Synchronization of Multiple Kinects and Microphones for 3D Audiovisual Spatiotemporal Data Capture. IEEE International Conference on Multimedia and Expo (ICME), San Diego, California.

[PDF]  [Scholar Search / Bibtex]

MULTI-SENSOR SYSTEMS. L. Guo, H. Quant, N. Lamb, B. Lowit, N. K. Banerjee, and S. Banerjee (2018). Multi-Camera Microenvironment to Capture Multi-view Time-lapse Videos for 3D Analysis of Aging Objects. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]  [Video]  [Scholar Search / Bibtex]

ASSISTIVE AI. L. Guo, H. Quant, N. Lamb, B. Lowit, S. Banerjee, and N. K. Banerjee (2018). Spatiotemporal 3D Models of Aging Fruit from Multi-View Time-Lapse Videos. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]  [Scholar Search / Bibtex]

3D PRINTING + SCANNING. N. Lamb, N. K. Banerjee, and S. Banerjee (2018). Programmatic 3D Printing of a Revolving Camera Track to Automatically Capture Dense Images for 3D Scanning of Objects. Intl. Conf. on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]  [Video]  [Scholar Search / Bibtex]

VR / AR. H. Quant, S. Banerjee, and N. K. Banerjee (2018). A virtual reality interface for interactions with spatiotemporal 3D data. International Conference on Multimedia Modeling (MMM), Bangkok, Thailand.

[PDF]  [Video]  [Scholar Search / Bibtex]

APPLIED ML. D. Gwinn, J. Helmick, N. K. Banerjee, and S. Banerjee (2018). Optimal Estimation of Census Block Group Clusters to Improve the Computational Efficiency of Drive Time Calculations. Intl. Conf. on Geographical Information Systems Theory, Applications and Management (GISTAM), Madeira, Portugal.

[PDF]  [Scholar Bibtex]

APPLIED ML. T. Dunn, N. K. Banerjee, and S. Banerjee (2016). GPU acceleration of document similarity measures for automated bug triaging. International Workshop on Software Faults (co-located with IEEE International Symposium on Software Reliability Engineering, ISSRE), Ottawa, Canada.

[PDF]  [Scholar Search / Bibtex]

PEOPLE

DIRECTORS

Natasha Banerjee
Assistant Professor
Computer Science
Sean Banerjee
Assistant Professor
Computer Science

POST-DOCTORAL ASSOCIATE

Soumyabrata Dey
PhD, University of Central Florida
Computer Science

GRADUATE STUDENTS

Yijun Jiang
PhD
Computer Science
Miao Luo
MS
Computer Science

UNDERGRADUATE STUDENTS

Nikolas Lamb
4th Year Computer Science
NSF GRF Winner
Tim Dunn
4th Year Electrical Engineering /
Computer Science
Honors, Goldwater Scholarship Winner
Damon Gwinn
4th Year Computer Science
Benjamin Moeller
4th Year Computer Science
Heet Dave
3rd Year Computer Science
David Russell
3rd Year Computer Science
Honors, Goldwater Scholarship Winner
Hannah DeFazio
2nd Year Computer Science /
Computer Engineering
Honors
Jenna Ryan
2nd Year Computer Science /
Math
Honors
Alex Kupin
2nd Year Computer Science
Justin Opini
2nd Year Computer Science
Honors
Elim Schenck
2nd Year Computer Engineering / Computer Science
Benjamin Myrick
2nd Year Computer Science
Ryan Marshall
2nd Year Computer Science
Matt Rodman
2nd Year Electrical Engineering
Sarah Inzerillo
1st Year Computer Science
Ashwin Ajit
1st Year Computer Science
Chandler Kent
1st Year Computer Engineering
Kyle FitzGerald
1st Year Mechanical Engineering
Reed Watson
1st Year Mechanical Engineering

ALUMNI

Marc Bishop
MS, Electrical Engineering
Currently at AFRL
Lintao Guo
MS, Computer Science
Currently at Zebra Technologies
Matthew Inkawhich
BS, Software Engineering
Doing a Ph.D. at Duke University
Benjamin Lowit
BS, Computer Engineering
Currently at Epic Systems
Scott Straw
BS, Computer Engineering
Currently at Ensign-Bickford
Gus Naughton
Currently at GE
Hunter Quant
BS, Computer Science

PRESS

Copyright © Natasha Kholgade Banerjee. All rights reserved.