Thrust 4
Video Analytics and Signature Analysis

Thrust Leader: David Castañón, Boston University

This thrust focuses on multi-camera video anomaly detection in scenarios relevant to passenger tracking and area monitoring in public spaces. Signature analysis work will develop fundamental processing algorithms for trace; bulk and multi-sensor systems will extract maximal information from available sensed signals to increase the probability of detection and classification of explosives while reducing the number of false alarms.  The research focuses on improved Model-Based Iterative Reconstruction for single and dual-energy X-ray CT, exploitation of new signatures such as multi-spectral CT and X-ray diffraction, threat detection in our novel trace sensors in Thrust R2, and algorithms for sensor fusion in AIT and standoff threat detection.

Project Leaders

  • Octavia Camps
    Professor
    Northeastern University
    Email

  • Venkatesh Saligrama
    Associate Professor
    Boston University
    Email

  • Richard Radke
    Professor
    Rensselaer Polytechnic Institute
    Email

  • Charles A. Bouman
    Professor
    Purdue University
    Email

  • Eric Miller
    Professor
    Tufts University
    Email

  • W. Clem Karl
    Professor
    Boston University
    Email

  • David Castañón
    Professor
    Boston University
    Email


Faculty and Staff

  • Mario Sznaier
    Professor
    Northeastern University
    Email

  • Ken D.Sauer
    Professor
    Notre Dame University
    Email

  • Brian Tracey
    Research Assistant Professor
    Tufts University
    Email


Students

  • Pengchong Jin
    Purdue University
  • Mahdee Jameel
    RPI
  • Matthew Reome
    RPI
  • Srikrishna Karanam
    RPI
  • Ziyan Wu
    Rensselaer Polytechnic Institute
  • Austin Li
    RPI
  • Hao Zhang
    Tufts
  • Jing Qian
    Boston University
  • Yuting Chen
    Boston University
  • Ahmet Tuysuzoglu
    Boston University
  • Ke Chen
    Boston University
  • Gregory Castanon
    Boston University
  • Group Membership Prediction Zhang, Z., Chen, Y., & Saligrama, V. International Conference on Computer Vision (ICCV15) 2015.
  • Efficient Deep Learning Algorithms for Deep Supervised Hashing Zhang, Z., Chen, Y., & Saligrama, V. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016) 2016.
  • Efficient temporal Sequence Comparison and Classification using Gram Matrix Embeddings on a Riemannian Manifold Zhang, X., Camps, O., & Snaier, M. 2016 IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 4498 - 4507 2016.
  • Zero-Shot Learning via Semantic Similarity Learning Zhang, Z & Saligrama, V. International conference on Computer Vision (ICCV15) 2015.
  • Zero-Shot Based on Latent Embeddings Zhang, Z & Saligrama, V. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016) 2016.
  • Robust X-Ray based Material Identification Using Multi-Energy Sinogram Decomposition in Anomaly Detection and Imaging with X-Rays (ADIX) Yuan, Y., Tracey, B., & Miller, E. Proceedings of SPIE Vol. 9847 2016.
  • Performance Bounds for Sinogram Decomposition and Potential Befits of Multi-Energy Data Yuan, Y., Tracey, B., & Miller, E. 4th International Conference on Image Formation in X-Ray Computed Tomography 2016.
  • Efficient Identification of Weiner Systems Using a Combination of Atomic Norm Minimization and Interval Matrix Properties Yilmaz, B., & Szanier, M. IEEE 54th Conf. on Decision and Control (CDC), pp. 109 - 114 2015. DOI: 10.1109/CDC.2015.7402094.
  • Identification of a Class of Generalized Autoregressive Conditional Heteroskedasticity (GARCH) Models with Applications to Covariance Propagation Wang, Y., Sznaier, M., Camps, O., & Pat, F. IEEE 54th Conf. on Decision and Control (CDC), pp. 795 - 800 2015. DOI:10.1109/CDC.2015.7402327.
  • High Performance Model Based Image Reconstruction Wang, X., Sabne, A., Kisner, S. J., Bouman, C., & Midkidd, S. P. 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP) 2016. DOI: 10.1145/2851141.2851163.
  • Fast Voxel Line Update for Time-Space Image Reconstruction Wag, X., Mohan, K.A., Kisner, S. J., Bouman, C., & Midkiff, S. P. 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1209 - 1213 2016.
  • High Performance Model Based Image Reconstruction Wang, X., Bouman, C. A., & Midkidd, S. P. 2015 Supercomputing Conference (SC'15) 2015.
  • Efficient Learning by Directed Acyclic Graph for Resource Constrained Prediction Wang, J., Trapeznikov, K., & Saligrama, V. 2015 Neural Information Processing Systems (NIPS) 2015.
  • Variable Splitting Techniques for Discrete Tomography Tuysuzoglu, A., Khoo, y., & Karl, W. C. Proc. IEEE International Conference on Image Processing 2016.
  • Enhancing Nuclear Resonance Fluorescence with Coded Aperture for Security Based Imaging Sun, Z., Karl, W. C., & Castanon, D. Computational Imaging 2016.
  • Sparse View Compton Scatter Tomography With Energy Resolved Data Rezaee, H., Tracey, B., & Miller, E. SIAM Conference on Imaging Science 2016.
  • Feature-Budgeted Random Forest Nan, F., Wang, J., & Saligrama, V. Proceedings of the 32nd International Conference on Machine Learning, JMLR: W&CP, Volume 37 2015.
  • Unsupervised Fault detection Using Semidefinite Programming Lopez, J. A., Sznaier, M., & Camps, O. IEEE 54th Conf. on Decision and Control (CDC), pp. 3798 - 3803 2015. DOI: 10.1109/CDC.2015.7402809.
  • Multi-Shot Human Re-Identification Using Adaptive Fisher Discriminant Analysis Li, Y., Karanam, S., & Radke, R. J. 26th British Machine Vision Conference (BMVC 2015) 2015. DOIL 10.5244/C.29.73.
  • Person Re-Identification with Discriminatively Trained Viewpoint Invariant Dictionaries Karanam, S., Li, Y., & Radke, R. J. International Conference on Computer Vision (ICCV15) 2015. DOI: 10.1109/ICCV.2015.513.
  • Particle Dynamics and Multi-Channel Feature Dictionaries for Robust Visual Tracking Karanam, S., Li, Y., & Radke, R. J. 26th British Machine Vision Conference (BVMC 2015) 2015. DOI: 10.5244/C.29.183.
  • Joint Metal Artifact Reduction and Segmentation of CT Images Using Dictionary-Based Image Prior and Continuous-Relaxed Potts Model Jin, P., Ye, D., & Bouman, C. IEEE Int'l Conf. Image Processing 2015.
  • Solving Temporal Puzzles Dicle, C., Camps, O., & Sznair, M. 2016 IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp 5896 - 5905 .
  • Subspace Clustering with Priors via Sparse Quadratically Constrained Quadratic Programming Cheng, Y., Wang, Y., Camps. O. & Sznair, M. 2016 IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 5204 - 5212 2016.
  • The Interplay Between Big Data and Sparsity in Systems Identification Cheng, Y., Wang, Y., Camps, O., & Sznaier, M. IFAC Symposium on System Identification, pp. 1285 - 1292 2015. DOI: 10.1016/j.ifacol.2015.12.309.
  • Robust Superstabilizing Control Design From Open Lopp Experimental Input/Output Data Cheng, Y., Sznair, M., & Lagoa, C. Proc. of the 17th IFAC Symposium on System Identification, pp. 1331-1336 2015.
  • Identification of LPV Systems with LFT Parametric Dependence Via Convex Optimization Cheng, Y. & Sznair, M. IEEE 54th Conf. on Decision and Condrol (CDC), pp. 1459 - 1464 2015. DOI: 10.1109/CDEC.2015.7402416.
  • Efficient Activity Retrieval Through Semantic Graph Queries Castanon, G., Chen, Y., Zhang, Z., & Saligrama, V. Association for Computing Machinery Multimedia Conference 2015 (ACM MM 2015) 2015.
  • Low-Order Model Identification of MIMI Systems from Noisy and Incomplete Data Bekirolgu, K., Lagoa, C. & Sznair, M. IEEE 54th Conf. on Decision and Control (CDC), pp. 4029 - 4034 2015. DOI: 10.1109/CDC.2015.7402846.
  • Stabalizing Dual-Energy X-Ray Computed Tomography Reconstructions Using Patch-Based Regularization Tracey, B. H. & Miller, E. L. Inverse Problems, Vol. 31, No. 10 2015.
  • Minimax Optimal Sparse Signal Recovery with Poisson Statistics Rohban, M., Saligrama, V., & Vaziri, D. M. IEEE Transactions on Signal Processing, 64(13), pp. 3495 - 3508 2016. DOI: 10.1109/TSP.2016.2529588.
  • Learning-Based Object Identification and Segmentation Using Dual-Energy CT Images for Security Matrin, L., Tuysuzoglu, A., Karl, W. C., & Ishwar, P. IEEE Transactions on Image Processing, Vol. 24, No. 11, pp. 4069-4081 2015.
  • A Model-Based Image Reconstruction Algorithm with Simultaneous Beam Hardening Correction for X-Ray CT Jin, P., Bouman, C., & Sauer, K. IEEE Transactions on Computational Imaging, Vol. 1, No. 3, pp 200-216 2015.
  • From the Lab to the Real World: Re-Identification in an Airport Camera Network Camps, O., Guo, M., Hebble, T., Karanam, S., Lehmann, O., Li, Y., Radke, R. J., Wu, Z., & Xiong, F. IEEE Transactionf on Circuits and Systems for Video Technology, Special Issue on Group and Crowd Behavior Analysis for Intelligent Multi-Camera Video Surveillance 2016. DOI: 10.1109/TCSVT.2016.2556538.
  • Person re-identification with block sparse recovery Karanam, S., Li, Y., & Radke, R. Image and Vision Computing, Volume 60, pp. 75-90, 2017. DOI:10.1016/j.imavis.2016.11.015.
  • Rapidly Accelerated Proximal Gradient Algorithms Zhang, Z., & Saligrama, V. 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015. 2015.
  • A Novel Visual Word Co-occurrence Model for Person Re-identification Zhang, Z., Chen, Y., & Saligrama, V. ECCV Workshop 2014, 6-7 September 2014. 2014.
  • Person Re-Identification Using Kernel-Based Metric Learning Methods Xiong, F., Gou, M., Camps, O., & Sznaier, M. 2014 European Comp. Vision Conference, Zurich, Switzerland, September 2014, pp. 1–16. 2014.
  • Sparse Static Output Feedback Controller Design via Convex optimization Wang, Y., Lopez, J., & Sznaier, M. 2014 IEEE 53rd Annual Conference Decision and Control (CDC), 2014, pp. 376 – 381. 2014.
  • Self Scaled Regularized Robust Regression Wang, Y., Dicle, C., Camps, O., & Sznaier, M. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015. 2015.
  • Model Selection by Linear Programming Wang, J., Bolukbasi, T., Trapeznikov, K., & Saligrama, V ECCV 2014 – European Conference on Computer Vision, 6-12 September 2014. 2014.
  • Surviving the Upcoming Data Deluge: A Systems and Control Perspective Sznaier, M., Camps, O., Ozay, N., & Lagoa, C. 2014 IEEE 53rd Annual Conference on Decision and Control (CDC), 2014, pp. 1488 – 1498. 2014.
  • Learning Efficient Anomaly Detectors from KNN Graphs Qian, J., & Saligrama, V 18th International Conference on Artificial Intelligence and Statistics (AISTATS) 2015, Journal of Machine Learning Research, W&CP, 2015. 2015.
  • Efficient Minimax Detection on Graphs Qian, J., & Saligrama, V. 28th Annual Conference on Neural Information Processing Systems (NIPS), 8-13 December 2014. 2014.
  • An Obstacle Avoidance and Motion Planning Command Governor Based Scheme: The Qball-X4 Quadrotor Case of Study Lucia, W., Sznaier, M., & Franze, G. 2014 IEEE 53rd Annual Conference on Decision and Control (CDC), 2014, pp. 6135 – 6140. 2014.
  • Gesture Modeling by Hanklet-Based Hidden Markov Model Lo Presti, L., La Cascia, M., Sclaroff, S., & Camps, O. Proc. Asian Conference on Computer Vision (ACCV), November 2014. 2014.
  • Multi-Shot Re-Identification with Random-Projection-Based Random Forests Li, Y., Wu, Z., & Radke, R.J. Winter Conference on Application of Computer Vision 2015, Waikola Beach, HI, January 2015. http://dx.doi. org/10.1109/WACV.2015.56 2015.
  • Real-World Re-Identification in an Airport Camera Network Li, Y., Wu, Z., Karanam, S., & Radke, R.J. Eighth ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC), Venice, Italy, November 2014 (invited paper). http://dx.doi.org/10.1145/2659021.2659039 2014.
  • Sparse Re-Id: Block Sparsity for Person Re-Identification Karanam, S., Li, Y., & Radke, R.J. IEEE/ISPRS 2nd Joint Workshop on Multi-Sensor Fusion for Dynamic Scene Understanding (MSF 15) in conjunction with CVPR 15, Boston, MA, 12 June 2015. 2015.
  • Efficient Detection and Localization on Graph Structured Data Hanawal, M., & Saligrama, V. 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015. 2015.
  • A Convex Optimization Approach to Semi-Supervised Identification of Switched ARX Systems Cheng, Y., Wang, Y., & Sznaier, M. 2014 IEEE 53rd Annual Conference on Decision and Control (CDC), 2014, pp. 2573 – 2578. 2014.
  • Improving Counterflow Detection in Dense Crowds with Scene Features Wu, Z., & Radke, R.J. Pattern Recognition Letters: Special Issue on Pattern Recognition and Crowd Analysis, 44, 15 July 2014, pp. 152-160. DOI: 10.1016/j.patrec.2013.11.016 2014.
  • Viewpoint Invariant Human Re-Identifi cation in Camera Networks Using Pose Priors and Subject-Discriminative Features Wu, Z., Li, Y., & Radke, R.J. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(5), May 2015, pp. 1095-1108. DOI: 10.1109/TPAMI.2014.2360373 2015.
  • Graph-Cut Based Discrete-Valued Image Reconstruction Tuysuzoglu, A., Karl, W. C., Stojanovic, I., Castanon, D. A., & Unlu, S. IEEE Transactions on Image Processing, 24(5), May 2015, pp. 1616-1627. http://ieeexplore.ieee. org/stamp/stamp.jsp?arnumber=7055898 2015.
  • Fast Structured Nuclear Norm Minimization with Applications to Set Membership Systems Identification Sznaier, M., Ayazoglu, M., & Inanc, T. IEEE Transactions on Automatic Control, 59(10), October 2014, pp. 2837–2842. 2014.
  • Convex Certificates for Model (In)validation of Switched Affi ne Systems with Unknown Switches Ozay, N., Sznaier, M., & Lagoa, C.M. IEEE Transactions on Automatic Control: Special Issue on Relaxation Methods in Identification and Estimation Problems, 59(11), November 2014, pp. 2921–2932. 2014.
  • Set Membership Identifi cation of Switched Linear Systems with Known Number of Subsystems Ozay, N., Lagoa, C.M., & Sznaier, M. Automatica, 51, January 2015, pp. 180-191. 2015.
  • Probabilistic Optimal Estimation with Uniformly Distributed Noise Dabbene, F., Sznaier, M., & Tempo, R. IEEE Transactions on Automatic Control, 59(8), August 2014, pp. 2113–2127. 2014.