Publications

Journals

T. J. Meo, C. Kim, A. Raghavan, A. Tozzo, D. A. Salter, A. Tamrakar, M. R. Amer. Aesop: A Visual Storytelling Platform for Conversational AI and Common Sense Grounding. AI Communications, 2019 Pre-Print.

D. Ramachandram, M Lisicki, TJ Shields, M.R. Amer, GW Taylor. Bayesian Optimization on Graph-Structured Search Spaces: Optimizing Deep Multimodal Fusion Architectures. Neurocomputing, 2018. PDF

M. R. Amer, T. J. Shields, B. Siddiquie, A. Tamrakar, A. Divakaran, S. Chai, Deep Multimodal Fusion: A Hybrid Approach, International Journal of Computer Vision, 2017. PDF

M. R. Amer and S. Todorovic. Sum Product Networks for Activity Recognition in Videos. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016. PDF

M. R. Amer, S. Yousefi, R. Raich, and S. Todorovic. Monocular Extraction of 2.1D Sketch using Constrained Convex Optimization. International Journal of Computer Vision, 2015. PDF

Conferences

B. Knyazev, G. W. Taylor, M. R. Amer. Understanding Attention and Generalization in Graph Neural Networks. Neural Information Processing Systems, 2019. PDF

B. Knyazev, X. Lin, M. R. Amer, G. W. Taylor. Image Classification with Hierarchical Multigraph Networks. British Machine Vision Conference, 2019. PDF

X. Lin, I. Sur, S. Nastase, A. Divakaran, U. Hasson, M. R. Amer. Data-Efficient Mutual Information Neural Estimator. arXiv, 2019. PDF

X. Lin, M. R. Amer.  Human Motion Generation from Text using Dense Validation Adversarial Networks. arXiv, 2018. PDF 

D. Ramachandram, T. J. Shields, M. Lisicki, M. R. Amer and G. W. Taylor. Structure Optimization for Deep Multimodal Fusion Networks using Graph-Induced Kernels. European Symposium on Artificial Neural Networks, 2017. PDF

D. A. Salter, A. Tamrakar, B. Siddiquie, M. R. Amer, A. Divakaran, B. Lande , D. Mehri. The Tower Game Dataset: A Multimodal Dataset for Analyzing Social Interaction Predicates. Affective Computing and Intelligent Interactions, 2015. PDF

M. R. Amer, L. Peng, and S. Todorovic. HiRF: Hierarchical Random Field for Collective Activity Recognition in Videos. European Conference on Computer Vision, 2014. PDF

M. R. Amer, B. Siddiquie, S. Khan, A. Divakaran, H. Sawhney. Multimodal Fusion using Dynamic Hybrid Models. Winter Conference on Applications of Computer Vision, 2014. PDF

M. R. Amer, B. Siddiquie, C. Richey, A. Divakaran. Emotion Detection in Speech using Deep Networks. International Conference on Acoustics, Speech, and Signal Processing, 2014. PDF

M. R. Amer, A. Fern, S. Todorovic, S. Zhu. Monte Carlo Tree Search for Scheduling Activity Recognition. International Conference on Computer Vision, 2013. PDF

M. R. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu. Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition. European Conference on Computer Vision, 2012. Oral presentationPDF

M. R. Amer and S. Todorovic. Sum Product Networks for Modeling Activities with Stochastic Structures. IEEE Conference on Computer Vision and Pattern Recognition, 2012. PDF

M. R. Amer and S. Todorovic. A Chains Model for Localizing Participants of Group Activities in Videos. International Conference on Computer Vision, 2011. PDF

W. Brendel, M. R. Amer, and S. Todorovic. Multiobject Tracking as Maximum-Weight Independent Set. IEEE Conference on Computer Vision and Pattern Recognition, 2011. Oral presentationPDF

M. R. Amer, R. Raich, S. Todorovic. Monocular Estimation of 2.1D Sketch. International Conference on Image Processing, 2010. Oral presentationPDF

Workshops

B. Knyazev, G. W. Taylor, M. R. Amer. Understanding Attention in Graph Neural Networks. International Conference on Learning Representations, 2019. Oral presentation. PDF 

B. Knyazev, G. W. Taylor, X. Lin, M. R. Amer. Discovering and Fusing Relations in Molecules using Spectral Graph Networks. Neural Information Processing Systems, 2018. PDF

A. Tozzo, D. Jovanovic, M. R. Amer. Neural Event Extraction in Movies. North American Association for Computational Linguists, 2018. PDF

T. J. Shields*, M. R. Amer*, M. Ehrlich, A. Tamrakar. Action-Affect-Gender Classification using Multi-Task Representation Learning. IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2017. PDF

M. Ehrlich, T. J. Shields, T. Almaev, M. R. Amer. Facial Attributes Classification using Multi-Task Representation Learning. IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2016. PDF

A. Raghavan, M. R. Amer, T. J. Shields, D. Zhang, S. Chai. GPU Activity Recognition using Representation Learning. International Conference on Machine Learning Workshops, 2016. PDF

J. Selman, M. R. Amer, A. Fern, and S. Todorovic. PEL-CNF: Probabilistic Event Logic Conjunctive Normal Form for Video Interpretation. International Conference on Computer Vision Workshops, 2011. PDF

M. R. Amer, E. Bilgazyev, S. Todorovic, S. Shah, I. Kakadiaris, and L. Ciannelli. Fine-grained Categorization of Events in Underwater Videos by Tracking Fish. International Conference on Computer Vision Workshops, 2011. PDF

Demos

X. Lin, C. Kim, T. Meo, and M. R. Amer. Learn, Generate, Rank: Generative Ranking of Motion Capture. European Conference on Computer Vision, 2018. PDF

T. Meo, A. Raghavan, D. Salter, A. Tozzo, A. Tamrakar, and M. R. Amer. Aesop: A Visual Storytelling Platform for Conversational AI, International Joint Conference on Artificial Intelligence, 2018. Best demo awardPDF

S. Kim, D. Salter, L. DeLuccia, K. Son, M. R. Amer and A. Tamrakar. SMILEE: Symmetric Multi-modal Interactions with Language-gesture Enabled AI Embodiment. North American Association for Computational Linguists, 2018. PDF

Patents

M. R. Amer, B. Siddiquie, A. Divakaran, C. Richey, S. Khan, H. Sawhney, T. J. Shields. Dynamic Hybrid Models for Multimodal Analysis. US9875445, 2018. PDF

M. R. Amer, T. J. Shields, A. Tamrakar, M. Ehrlich, T. Almaev. Deep Multi-Task Representation Learning. WO2017161233,  Pending. PDF

S. M. Chai, D. C. Zhang, M. R. Amer, T. J. Shields, A. N. Raghavan. Low precision neural networks using subband decomposition. WO2017176384, Pending. PDF

S. M. Chai, D. C. Zhang, M. R. Amer, T. J. Shields, A. N. Raghavan, B. Ramamurthy. Systems and methods for optimizing operations of computing devices using deep neural networks. US15625578, Pending. PDF