|NIPS 2016:||My former intern Spandana Gella is introducing our work from the summer: The first computational model for vision-to-language specifically for people who are blind. This is one of the most important perspectives to consider if you're interested in vision-language research. At WiML.|
|Early November:||Honored to begin new position as a Senior Research Scientist at Google Research and Machine Intelligence.|
|Late October:||I have left Microsoft Research. Please invite me out for cookies and beers, I could use it.|
|October:||I had the great privilege of being an AI expert on the new Bill Nye show!|
|Late September:||The Visual Question Answering work is taking the world by storm.|
|Early September:||Was offered the amazing opportunity of being a Senior Research Scientist in Google's Machine Intelligence group.|
|Late August:||Our Seeing AI project has over 1.7 million views on Buzzfeed. =O|
Microsoft has let me know that I am not making enough impact, and promoted the men around me who helped with the project. My annual cash income has been lowered.
|Early August:||Our former intern Ishan Misra did a fantastic job explaining the reporting bias model on the Data Skeptic podcast!|
|Late July:||Helped advance clinical state-of-the-art in a one-of-a-kind workshop on Detecting Risk and Protective Factors of Mental Health using Social Media Linked with Electronic Health Records, part of the JSALT Workshop series. Definitely worth plugging in for a couple weeks.|
|CVPR 2016:||Presented the first computational model for reporting bias! Use variations on this one handy trick to significantly improve captioning, detection, etc. etc.!|
Gave invited talk on vision-to-language generation at the VQA Challenge! [photo]
|NAACL 2016:||Presented the storytelling work to the masses!|
|June:||My kinda silly "sea of dudes" phrase, which I use to feel more relaxed as I go up and present, is taking the world by storm! Thanks, Bloomberg!|
|April:||People are interested in both the Seeing AI work and the Visual Storytelling work! |
Here are some articles on Seeing AI from Fast Company, MIT Technology Review, and Microsoft.
Here are some articles on the storytelling work from Live Science, Venture Beat, and Microsoft. The Live Science journalist was great, he was deeply concerned about how these things can be evaluated, and how you know when you're doing well.
|30.March:||Satya unveiled our project for assisting the visually impaired, Seeing AI. Check out the video here!|
|CVPR 2015:||Our image captioning system won first place in the COCO captioning challenge, voted to be the most human-like! Let's hear it for thinking deeply about what kind of evaluation to focus on, and the power of logistic regression used well!|