{"id":971,"date":"2024-03-18T11:49:53","date_gmt":"2024-03-18T18:49:53","guid":{"rendered":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/?page_id=971"},"modified":"2024-03-18T11:49:53","modified_gmt":"2024-03-18T18:49:53","slug":"deep-learning-in-language-and-vision-seminar","status":"publish","type":"page","link":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/deep-learning-in-language-and-vision-seminar\/","title":{"rendered":"Deep Learning in Language and Vision Seminar"},"content":{"rendered":"\n
\n
\n

Seminar Info:<\/strong><\/p>\n\n\n\n

Host: Chitta Baral and Yezhou Yang<\/p>\n\n\n\n

Time: Every Thursday at Noon<\/p>\n\n\n\n

Location: BYENG 210<\/p>\n\n\n\n

Sponsors<\/strong>:<\/p>\n\n\n\n

CCC Post-Doc best practice program;<\/p>\n\n\n\n

NVIDIA DLI program.<\/p>\n<\/div>\n\n\n\n

\n
\"\"<\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n
\n

Topic lists:<\/strong><\/h4>\n\n\n\n

Intro to Deep Learning: <\/strong>Yezhou Yang
Activation Functions: <\/strong>Basic perceptron, Sigmoid, ReLU, (leaky) ReLU, identity, tanh, softmax (Yezhou, Vyom)<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n
\n

Neural network modules:<\/h4>\n\n\n\n

feed-forward, Word2Vec, CNN (Convolutional Neural Networks), Recurrent Neural Networks (RNNS), RNN with memory units – LSTM, Encoders (auto encoders), Decoders, Recursive Neural Networks, Generative Models, GANs (Generative Adversarial Networks), Relational Networks, Adversarial networks (Kausic – CNNs, Chieh-Yang – Word2Vec, Rudra – GAN, Xin – LSTM)<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n
\n

Modules and Applications:<\/h4>\n\n\n\n

Vision – CNN for recognition, GAN (and its extensions such as InfoGANs) Language – RNN, LSTM Decision Making –<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n
\n

Software and libraries:<\/h4>\n\n\n\n

Tensorflow, Theano, Torch, Keras (a Python library), Caffe, ONNX (an ecosystem for interchangeable AI frameworks)<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n
\n

Tuning Parameters:<\/h4>\n\n\n\n

network structure (how many layers), filter size of a CNN, learning rate (adaptive learning rate algorithms), how many epochs (Somak, Rudra, Mo)<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n
\n

Reinforcement Learning using NN (Rudra – Recap of Reinforcement Learning Workshop)<\/strong><\/p>\n\n\n\n

Recap of EMNLP.
Students talking about their own research.<\/strong><\/p>\n\n\n\n

Training Methods:<\/strong> SGD, \u2026
(ChengXi @UMD – remote presentation)

Important Developments:<\/strong> AlphaGo, \u2026

<\/p>\n\n\n\n

Challenges and Questions:<\/strong>
How to do incorporate background knowledge?
How to make inference based on deep learning explainable?
Relational Learning?
Planning<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Seminar Info: Host: Chitta Baral and Yezhou Yang Time: Every Thursday at Noon Location: BYENG 210 Sponsors: CCC Post-Doc best practice program; NVIDIA DLI program. Topic lists: Intro to Deep Learning: Yezhou YangActivation Functions: Basic perceptron, Sigmoid, ReLU, (leaky) ReLU, identity, tanh, softmax (Yezhou, Vyom) Neural network modules: feed-forward, Word2Vec, CNN (Convolutional Neural Networks), Recurrent…<\/p>\n","protected":false},"author":338,"featured_media":0,"parent":0,"menu_order":4,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-971","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/wp-json\/wp\/v2\/pages\/971","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/wp-json\/wp\/v2\/users\/338"}],"replies":[{"embeddable":true,"href":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/wp-json\/wp\/v2\/comments?post=971"}],"version-history":[{"count":0,"href":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/wp-json\/wp\/v2\/pages\/971\/revisions"}],"wp:attachment":[{"href":"https:\/\/faculty.engineering.asu.edu\/yezhouyang\/wp-json\/wp\/v2\/media?parent=971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}