BEGIN:VCALENDAR
PRODID:-//eluceo/ical//2.0/EN
VERSION:2.0
CALSCALE:GREGORIAN
BEGIN:VEVENT
UID:www.tcs.tifr.res.in/event/1309
DTSTAMP:20230914T125958Z
SUMMARY:New results on reasoning using transformer\, Part 2
DESCRIPTION:Speaker: Piyush Srivastava\n\nAbstract: \nIn the ML reading gro
 up this Friday\, we will look at a circuit model (or "architecture") calle
 d "transformer" that ostensibly underlies recent popular applications such
  as ChatGPT\, Bard and friends.  We\, however\, will focus on works (mostl
 y empirical as of now) that attempt to understand its power in the more re
 stricted setting of learning to "reason" in the setting of a restricted pr
 oof system.  Two examples we will look at are\n\n1) Straight Line Programs
 \n2) Proofs in the Isabelle proof system.\n\nReferences:\n Vaswani\, Ashis
 h\, Noam Shazeer\, Niki Parmar\, Jakob Uszkoreit\, Llion Jones\, Aidan N G
 omez\, Łukasz Kaiser\, and Illia Polosukhin. "Attention Is All You Need."
  In Advances in Neural Information Processing Systems\, Vol. 30. Curran As
 sociates\, Inc.\, 2017. https://papers.nips.cc/paper/2017/hash/3f5ee243547
 dee91fbd053c1c4a845aa-Abstract.html.\n Zhang\, Yi\, Arturs Backurs\, Séba
 stien Bubeck\, Ronen Eldan\, Suriya Gunasekar\, and Tal Wagner. "Unveiling
  Transformers with LEGO: A Synthetic Reasoning Task." arXiv\, February 17\
 , 2023. http://arxiv.org/abs/2206.04301.\nMikuła\, Maciej\, Szymon Antoni
 ak\, Szymon Tworkowski\, Albert Qiaochu Jiang\, Jin Peng Zhou\, Christian 
 Szegedy\, Łukasz Kuciński\, Piotr Miłoś\, and Yuhuai Wu. "Magnushammer
 : A Transformer-Based Approach to Premise Selection." arXiv\, March 8\, 20
 23. https://doi.org/10.48550/arXiv.2303.04488.\n
URL:https://www.tcs.tifr.res.in/web/events/1309
DTSTART;TZID=Asia/Kolkata:20230630T143000
DTEND;TZID=Asia/Kolkata:20230630T153000
LOCATION:A201
END:VEVENT
END:VCALENDAR