Join the channel membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Support and Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu
ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744
Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy
Earn up to $170 welcome bonus on Huobi now with my crypto affiliate link:
Binance ⇢ https://accounts.binance.com/en/register?ref=27700065
Huobi ⇢ https://www.huobi.com/en-us/topic/welcome-bonus/?invite_code=xj9pc
The video is reposted for educational purposes and encourages involvement in the field of research.
Source: https://parameterfree.com/icml-tutorial/
...
https://www.youtube.com/watch?v=kXJnwBb_GrQ
Join the channel membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Support and Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu
ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744
Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy
Wanted to own BTC, ETH, or even Dogecoin? Kickstart your crypto portfolio with the largest crypto market Binance with my affiliate link:
https://accounts.binance.com/en/register?ref=27700065
The video was published under the license of the Creative Commons Attribution license (reuse allowed). It is reposted for educational purposes and encourages involvement in the field of research.
Source: https://youtu.be/4-t1YDp8qHU
Subscribe to Andreas Maier: https://www.youtube.com/channel/UCoiMqX5FHfk_KDow7xSe7pg
...
https://www.youtube.com/watch?v=pxw_YeZvgKw
Join the channel membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Support and Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu
ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744
Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy
Earn up to $170 welcome bonus on Huobi now with my crypto affiliate link:
Binance ⇢ https://accounts.binance.com/en/register?ref=27700065
Huobi ⇢ https://www.huobi.com/en-us/topic/welcome-bonus/?invite_code=xj9pc
The video is reposted for educational purposes and encourages involvement in the field of research.
Source: https://parameterfree.com/icml-tutorial/
...
https://www.youtube.com/watch?v=YGEdhj1TbxI
Join the channel membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Support and Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu
ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744
Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy
Wanted to own BTC, ETH, or even Dogecoin? Kickstart your crypto portfolio with the largest crypto market Binance with my affiliate link:
https://accounts.binance.com/en/register?ref=27700065
The video was published under the license of the Creative Commons Attribution license (reuse allowed). It is reposted for educational purposes and encourages involvement in the field of research.
Source: https://www.facebook.com/1620822758218702/videos/1001102260293556
...
https://www.youtube.com/watch?v=eq7-GSxWI_U
Join the channel membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Support and Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu
ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744
Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy
Wanted to own BTC, ETH, or even Dogecoin? Kickstart your crypto portfolio with the largest crypto market Binance with my affiliate link:
https://accounts.binance.com/en/register?ref=27700065
Filmed at https://2019.dotgo.eu on March 25th in Paris. More talks on https://dotconferences.com/talks
Making code faster is exciting, and benchmarks in Go make that easy to do!
Not really. Optimizing a program can be complex and require careful consideration to do properly. Daniel demonstrates techniques and tools which are a must for any performance aficionado.
License
Creative Commons Attribution license (reuse allowed)
The video was published under the license of the Creative Commons Attribution license (reuse allowed). It is reposted for educational purposes and encourages involvement in the field of research.
...
https://www.youtube.com/watch?v=slcIk-RuFzw
If you would like to support the channel, please join the membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
The video is reposted for educational purposes and encourages involvement in the field of AI research.
Source: https://aclanthology.org/2022.acl-long.1.mp4
Abstract
Pre-trained language models have shown stellar performance in various downstream tasks. But, this usually comes at the cost of high latency and computation, hindering their usage in resource-limited settings. In this work, we propose a novel approach for reducing the computational cost of BERT with minimal loss in downstream performance. Our method dynamically eliminates less contributing tokens through layers, resulting in shorter lengths and consequently lower computational cost. To determine the importance of each token representation, we train a Contribution Predictor for each layer using a gradient-based saliency method. Our experiments on several diverse classification tasks show speedups up to 22x during inference time without much sacrifice in performance. We also validate the quality of the selected tokens in our method using human annotations in the ERASER benchmark. In comparison to other widely used strategies for selecting important tokens, such as saliency and attention, our proposed method has a significantly lower false positive rate in generating rationales. Our code is freely available at https://github.com/amodaresi/AdapLeR.
@inproceedings{modarressi-etal-2022-adapler,
title = "{A}dap{L}e{R}: Speeding up Inference by Adaptive Length Reduction",
author = "Modarressi, Ali and
Mohebbi, Hosein and
Pilehvar, Mohammad Taher",
booktitle = "Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
month = may,
year = "2022",
address = "Dublin, Ireland",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.acl-long.1",
doi = "10.18653/v1/2022.acl-long.1",
pages = "1--15",
abstract = "Pre-trained language models have shown stellar performance in various downstream tasks. But, this usually comes at the cost of high latency and computation, hindering their usage in resource-limited settings. In this work, we propose a novel approach for reducing the computational cost of BERT with minimal loss in downstream performance. Our method dynamically eliminates less contributing tokens through layers, resulting in shorter lengths and consequently lower computational cost. To determine the importance of each token representation, we train a Contribution Predictor for each layer using a gradient-based saliency method. Our experiments on several diverse classification tasks show speedups up to 22x during inference time without much sacrifice in performance. We also validate the quality of the selected tokens in our method using human annotations in the ERASER benchmark. In comparison to other widely used strategies for selecting important tokens, such as saliency and attention, our proposed method has a significantly lower false positive rate in generating rationales. Our code is freely available at https://github.com/amodaresi/AdapLeR.",
}
...
https://www.youtube.com/watch?v=-Dv0BZ4rXEA
Join the channel membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Support and Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu
ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744
Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy
Wanted to own BTC, ETH, or even Dogecoin? Kickstart your crypto portfolio with the largest crypto market Binance with my affiliate link:
https://accounts.binance.com/en/register?ref=27700065
BuyMeACoffee: https://www.buymeacoffee.com/angustay
-----------------------------------------------------------------------------------------
The video is reposted for educational purposes.
Source: https://slideslive.com/38917280/best-paper-award-and-panel-discussion
...
https://www.youtube.com/watch?v=maatjfPxTmU
Welcome to AIP.
- The main focus of this channel is to publicize and promote existing SoTA AI research works presented in top conferences, removing barrier for people to access the cutting-edge AI research works.
- All videos are either taken from the public internet or the Creative Common licensed, which can be accessed via the link provided in the description.
- To avoid conflict of interest with the ongoing conferences, all videos are published at least 1 week after the main events. A takedown can be requested if it infringes your right via email.
- If you would like your presentation to be published on AIP, feel free to drop us an email.
- AI conferences covered include: NeurIPS (NIPS), AAAI, ICLR, ICML, ACL, NAACL, EMNLP, IJCAI
If you would like to support the channel, please join the membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
Donate any cryptocurrency on BEP20 (BTC, ETH, USDT, BNB, Doge, Shiba): 0x0712795299bf00eee99f13b4cda0e19dc656bf2c
BTC ⇢ 1BwE1gufcE5t1Xh4w3wQhGgcJuCTb7AGj3
ETH ⇢ 0x0712795299bf00eee99f13b4cda0e19dc656bf2c
Doge ⇢ DL57g3Qym7XJkRUz5VTU97nvV3XuvvKqMX
USDT (TRN20) ⇢ THV9dCnGfWtGeAiZEBZVWHw8JGdGCWC4Sh
The video is reposted for educational purposes and encourages involvement in the field of AI research.
...
https://www.youtube.com/watch?v=xH0GkKWpqnM
Join the channel membership:
https://www.youtube.com/c/AIPursuit/join
Subscribe to the channel:
https://www.youtube.com/c/AIPursuit?sub_confirmation=1
Support and Donation:
Paypal ⇢ https://paypal.me/tayhengee
Patreon ⇢ https://www.patreon.com/hengee
BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu
ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744
Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy
Wanted to own BTC, ETH, or even Dogecoin? Kickstart your crypto portfolio with the largest crypto market Binance with my affiliate link:
https://accounts.binance.com/en/register?ref=27700065
-----------------------------------------------------------------------------------------
The video was published under the license of the Creative Commons Attribution license (reuse allowed). It is reposted for educational purposes and encourages involvement in the field of research.
Source: https://www.youtube.com/watch?v=uhgY3MeTdLo
...
https://www.youtube.com/watch?v=02XXQAD4HIU