If you would like to support the channel, please join the membership: https://www.youtube.com/c/AIPursuit/join Subscribe to the channel: https://www.youtube.com/c/AIPursuit?sub_confirmation=1 The video is reposted for educational purposes and encourages involvement in the field of AI research. Source: https://aclanthology.org/2022.acl-long.60/ Abstract: Pre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, existing prompt engineering methods require significant amounts of labeled data, access to model parameters, or both. We introduce a new method for selecting prompt templates without labeled examples and without direct access to the model. Specifically, over a set of candidate templates, we choose the template that maximizes the mutual information between the input and the corresponding model output. Across 8 datasets representing 7 distinct NLP tasks, we show that when a template has high mutual information, it also has high accuracy on the task. On the largest model, selecting prompts with our method gets 90% of the way from the average prompt accuracy to the best prompt accuracy and requires no ground truth labels. To Cite: sorensen-etal-2022-information @inproceedings{sorensen-etal-2022-information, title = "An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels", author = "Sorensen, Taylor and Robinson, Joshua and Rytting, Christopher and Shaw, Alexander and Rogers, Kyle and Delorey, Alexia and Khalil, Mahmoud and Fulda, Nancy and Wingate, David", booktitle = "Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)", month = may, year = "2022", address = "Dublin, Ireland", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/2022.acl-long.60", doi = "10.18653/v1/2022.acl-long.60", pages = "819--862", abstract = "Pre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, existing prompt engineering methods require significant amounts of labeled data, access to model parameters, or both. We introduce a new method for selecting prompt templates \textit{without labeled examples} and \textit{without direct access to the model}. Specifically, over a set of candidate templates, we choose the template that maximizes the mutual information between the input and the corresponding model output. Across 8 datasets representing 7 distinct NLP tasks, we show that when a template has high mutual information, it also has high accuracy on the task. On the largest model, selecting prompts with our method gets 90{\%} of the way from the average prompt accuracy to the best prompt accuracy and requires no ground truth labels.", } ... https://www.youtube.com/watch?v=RByZaEFk-sQ

Join the channel membership: https://www.youtube.com/c/AIPursuit/join Subscribe to the channel: https://www.youtube.com/c/AIPursuit?sub_confirmation=1 Support and Donation: Paypal ⇢ https://paypal.me/tayhengee Patreon ⇢ https://www.patreon.com/hengee BTC ⇢ bc1q2r7eymlf20576alvcmryn28tgrvxqw5r30cmpu ETH ⇢ 0x58c4bD4244686F3b4e636EfeBD159258A5513744 Doge ⇢ DSGNbzuS1s6x81ZSbSHHV5uGDxJXePeyKy Wanted to own BTC, ETH, or even Dogecoin? Kickstart your crypto portfolio with the largest crypto market Binance with my affiliate link: https://accounts.binance.com/en/register?ref=27700065 ----------------------------------------------------------------------------------------- The video was published under the license of the Creative Commons Attribution license (reuse allowed). It is reposted for educational purposes and encourages involvement in the field of research. Source: https://youtu.be/XqluthtTenI Subscribe to Ian Sullivan: https://www.youtube.com/channel/UCbCoz3MxHc2Ixcfq-xLCigw Source code: https://github.com/IanSullivan/DeepFakeTorch ... https://www.youtube.com/watch?v=gYGkOrpiSDE