Unsupervised Topic Segmentation of Meetings with BERT Embeddings (Research Paper Walkthrough)

Unsupervised Topic Segmentation of Meetings with BERT Embeddings (Research Paper Walkthrough)

Dec 01, 2021
|
34 views
Details
#bert #research #nlp ⏩ Abstract: Topic segmentation of meetings is the task of dividing multi-person meeting transcripts into topic blocks. Supervised approaches to the problem have proven intractable due to the difficulties in collecting and accurately annotating large datasets. In this paper, we show how previous unsupervised topic segmentation methods can be improved using pre-trained neural architectures. We introduce an unsupervised approach based on BERT embeddings that achieves a 15.5% reduction in error rate over existing unsupervised approaches applied to two popular datasets for meeting transcripts. Sign-up for Email Subscription - https://forms.gle/duSwrYAGw6zUhoGf9 ⏩ OUTLINE: 0:00 - Understanding Problem Statement 02:05 - Example of Meeting Transcript 02:42 - Topic Segmentation Method 04:06 - Sentence Representation Methods(RoBERTa and Sentence-BERT) 06:20 - Segmentation Scheme 07:43 - Results ⏩ Paper Title: Unsupervised Topic Segmentation of Meetings with BERT Embeddings ⏩ Paper: https://arxiv.org/abs/2106.12978 ⏩ Code: https://github.com/gdamaskinos/unsupervised_topic_segmentation ⏩ Author: Alessandro Solbiati, Kevin Heffernan, Georgios Damaskinos, Shivani Poddar, Shubham Modi, Jacques Cali ⏩ Organisation: Facebook Please feel free to share out the content and subscribe to my channel :) ⏩ Subscribe - https://youtube.com/channel/UCoz8NrwgL7U9535VNc0mRPA?sub_confirmation=1 BERT use-cases in NLP: https://www.youtube.com/watch?v=uhnKsGDyhEg&list=PLsAqq9lZFOtX-WN8lldIOI7p-p0lBzjtY ********************************************** If you want to support me financially which is totally optional and voluntary ❤️ You can consider buying me chai ( because I don't drink coffee :) ) at https://www.buymeacoffee.com/TechvizCoffee ❤️ Support using Paypal - https://www.paypal.com/paypalme/TechVizDataScience ********************************************** ⏩ Youtube - https://www.youtube.com/c/TechVizTheDataScienceGuy ⏩ LinkedIn - https://linkedin.com/in/prakhar21 ⏩ Medium - https://medium.com/@prakhar.mishra ⏩ GitHub - https://github.com/prakhar21 ⏩ Twitter - https://twitter.com/rattller ********************************************* Tools I use for making videos :) ⏩ iPad - https://tinyurl.com/y39p6pwc ⏩ Apple Pencil - https://tinyurl.com/y5rk8txn ⏩ GoodNotes - https://tinyurl.com/y627cfsa #techviz #datascienceguy #nlproc #machinelearning #unsupervisedlearning

0:00 - Understanding Problem Statement 02:05 - Example of Meeting Transcript 02:42 - Topic Segmentation Method 04:06 - Sentence Representation Methods(RoBERTa and Sentence-BERT) 06:20 - Segmentation Scheme 07:43 - Results
Comments
loading...