Unsupervised Topic Segmentation of Meetings with BERT Embeddings (Research Paper Walkthrough)

Dec 01, 2021

|

32 views

prakharmishra137

Details

#bert #research #nlp ⏩ Abstract: Topic segmentation of meetings is the task of dividing multi-person meeting transcripts into topic blocks. Supervised approaches to the problem have proven intractable due to the difficulties in collecting and accurately annotating large datasets. In this paper, we show how previous unsupervised topic segmentation methods can be improved using pre-trained neural architectures. We introduce an unsupervised approach based on BERT embeddings that achieves a 15.5% reduction in error rate over existing unsupervised approaches applied to two popular datasets for meeting transcripts. Sign-up for Email Subscription - https://forms.gle/duSwrYAGw6zUhoGf9 ⏩ OUTLINE: 0:00 - Understanding Problem Statement 02:05 - Example of Meeting Transcript 02:42 - Topic Segmentation Method 04:06 - Sentence Representation Methods(RoBERTa and Sentence-BERT) 06:20 - Segmentation Scheme 07:43 - Results ⏩ Paper Title: Unsupervised Topic Segmentation of Meetings with BERT Embeddings ⏩ Paper: https://arxiv.org/abs/2106.12978 ⏩ Code: https://github.com/gdamaskinos/unsupervised_topic_segmentation ⏩ Author: Alessandro Solbiati, Kevin Heffernan, Georgios Damaskinos, Shivani Poddar, Shubham Modi, Jacques Cali ⏩ Organisation: Facebook Please feel free to share out the content and subscribe to my channel :) ⏩ Subscribe - https://youtube.com/channel/UCoz8NrwgL7U9535VNc0mRPA?sub_confirmation=1 BERT use-cases in NLP: https://www.youtube.com/watch?v=uhnKsGDyhEg&list=PLsAqq9lZFOtX-WN8lldIOI7p-p0lBzjtY ********************************************** If you want to support me financially which is totally optional and voluntary ❤️ You can consider buying me chai ( because I don't drink coffee :) ) at https://www.buymeacoffee.com/TechvizCoffee ❤️ Support using Paypal - https://www.paypal.com/paypalme/TechVizDataScience ********************************************** ⏩ Youtube - https://www.youtube.com/c/TechVizTheDataScienceGuy ⏩ LinkedIn - https://linkedin.com/in/prakhar21 ⏩ Medium - https://medium.com/@prakhar.mishra ⏩ GitHub - https://github.com/prakhar21 ⏩ Twitter - https://twitter.com/rattller ********************************************* Tools I use for making videos :) ⏩ iPad - https://tinyurl.com/y39p6pwc ⏩ Apple Pencil - https://tinyurl.com/y5rk8txn ⏩ GoodNotes - https://tinyurl.com/y627cfsa #techviz #datascienceguy #nlproc #machinelearning #unsupervisedlearning

0:00 - Understanding Problem Statement 02:05 - Example of Meeting Transcript 02:42 - Topic Segmentation Method 04:06 - Sentence Representation Methods(RoBERTa and Sentence-BERT) 06:20 - Segmentation Scheme 07:43 - Results

Category: Research Paper

Comments

loading...

Reactions (0) | Note

📝 No reactions yet

Be the first one to share your thoughts!

Reactions(0)

Note

loading...

Recommended

ICAPS 2014: Mike Barley on "Overcoming the Utility Problem in Heuristic Generation: ..."

ICAPS | Aug 7, 2014

ICAPS 2014: Stefan Edelkamp on "Symbolic and Explicit Search Hybrid through Perfect Hash Functions"

ICAPS | Aug 7, 2014

ICAPS 2012: Invited Talk by Anthony Cohn

ICAPS | Aug 15, 2014

ICAPS 2012: Invited talk by George Pappas

ICAPS | Aug 18, 2014

ICAPS 2012: Opening Remark & Invited Talk by Robert Ambrose

ICAPS | Aug 18, 2014