Y

YouLibs

Remove Touch Overlay

BERT Masked Language Modelling: Should I pre-train on domain-specific text?

Duration: 20:19Views: 6.9KLikes: 306Date Created: Nov, 2020

Channel: tanmay bakshi

Category: Science & Technology

Description: In this video, I answer a question about BERT: Should I be pre-training a second time, with domain specific text? Usually, BERT is fine tuned directly on a downstream task. However, sometimes there is a limitation for how much data you can get for this task. Therefore, you may want to consider pre-training BERT in an unsupervised fashion on unlabelled data that relates to the domain in which your labelled data sits. Code: github.com/tanmayb123/BertPreTraining

Swipe Gestures On Overlay
Home
Channels
All Videos
Categories
Tags
Related
Infinite Masonry

Related

Sorts:
▼
Filters:
CategoryChannelDate CreatedDurationLikesPopularityTagsTitleViews
▼
1-10mins10-30minspast weekpast monthpast year2021-20242015-2020
  • 16 AMAZING HOME MADE INVENTIONS FROM ANGLE GRINDER / YOU NEED TO SEE 2020Rough Hands and Unusual Ideas03:24:54Jan, 20203.2Mbackgroundvideo thumbnail for: 16 AMAZING HOME MADE INVENTIONS FROM ANGLE GRINDER / YOU NEED TO SEE 2020
  • I Grew Real Spider Silk Using YeastThe Thought Emporium32:47Sep, 20202.3Mbackgroundvideo thumbnail for: I Grew Real Spider Silk Using Yeast
  • Newegg Tried To Bribe Me To Not Make This VideoUFD Tech30:01Feb, 2022600Kbackgroundvideo thumbnail for: Newegg Tried To Bribe Me To Not Make This Video
  • 2.5 Hours Building a Lego Press (no talking, ASMR-ish)Brick Experiment Channel02:38:13Oct, 2018655.2Kbackgroundvideo thumbnail for: 2.5 Hours Building a Lego Press (no talking, ASMR-ish)
  • Orlin's Back... And It's Worse... MUKBANGNikocado Avocado 347:56Dec, 2021809.2Kbackgroundvideo thumbnail for: Orlin's Back... And It's Worse... MUKBANG
  • Taco Bell With Orlin • MUKBANGNikocado Avocado 334:45Sep, 2021578.8Kbackgroundvideo thumbnail for: Taco Bell With Orlin • MUKBANG
  • Wendy's With Orlin • MUKBANGNikocado Avocado 339:41Sep, 2021757.4Kbackgroundvideo thumbnail for: Wendy's With Orlin • MUKBANG
  • How Did Humans Become Earth's Dominant Species? [4K] | Evolution Of Us | SparkSpark47:28Feb, 2022522.8Kbackgroundvideo thumbnail for: How Did Humans Become Earth's Dominant Species? [4K] | Evolution Of Us | Spark
  • Restoration NIKON F50 Vintage Camera | Restore Dedicated mechanical camera NIKON F50 JapanThe Restoration 2R30:19Sep, 2021754Kbackgroundvideo thumbnail for: Restoration NIKON F50 Vintage Camera | Restore Dedicated mechanical camera NIKON F50 Japan
  • Restoration of old rusted generator engine | Restore old 4-stroke gasoline generator HONDA $ 2The Restoration 2R36:46Jun, 20201.2Mbackgroundvideo thumbnail for: Restoration of old rusted generator engine | Restore old 4-stroke gasoline generator HONDA $ 2
    • Items shown
    to: 40
    of:999
    ‹123456...100›