Search Paper
  • Home
  • Login
  • Categories
  • Post URL
  • Academic Resources
  • Contact Us

 

Merging Language and Domain Specific Models: The Impact on Technical Vocabulary Acquisition

google+
Views: 357                 

Author :  Thibault Rousset1, Taisei Kakibuchi2, Yusuke Sasaki2 and Yoshihide Nomura2

Affiliation :  1McGill University, Canada, 2Fujitsu Research Ltd

Country :  Canada

Category :  NLP

Volume, Issue, Month, Year :  15, 10, May, 2025

Abstract :


Advancements in Natural Language Processing have enabled specialized language models, but integrating domain-specific knowledge into general-purpose models in multilingual settings remains challenging, particularly for technical vocabulary. This paper explores cross-lingual knowledge transfer in model merging, examining how combining a general-purpose language model with a domain-specific model affects technical jargon comprehension. The objective is to evaluate the effectiveness of merging techniques in enhancing domain-specific proficiency while preserving general language understanding. Our study analyzes different merging strategies and their impact on specialized terminology retention. A quantitative evaluation compares the merged model’s performance against its constituent models, offering insights into the strengths and limitations of various approaches. The results demonstrate the potential of model merging for domain adaptation while highlighting challenges in cross-lingual knowledge transfer. These findings provide valuable guidance for optimizing model merging techniques in specialized NLP applications.

Keyword :  Large Language Models, Knowledge Transfer, Model Merging, Domain Adaptation, Natural Language Processing

Journal/ Proceedings Name :  CS & IT

URL :  https://csitcp.org/abstract/15/1510csit01

User Name : alex
Posted 17-07-2025 on 14:22:16 AEDT



Related Research Work

  • A Robust Joint-training Graphneuralnetworks Model For Event Detectionwithsymmetry And A Noisylabels
  • A Self-supervised Tibetan-chinese Vocabulary Alignment Method
  • Identifying Key Terms In Prompts For Relevance Evaluation With Gpt Models
  • A Smart Rpg Game-based English Learning Platform Using Generative Artificial Intelligence And Nature Language Processing

About Us | Post Cfp | Share URL Main | Share URL category | Post URL
All Rights Reserved @ Call for Papers - Conference & Journals