Csépányi-Fürjes, László (2022) Performance analysis of low dimensional word embeddings to support green computing. PRODUCTION SYSTEMS AND INFORMATION ENGINEERING, 10 (2). pp. 27-36. ISSN 1785-1270
|
Text
1840-Article Text-7421-1-10-20220712.pdf Download (351kB) | Preview |
Abstract
It has become increasingly important to pay attention how much energy we use to operate various Artificial Intelligence (AI) and Machine Learning (ML) systems. In order to implement environmentally responsible solutions we need to reconsider our used storage resources and computational power. Training a natural language model is a time and energy demanding process. In recent years the language models are becoming extremely large and the trend is growing. The building process of these models are consuming an extremely large amount of computational power hence these demands huge amounts of energy. In our research we trained and evaluated low dimensional word2vec embedding models and analyzed their performance on building transition based dependency parsers to show that low dimensional models are still competitive and in many use cases may be sufficient.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | green computing, word2vec, transition based dependency parsing |
Subjects: | T Technology / alkalmazott, műszaki tudományok > T2 Technology (General) / műszaki tudományok általában |
Depositing User: | Anita Agárdi |
Date Deposited: | 05 Sep 2022 07:49 |
Last Modified: | 03 Apr 2023 07:57 |
URI: | https://real.mtak.hu/id/eprint/147651 |
Actions (login required)
![]() |
Edit Item |