Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Alliance Grants

The University of British Columbia

$25,000.00

Reduce the Embedding Space of Code-Language Models, Case Study on R

FY 2023-24

Summary
In the past few years, the advancements of Natural Language Processing (NLP) have risen significantly, including ChatGPT, a Large Language Model (LLM) that is used for various text-related tasks. Similar advancements have been shown for Software Engineering (SE), with code-Language Models (code-LM) such as CoPilot. Code-LMs are adopted for many SE-tasks, e.g., code generation, thus increasing developers' productivity and helping software maintainability. One of the main issues with the current models is that they only consider the popular languages (i.e., Java, Python), leaving out other languages, such as R, that is used by a wide community of statisticians and scientists. The second challenge is that the current models are big, and using them requires heavy computational equipment and GPUs, which are not accessible to many people and even companies. Thus, in this research, we intend to develop smaller code-LMs to make the technology more inclusive and accessible.
Program
Alliance Grants
Location
British Columbia, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
590428-2023
Name nom
Hendijani Fard, Fatemeh FHF
Department département
Okanagan - Irving K Barber Faculty of Arts and Sciences
Organization id
2
Institution établissement
The University of British Columbia
Province en
British Columbia
Province fr
Colombie-Britannique
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2023
Award amount
25000
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
802
Area of application group en
Information and communication services
Area of application group fr
Services d'information et de télécommunications
Area of application en
Information systems and technology
Area of application fr
Systèmes d'information et technologie de l'information
Research subject code
2706
Research subject group en
Information technology
Research subject group fr
Software engineering
Research subject en
Technologie de l'information
Research subject fr
Génie logiciel
Application title
Reduce the Embedding Space of Code-Language Models, Case Study on R
Keyword
Code Language Models; Code Representation Learning; Pre-trained Language Models; R Programming Language; Software Engineering
Application summary
In the past few years, the advancements of Natural Language Processing (NLP) have risen significantly, including ChatGPT, a Large Language Model (LLM) that is used for various text-related tasks. Similar advancements have been shown for Software Engineering (SE), with code-Language Models (code-LM) such as CoPilot. Code-LMs are adopted for many SE-tasks, e.g., code generation, thus increasing developers' productivity and helping software maintainability. One of the main issues with the current models is that they only consider the popular languages (i.e., Java, Python), leaving out other languages, such as R, that is used by a wide community of statisticians and scientists. The second challenge is that the current models are big, and using them requires heavy computational equipment and GPUs, which are not accessible to many people and even companies. Thus, in this research, we intend to develop smaller code-LMs to make the technology more inclusive and accessible.
The University of British Columbia - $25,000 Grant (2… | Canada Spends