cv
Basics
Name | Dung Nguyen Manh |
Label | Research Resident |
dungnm.workspace@🅖🅜🅐🅘🅛.🅒🅞🅜 |
Work
-
2022 - Present -
2020.05 - 2022.10 Undergraduate Student Researcher
University of Enginering and Technology, Vietnam National University, Hanoi
Education
-
2018 - 2022 Hanoi, Vietnam
Bachelor
University of Enginering and Technology, Vietnam National University, Hanoi
Computer Science
Publications
-
2024.10 CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding Capabilities of CodeLLMs
arXiv preprint arXiv:2410.01999
We present CodeMMLU, a comprehensive multiple-choice question-answer benchmark designed to evaluate the depth of software and code understanding in LLMs.
-
2023.12 The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation
EMNLP 2023
The Vault, a dataset of high-quality code-text pairs in multiple programming languages for training large language models to understand and generate code.
Projects
- 2024.06 - Present
Code LLMs evaluator
Effective universal library for evaluating language model with instant fast inference.
- 2022 - 2023
CodeText-parser
Tree-sitter custom toolkit for break abstract syntax tree (AST) into code (i.e. function, class) properties.
- 2023.05 - 2023.06
Vi-Medicine
Vietnamese illness prediction based on symtomps and medical suggestion, powered by Language models agent and retrieval component.
Languages
Vietnamese | |
Native speaker |
English | |
Fluent |