Junjie Chen

I'm an applied scientist working on multimodal LLM systems and LLM evaluation. I enjoy learning from the product development cycle: understanding the requirement, building the system, and evaluating and triaging the true requirement.

I'm currently a postdoctoral researcher at the University of Oxford, where I build and evaluate end-to-end comic translation. In parallel, I am developing an audio-only heart-rate monitoring algorithm for Marley Health. Before that I was an Amazon Science Fellow working on LLM manga translation, and a research intern at Rakuten working on explainable PII detection. I received my Ph.D. in Computer Science from the University of Tokyo.

Email  /  Resume  /  Scholar  /  Semantic Scholar  /  Github

profile photo

Experience

Postdoctoral Researcher, University of Oxford — May 2026 – present
Amazon Science Fellow, Amazon, Tokyo — Aug 2025 – Feb 2026
Research Intern, Rakuten, Tokyo — Nov 2024 – Feb 2025
Research Assistant, LLM-jp, National Institute of Informatics — Jun 2024 – Feb 2025

Education

Ph.D. in Computer Science, The University of Tokyo — 2021 – 2025
M.S. in Computer Science, The University of Tokyo — 2019 – 2021
B.S. in Software Engineering, Northeastern University (China) — 2015 – 2019

Grants

Travel Grant ($2,000), AAAI — 2025
Special Allowance for Outstanding Student, JSPS — 2024
DC2 Doctoral Fellowship, Japan Society for the Promotion of Science (JSPS) — 2023
IST-RA Fellowship, The University of Tokyo — 2022

My Research

I am interested in Natural Language Processing, Multimodal Machine Translation, and Signal Processing. Currently, I want to understand the factor that makes human like or dislike a comic translation. My PhD research on unsupervised parsing is to find a measurable proxy to "syntax/semantic units in languages".

Below are my 11 publications, including ICLR (Spotlight), ACL (Oral), NAACL, and AAAI (Oral). They're also on Google Scholar.

Improving Unsupervised Constituency Parsing via Maximizing Semantic Information
Junjie Chen, Xiangheng He, Yusuke Miyao, Danushka Bollegala
ICLR, 2025  (Spotlight)
paper / code / poster
ProsodyFM: Unsupervised Phrasing and Intonation Control for Intelligible Speech Synthesis
Xiangheng He, Junjie Chen, Zixing Zhang, Björn W. Schuller
AAAI, 2025  (Oral)
paper
Constituents are Frequent Word Sequences among Sentences with Equivalent Predicate-Argument Structures: Unsupervised Constituency Parsing by Span Matching
Junjie Chen, Xiangheng He, Danushka Bollegala, Yusuke Miyao
Findings of ACL, 2024
paper / code / slides
Language Model Based Unsupervised Dependency Parsing with Conditional Mutual Information and Grammatical Constraints
Junjie Chen, Xiangheng He, Yusuke Miyao
NAACL, 2024
paper / code / slides
Task Selection and Assignment for Multi-Modal Multi-Task Dialogue Act Classification with Non-Stationary Multi-Armed Bandits
Xiangheng He, Junjie Chen, Björn W. Schuller
ICASSP, 2024
paper
Modeling Syntactic-Semantic Dependency Correlations in Semantic Role Labeling Using Mixture Models
Junjie Chen, Xiangheng He, Yusuke Miyao
ACL, 2022  (Oral)
paper / code / poster
Syntactic-Semantic Dependency Correlation in Semantic Role Labeling: A Shift in Semantic Label Distributions
Junjie Chen
Journal of Natural Language Processing, 2022
paper
An Improved StarGAN for Emotional Voice Conversion: Enhancing Voice Quality and Data Augmentation
Xiangheng He, Junjie Chen, Georgios Rizos, Björn W. Schuller
Interspeech, 2021
paper
A System for Worldwide COVID-19 Information Aggregation
Akiko Aizawa, Frédéric Bergeron, Junjie Chen, et al.
NLP-COVID19 Workshop @ EMNLP, 2020
paper
A Pattern-Based Method for Medical Entity Recognition from Chinese Diagnostic Imaging Text
Zihong Liang, Junjie Chen, Zhaopeng Xu, Yuyang Chen, Tianyong Hao
Frontiers in Artificial Intelligence, 2019
paper
A Bibliometric Analysis of the Research Status of the Technology Enhanced Language Learning
Xieling Chen, Juntao Hao, Junjie Chen, Songshou Hua, Tianyong Hao
SETE, 2018
paper

Website template from Jon Barron.