Publications

2026

1. EMNLP Finding 2026

   

   Neuron-Guided Fine-Tuning: Unlocking Efficient Alignment Mechanisms for Large Language Models

   Zeyu Wu, Junchao Wu, Shudong Liu, Runzhe Zhan, Xin Chen, and 6 more authors

   In The 2026 Conference on Empirical Methods in Natural Language Processing, 2026

   Abs Bib

   Existing Supervised Fine-Tuning paradigms, particularly Full Parameter Fine-Tuning are often plagued by parameter redundancy, inconsistent data quality, and catastrophic forgetting, which current methods typically address in isolation and lack a unified optimization signal to bridge data selection, parameter updates, and knowledge preservation. To address this, we propose Neuron-Guided Fine-Tuning (NGFT), a holistic framework that leverages neuron activation patterns as a universal proxy to unify the fine-tuning lifecycle. NGFT operates via three synergistic mechanisms: (1) Adaptive Task-Specific Neuron Selection, which identifies essential neurons in a single forward pass to concentrate updates and reduce redundancy; (2) Activation-Based Data Selection, which prioritizes information-dense samples that maximize contribution to key neurons; and (3) Neuron Activation Alignment, a novel loss function that anchors activations to pre-trained states, deepening representation learning and preserving general knowledge. Experimental results across three models across both domain-specific and general benchmarks demonstrate that NGFT significantly outperforms existing mainstream fine-tuning methods in both efficiency and performance, while effectively mitigating catastrophic forgetting.

   @inproceedings{wu2026neuronguided,
     title = {Neuron-Guided Fine-Tuning: Unlocking Efficient Alignment Mechanisms for Large Language Models},
     author = {Wu, Zeyu and Wu, Junchao and Liu, Shudong and Zhan, Runzhe and Chen, Xin and Yang, Shu and Du, Yichao and Wang, Longyue and Luo, Weihua and Su, Jinsong and Wong, Derek F.},
     booktitle = {The 2026 Conference on Empirical Methods in Natural Language Processing},
     year = {2026},
   }

2. NLPCC 2026

   

   ScienceJudge: Pattern Perturbation Augmentation for Sentence-Level Scientific Claim Verification

   Chuhai Cai, Xin Chen, Min Yang, and Feng Jiang

   In The 15th CCF International Conference on Natural Language Processing and Chinese Computing, 2026

   Abs Bib

   Sentence-level scientific claim verification determines whether each sentence in an AI-generated scientific paragraph is supported by a given multimodal evidence bundle. Fine-grained reporting errors often preserve fluent and plausible statements while introducing subtle evidence–claim deviations, making them difficult to detect under sparse and imbalanced supervision. We propose Pattern Perturbation Augmentation (PPA), which models reporting errors as label-specific faithfulness breaking transformations and induces reusable error patterns from labeled examples. PPA applies these patterns to supported claims to construct controlled hard negatives and expands their coverage through pattern-level, operation-level, and cross-domain augmentation. Based on these augmented views, we develop ScienceJudge, which integrates PPA-trained vision-language predictors and instruction-guided LLM predictors through class-weighted ensemble inference. On the local development set, ScienceJudge improves the average score from 0.8124 to 0.8692, achieving a Macro-F1 of 0.8466 and a Paragraph Exact Match score of 0.8919. Our submitted system ranks first on the official NLPCC 2026 Task 10 Track 1 leaderboard with a final score of 0.6890.

   @inproceedings{cai2026sciencejudge,
     title = {ScienceJudge: Pattern Perturbation Augmentation for Sentence-Level Scientific Claim Verification},
     author = {Cai, Chuhai and Chen, Xin and Yang, Min and Jiang, Feng},
     booktitle = {The 15th CCF International Conference on Natural Language Processing and Chinese Computing},
     year = {2026},
   }

3. ACL Main 2026

   

   Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers

   Xin Chen, Feng Jiang, Yiqian Zhang, Hardy Chen, Shuo Yan, and 3 more authors

   In The 64th Annual Meeting of the Association for Computational Linguistics, 2026

   Abs arXiv Bib HTML

   Reasoning-oriented Large Language Models (LLMs) have achieved remarkable progress with Chain-of-Thought (CoT) prompting, yet they remain fundamentally limited by a \emphblind self-thinking paradigm: performing extensive internal reasoning even when critical information is missing or ambiguous. We propose Proactive Interactive Reasoning (PIR), a new reasoning paradigm that transforms LLMs from passive solvers into proactive inquirers that interleave reasoning with clarification. Unlike existing search- or tool-based frameworks that primarily address knowledge uncertainty by querying external environments, PIR targets premise- and intent-level uncertainty through direct interaction with the user. PIR is implemented via two core components: (1) an uncertainty-aware supervised fine-tuning procedure that equips models with interactive reasoning capability, and (2) a user-simulator-based policy optimization framework driven by a composite reward that aligns model behavior with user intent. Extensive experiments on mathematical reasoning, code generation, and document editing demonstrate that PIR consistently outperforms strong baselines, achieving up to 32.70% higher accuracy, 22.90% higher pass rate, and 41.36 BLEU improvement, while reducing nearly half of the reasoning computation and unnecessary interaction turns. Further reliability evaluations on factual knowledge, question answering, and missing-premise scenarios confirm the strong generalization and robustness of PIR.

   @inproceedings{chen2026reasoning,
     title = {Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers},
     author = {Chen, Xin and Jiang, Feng and Zhang, Yiqian and Chen, Hardy and Yan, Shuo and Xie, Wenya and Yang, Min and Huang, Shujian},
     booktitle = {The 64th Annual Meeting of the Association for Computational Linguistics},
     year = {2026},
   }

4. ICLR 2026

   

   Neuron-Aware Data Selection in Instruction Tuning for Large Language Models

   Xin Chen, Junchao Wu, Shu Yang, Runzhe Zhan, Zeyu Wu, and 4 more authors

   In The Fourteenth International Conference on Learning Representations, 2026

   Abs arXiv Bib HTML

   Instruction Tuning (IT) has been proven to be an effective approach to unlock the powerful capabilities of large language models (LLMs). Recent studies indicate that excessive IT data can degrade LLMs performance, while carefully selecting a small subset of high-quality IT data can significantly enhance their capabilities. Therefore, identifying the most efficient subset data from the IT dataset to effectively develop either specific or general abilities in LLMs has become a critical challenge. To address this, we propose a novel and efficient framework called NAIT. NAIT evaluates the impact of IT data on LLMs performance by analyzing the similarity of neuron activation patterns between the IT dataset and the target domain capability. Specifically, NAIT captures neuron activation patterns from in-domain datasets of target domain capabilities to construct reusable and transferable neuron activation features. It then evaluates and selects optimal samples based on the similarity between candidate samples and the expected activation features of the target capabilities. Experimental results show that training on the 10% Alpaca-GPT4 IT data subset selected by NAIT consistently outperforms methods that rely on external advanced models or uncertainty-based features across various tasks. Our findings also reveal the transferability of neuron activation features across different capabilities of LLMs. In particular, IT data with more logical reasoning and programmatic features possesses strong general transferability, enabling models to develop stronger capabilities across multiple tasks, while a stable core subset of data is sufficient to consistently activate fundamental model capabilities and universally improve performance across diverse tasks.

   @inproceedings{chen2026neuron,
     title = {Neuron-Aware Data Selection in Instruction Tuning for Large Language Models},
     author = {Chen, Xin and Wu, Junchao and Yang, Shu and Zhan, Runzhe and Wu, Zeyu and Yang, Min and Huang, Shujian and Chao, Lidia S. and Wong, Derek F.},
     booktitle = {The Fourteenth International Conference on Learning Representations},
     year = {2026},
   }

5. TACL 2026

   

   Understanding Aha Moments: From External Observations to Internal Mechanisms

   Shu Yang, Junchao Wu, Xin Chen, Yunze Xiao, Xinyi Yang, and 2 more authors

   Transactions of the Association for Computational Linguistics, 2026

   Abs arXiv Bib HTML

   Large Reasoning Models (LRMs), capable of reasoning through complex problems, have become crucial for tasks like programming, mathematics, and commonsense reasoning. However, a key challenge lies in understanding how these models acquire reasoning capabilities and exhibit "aha moments" when they reorganize their methods to allocate more thinking time to problems. In this work, we systematically study "aha moments" in LRMs, from linguistic patterns, description of uncertainty, "Reasoning Collapse" to analysis in latent space. We demonstrate that the "aha moment" is externally manifested in a more frequent use of anthropomorphic tones for self-reflection and an adaptive adjustment of uncertainty based on problem difficulty. This process helps the model complete reasoning without succumbing to "Reasoning Collapse". Internally, it corresponds to a separation between anthropomorphic characteristics and pure reasoning, with an increased anthropomorphic tone for more difficult problems. Furthermore, we find that the "aha moment" helps models solve complex problems by altering their perception of problem difficulty. As the layer of the model increases, simpler problems tend to be perceived as more complex, while more difficult problems appear simpler.

   @article{yang2025aha,
     title = {Understanding Aha Moments: From External Observations to Internal Mechanisms},
     author = {Yang, Shu and Wu, Junchao and Chen, Xin and Xiao, Yunze and Yang, Xinyi and Wong, Derek F. and Wang, Di},
     journal = {Transactions of the Association for Computational Linguistics},
     year = {2026},
   }

2025

1. TACL 2025

   

   RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patterns

   Xin Chen, Junchao Wu, Shu Yang, Runzhe Zhan, Zeyu Wu, and 5 more authors

   Transactions of the Association for Computational Linguistics, 2025

   Abs arXiv Bib HTML

   Detecting content generated by large language models (LLMs) is crucial for preventing misuse and building trustworthy AI systems. Although existing detection methods perform well, their robustness in out-of-distribution (OOD) scenarios is still lacking. In this paper, we hypothesize that, compared to features used by existing detection methods, the internal representations of LLMs contain more comprehensive and raw features that can more effectively capture and distinguish the statistical pattern differences between LLM-generated texts (LGT) and human-written texts (HWT). We validated this hypothesis across different LLMs and observed significant differences in neural activation patterns when processing these two types of texts. Based on this, we propose RepreGuard, an efficient statistics-based detection method. Specifically, we first employ a surrogate model to collect representation of LGT and HWT, and extract the distinct activation feature that can better identify LGT. We can classify the text by calculating the projection score of the text representations along this feature direction and comparing with a precomputed threshold. Experimental results show that RepreGuard outperforms all baselines with average 94.92% AUROC on both in-distribution and OOD scenarios, while also demonstrating robust resilience to various text sizes and mainstream attacks.

   @article{chen2025repreguard,
     title = {RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patterns},
     author = {Chen, Xin and Wu, Junchao and Yang, Shu and Zhan, Runzhe and Wu, Zeyu and Luo, Ziyang and Wang, Di and Yang, Min and Chao, Lidia S. and Wong, Derek F.},
     journal = {Transactions of the Association for Computational Linguistics},
     year = {2025},
   }

2024

1. arXiv

   

   Understanding Reasoning in Chain-of-Thought from the Hopfieldian View

   Lijie Hu, Liang Liu, Shu Yang, Xin Chen, Hongru Xiao, and 4 more authors

   In arXiv preprint, 2024

   Abs arXiv Bib HTML

   Chain-of-Thought (CoT) holds a significant place in augmenting the reasoning performance for large language models (LLMs). While some studies focus on improving CoT accuracy through methods like retrieval enhancement, yet a rigorous explanation for why CoT achieves such success remains unclear. In this paper, we analyze CoT methods under two different settings by asking the following questions: (1) For zero-shot CoT, why does prompting the model with "let’s think step by step" significantly impact its outputs? (2) For few-shot CoT, why does providing examples before questioning the model could substantially improve its reasoning ability? To answer these questions, we conduct a top-down explainable analysis from the Hopfieldian view and propose a Read-and-Control approach for controlling the accuracy of CoT. Through extensive experiments on seven datasets for three different tasks, we demonstrate that our framework can decipher the inner workings of CoT, provide reasoning error localization, and control to come up with the correct reasoning path.

   @inproceedings{hu2024hopfieldian,
     title = {Understanding Reasoning in Chain-of-Thought from the Hopfieldian View},
     author = {Hu, Lijie and Liu, Liang and Yang, Shu and Chen, Xin and Xiao, Hongru and Li, Mengdi and Zhou, Pan and Ali, Muhammad Asif and Wang, Di},
     booktitle = {arXiv preprint},
     year = {2024},
   }

2021

1. ICEIT

   

   "The Canton Canon" Digital Library Based on Knowledge Graph—Taking the Revolutionary Archives of Canton in the Republic of China as an Example

   Junchao Wu, Ying Jiang, Xin Chen, Lingyu Guo, Xiaotong Wei, and 1 more author

   In 2021 IEEE 10th International Conference on Educational and Information Technology (ICEIT), 2021

   Best Presentation DOI Bib HTML Code

   Best Presentation Award

   @inproceedings{wu2021canton,
     title = {"The Canton Canon" Digital Library Based on Knowledge Graph---Taking the Revolutionary Archives of Canton in the Republic of China as an Example},
     author = {Wu, Junchao and Jiang, Ying and Chen, Xin and Guo, Lingyu and Wei, Xiaotong and Yang, Xiaoyan},
     booktitle = {2021 IEEE 10th International Conference on Educational and Information Technology (ICEIT)},
     pages = {171--179},
     year = {2021},
     publisher = {IEEE},
     doi = {10.1109/ICEIT51700.2021.9375538},
   }