Yuheng Ji (冀昱衡)
My name is Yuheng Ji, a lyric poet, a passionate lover of life and a master student at degree Chinese Academy of Science, Institute of Automation (CASIA).
I'm supervised by Prof. Xiaolong Zheng in iBasic. My research interests include multi-modal representation learning, efficient modeling and adversarial robust in machine learning.
Email  / 
Google Scholar  / 
Poetry Anthology
|
|
Research
My research interests mainly multi-modal representation learning, efficient modeling and adversarial robust in machine learning.
* denotes equal contributions.
|
|
AdvLoRA: Adversarial Low-Rank Adaptation of Vision-Language Models
Yuheng Ji*,
Yue Liu*,
Zhicheng Zhang,
Zhao Zhang,
Yuting Zhao,
Gang Zhou,
Xingwei Zhang,
Xinwang Liu,
Xiaolong Zheng
Arxiv, 2024
Paper
We propose a parameter-efficient adversarial adaptation method named AdvLoRA by low-rank adaptation to improve the robustness of vision-language models.
|
|
Learning Hash Subspace from Large-Scale Multi-modal Pre-Training: A CLIP-Based Cross-modal Hashing Framework
Yuheng Ji*,
Xingwei Zhang*,
Gang Zhou,
Xiaolong Zheng,
Daniel Dajun Zeng
China Conference on Command and Control (Outstanding Paper Award), 2023
Paper
We propose a cross-modal hashing framework called CCMH (CLIP-based Cross-Modal Hashing), which facilitates the transferability of a well-trained real-value semantic subspace to a hash semantic subspace.
|
- Reviewer for ICLR'25
- Reviewer for AAAI'25
- Reviewer for ACM MM'24
- [2024] Merit Student, UCAS, School Award.
- [2023] Outstanding Graduates, Provincial Award.
- [2022] Recommendation for admission to CASIA.
- [2022] Merit Student, Provincial Award.
- [2022] China National Scholarship for Undergraduate Student, National Award.
- [2021] China National Scholarship for Undergraduate Student, National Award.
- [2020] China National Scholarship for Undergraduate Student, National Award.
- [2019-2023] Scholarships, School Award.
- [2024] 冀昱衡, 张曌, 张兴伟, 郑晓龙, "大模型微调中的低秩性," 中国指挥与控制学会通讯.
- [2023] 冀昱衡, 张兴伟, 郑晓龙, "基于多模态预训练的跨模态检索算法研究," 中国指挥与控制学会通讯 46 (4), 10-16.
- [2023] 一种基于多模态预训练的跨模态哈希检索系统,发明专利,第一发明人
- [2023] 一种基于图神经网络的信用卡欺诈检测系统,发明专利,第一发明人
- [2023] 一种针对检索模型的在线隐私保护系统,发明专利,第二发明人
- [2022] 一种基于新闻主题句的文本情感分类系统,发明专利,第二发明人
Participation in Research Projects
在攻读硕博期间参与了以下项目研究,主要负责项目中跨模态信息语义融合与理解等专题研究工作:
|
- 基于多模态数据融合的智能社会风险预警研究, 国家自然科学基金重点项目.
- 新技术驱动的复杂社会系统管理, 国家杰出青年科学基金项目.
- 信息技术支撑国家治理现代化的战略研究, 中国科学院学部重大咨询项目.
- 跨模态多语言大数据驱动的社会风险感知与理解, 2030—“新一代人工智能”重大项目.
Design and source code from Jon Barron's website
|