CV

Education

• B.S. in BME, Northeastern University & Chinese Academy of Science, Shenyang, gpa 3.90 and rank 1/116, 2015-2019
• Ph.D in EE, Shanghai Jiao Tong University, National PhD Scholarship (top 2%), 2019-present

Experience

• 2023: Team Leader for Large Foundation Model Research
  • ShanghaiTech University, IDEA Lab.
  • We published the first LLM&CAD study ChatCAD at 2023/2/14. We merged the strengths of LLMs’ medical domain knowledge and logical reasoning with the vision understanding capability of existing medical-image CAD models to create a more user-friendly and understandable system for patients compared to conventional CAD systems.
  • We published the first Chinese medical LLM DoctorGLM at 2023/4/3. Try via this site. Our main focus was on exploring various methods of alignment (SFT/RLHF/RRHF) and different techniques for organizing training data.
• 2019-2022: Researcher for Radiologist’s Eye Gaze in Computer-aided diagnosis
  • Shanghai Jiao Tong University & ShanghaiTech University
  • After watching a Twitch streamer use eye trackers in their game, I realized the potential of eye movements as a source of valuable information. This inspired me to explore the use of eye tracking technology among radiologists to enhance computer-aided diagnosis. You can find further details on this topic at the following cite.
  • I helped to build the eye-tracking lab of ShanghaiTech University’s BME department.
  • I have completed four papers, with three of them being first-authored. Two have been accepted by the top journal TMI, one is currently under review at ICCV23, and another is under review at TNNLS.

Skills

• Python
  • Numpy & PyTorch
  • BeautifulSoup, web crawler
  • Matplotlib
  • GUI (Web and PyQt)
• Training Large Neural Networks
  • DeepSpeed training
  • Quantilization
  • Dataset Design
  • Evaluate Design
• Stable Diffusion
• C++ & OpenGL

Publications

I has published more than 10 academic journals and conference papers including TMI, MedIA and MICCAI. See more detail at my google scholar

Talks

• Radiologist’s Eye Gaze in Computer-aided diagnosis. The 9th Medical Imaging Computing Seminar, MICS2022, Nanjin China. Best Student Talk Award(2/50+).
• How to make CAD network learn efficiently? SJTU BME department seminar, Shanghai China.
• 3D medical image transformer for disease assessment. MLMI 2021, online
• Neural Style Transfer for Mammography. PRIME 2020, online

Teaching

TA, Computer Vision in Biomedical Engineering at Spring 2022.

Service and leadership

• Currently signed in to 43 different slack teams