Publications

Papers & Publications

*Equal First Author, #Corresponding Author

. X -Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning . CVPR 2022

Code PDF

. Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds . CVPR 2022

Code PDF Project Page

. Graph Enhanced Contrastive Learning for Radiology Findings Summarization . ACL 2022

PDF

. Contact-Distil: Boosting Low Homologous Protein Contact Map Prediction by Self-Supervised Distillation . AAAI 2022

PDF

. Medical-VLBERT: Medical Visual Language BERT for COVID-19 CT Report Generation with Alternate Learning . TNNLS

Dataset PDF

. Adaptive Residue-wise Profile Fusion for Low Homologous Protein Secondary Structure Prediction Using External Knowledge . IJCAI 2021

PDF

. PointLIE: Locally Invertible Embedding for Point Cloud Sampling and Recovery . IJCAI 2021

Github PDF

. Box-Aware Feature Enhancement for Single Object Tracking on Point Clouds . ICCV

Github PDF

. Shallow Attention Network for Polyp Segmentation . MICCAI2021

. Colorectal Polyp Classification from White-light Colonoscopy Images via Domain Alignment . MICCAI2021

. Multi-Compound Transformer for Accurate Biomedical Image Segmentation . MICCAI2021

Github

. InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referring . ICCV

Github

. Crystal structure of steroid reductase SRD5A reveals conserved steroid reduction mechanism . Nature Communication

Nature

. Shallow Feature Matters for Weakly Supervised Object Localization . CVPR 2021

CVPR

. PSSM-Distil: Protein Secondary Structure Prediction (PSSP) on Low-Quality PSSM by Knowledge Distillation with Contrastive Learning . AAAI 2021

Github

. Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion . AAAI 2021

Github PDF

. Towards Content-independent Multi-Reference Super-Resolution: Adaptive Pattern Matching and Feature Aggregation . ECCV 2020

ECCV2020 Supplementary

Characterizing Label Errors: Confident Learning for Noisy-labeled Image Segmentation . MICCAI 2020

Github Springer Link

. Adaptive Context Selection for Polyp Segmentation . MICCAI 2020

Springer Link Github

. UXNet: Searching Multi-level Feature Aggregation for 3D Medical Image Segmentation . MICCAI 2020

MICCAI2020

. PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling . CVPR 2020

arxiv Github

. Exemplar Normalization for Learning Deep Representation . CVPR 2020

CVPR

. Semi-Supervised Video Salient Object Detection Using Pseudo-Labels . ICCV 2019

arxiv Github

, WaveNano: a signal-level nanopore base-caller via simultaneous prediction of nucleotide labels and move labels through bi-directional WaveNets. . Quantitative Biology, 2018.

Springer link

. Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model . PLOS Computational Biology, 2017. (official 1st for CASP12, Highly cited paper of web of science, PLOS Computational Biology Research Prize 2018 in the category Breakthrough Advance/Innovation.).

arxiv link to CASP12

. High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inference . ICCV 2017(spotlight, 2.61%)

arxiv

. Folding membrane proteins by deep transfer learning , Cell Systems，2017 5(3):202-211.(Cover Letter Paper)

cell page

. Predicting membrane protein contacts from non-membrane proteins by deep transfer learning . The 21st International Conference on Research in Computational Molecular Biology (RECOMB) 2017

arxiv

, Protein Secondary Structure Prediction Using Cascaded Convolutional and Recurrent Neural Networks , Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (IJCAI), New York

IJCAI page Paper repo on Github

. LSTM-CF: Unifying Context Modeling and Fusion with LSTMs for RGB-D Scene Labeling . European Conference on Computer Vision (ECCV), Amsterdam

arxiv Paper repo on Github

Highlighted

Highlighted Projects

CVPR 2022
Code Paper

CVPR 2022
Code Paper Project Page

TNNLS
Dataset

MICCAI2021

Nature Communication
Link

CVPR 2021
PDF Github

ICCV 2021
PDF Github

ICCV 2021
PDF Github

AAAI 2021
PDF Github

AAAI 2021
PDF Github

ECCV 2020
PDF

MICCAI 2020
PDF Github

CVPR 2020
PDF Paper repo on Github

ECAI 2020

International Conference on Computer Vision (ICCV), Venice, October 2017. (ICCV spotlight, 2.61%)
PDF

Cell Systems，2017 5(3):202-211.(Cover Letter Paper)
Cell Seystms Page

PLOS Computational Biology, 2017 (official 1st for CASP12, Highly cited paper of web of science, PLOS Computational Biology Research Prize 2018 in the category Breakthrough Advance/Innovation.)
PLOS page link to CASP12

ECCV 2016
PDF Paper repo on Github

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (IJCAI), New York
PDF Paper repo on Github

Awards

Awards & Honors

  • Candidate for the 7th China Association for Science and Technology Young Talent Support Project
  • CCF-Tencent Rhino bird 2019 Award.
  • PLOS Computational Biology Research Prize 2018 in the category Breakthrough Advance/Innovation.

Professional activities

Conference Reviewer/Program Committee & Journal Reviewer

Conference Reviewer/Program Committee

  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR): 2022
  • European Conference on Computer Vision (ECCV): 2022
  • AAAI Conference on Artificial Intelligence (AAAI): 2022
  • Medical Image Computing and Computer Assisted Intervention (MICCAI): 2020-2022
  • International Conference on Computer Vision (ICCV): 2019-2021

Journal Reviewer

  • IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2020
  • IEEE Transactions on Multimedia (TMM), 2018

Teaching

Classroom & Workshop leadership

CIE6032&MDS6232

  • Deep Learning and its Applicaitons

EIE4512

  • Digital Image Processing

Current Students

Postdoc

Xiaozhe Gu

Real-time System
Scheduling Algorithm
Machine Learning.
2018, Ph.D., Nanyang Technological University, Singapore

Ph.D. Students

Ph.D. Year 4

Guangyi Liu

Text Generation
2018, B.S., University of Electronic Science and Technology of China

Weibing Zhao

Super-Resolution
Point Cloud Upsampling
2018, B.S., Beijing Normal University

Ph.D. Year 3

Xu Yan

Point Cloud Analysis
2019, M.S., CUHKSZ
2018, B.S., Sun Yat-sen University
SRIBD Fellowship

Qin Wang

Protein Structure Prediction
2019, B.S., Sun Yat-sen University
SRIBD Fellowship

Ph.D. Year 2

Yinghong Liao

Domain Adaptation, Multi-modal
2020, B.S., Sun Yat-sen University

Yiwen Hu

Medical Image Analysis
2020, B.S., Anhui Medical University

Wending Zhou

Domain Adaptation
2020, B.S., University of Waterloo

Yuncheng Jiang

Medical Image Analysis
2020, B.S., University of Electronic Science and Technology of China

Heshen Zhan

Domain Adaptation/Generalization, Robust Representation learning
2020, B.S., Jilin University

Chaoda Zheng

Point Cloud Analysis
2020, M.S. & B.S., South China University of Technology
SRIBD Fellowship

Jun Wei

Weakly Supervised learning
Medical Image Analysis
2020, M.S., Institute of Computing Technology, Chinese Academy of Sciences
B.S., HUST
CUHKSZ Presidential Fellowship

Ph.D. Year 1

Zixun Zhang

NAS, Pruning, Knowledge Distillation
2021, M.S. & B.S., Dalian University of Technology

Haiming Zhang

Point Cloud, Talking Face, GAN
2021 M.S. & B.S., Beijing Institute of Technology

Zhihao Yuan

Vision and Language
3D Scene Understanding
2021, B.S., Sun Yat-sen University

Huijun Xing

Federated learning
Medical Image Analysis
Air computation system
2021, B.S., Beihang University

Zhuo Li

Time Series
2021, B.S., Central South University

M.Phil. Students

M.Phil. Year 3

Shen Gao

Medical Image Analysis
2019 B.S., CUHKSZ

M.Phil. Year 2

Weizhen Ding

Medical Image Analysis
2020 B.S., CUHKSZ

Yingfeng Lu

Protein Structure Prediction
2020, B.S., Shanghai Jiao Tong University

M.Phil. Year 1

Shixi Qin

Medical Image Analysis
2021, B.S., CUHKSZ

Rui Sun

Domain Generalization
GAN, AI Fairness
2021, M.S., CityU

Research Assistant

Jiajian Ma

Computational Neuroscience
Medical Image Analysis
2021 M.D., Peking University Health Science Center

Shuangyi Tan

Medical Image Analysis
2022 M.S., London's Global University; B.S., South China University of Technology

Yatong Han

Multimodal Learning
Graph Learning
Computational Biological
2022, Ph.D., Harbin Engineering University

Yuzhe Zhou

Protein Structure Analysis
2021, M.S., HKUST
2020, B.S., University of Electronic Science and Technology of China

Contact