Yue Qiu

🏢 Central 1, 1-1-1 Umezono, Tsukuba, Ibaraki 305-8560, JAPAN

📧 qiu.yue [at] aist.go.jp

☎️ 029-861-6442

About me

I am a researcher with the Computer Vision Research Team at the National Institute of Advanced Industrial Science and Technology (AIST) [site]. My research interests include Computer Vision, Vision and Language, and 3D Vision. I am passionate about developing AI systems that can perceive the world and think similarly to humans, with a focus on interpretability.

In addition to my research, I have a strong enthusiasm for language learning. I am a native Chinese speaker, proficient in Japanese and English for communication and academic writing. I can engage in casual conversations in French (DELF B1) and Italian (CELI A2), and I am a beginner learner of Arabic.

Work Experience

Oct, 2021 – present Researcher, Computer Vision Research Team, National Institute of Advanced Industrial Science and Technology
Apr, 2021 – Sep, 2021 Postdoctoral Researcher, Computer Vision Research Team, National Institute of Advanced Industrial Science and Technology
May, 2017 – Mar, 2021 Research Assistant, Computer Vision Research Team, National Institute of Advanced Industrial Science and Technology

Education

Apr, 2018 – Mar, 2021 Ph.D., Department of Computer Science, University of Tsukuba (Japan)
Apr, 2016 – Mar, 2018 MS, Department of Computer Science, University of Tsukuba (Japan)
Sep, 2009 – Jun, 2014 B.S., Department of Software Engineering, HeFei University of Technology (China)

Ph.D. Thesis

Research on Evaluation and Improvement of Image Recognition Performance Focusing on Observation Viewpoint, Department of Computer Science, University of Tsukuba, Doctor of Engineering, 2021.04 (Advisor: Yutaka Satoh). [Thesis Paper]

Reviewer for Conferences

CVPR2024, ICCV2023, WACV2023, NeurIPS2022, ECCV2022, CVPR2022, IROS2022, ICPR2022, BMVC2021

Selected Publications

Books

Vision Transformer入門 (Computer Vision Library), 山本晋太郎, 徳永匡臣, 箕浦大晃, 邱玥(QIU YUE), 品川政太朗, 片岡裕雄, 技術評論社 (September 17, 2022).

Journal Articles

TransFusionOdom: Transformer-based LiDAR-Inertial Fusion Odometry Estimation, Leyuan Sun, Guanqun Ding, Yue Qiu, Yusuke Yoshiyasu, Fumio Kanehiro. IEEE Sensors Journal, 2023.08. [Paper]
Outdoor Vision-and-Language Navigation Needs Object-Level Alignment, Yanjun Sun, Yue Qiu, Yoshimitsu Aoi, Hirokatsu Kataoka Sensors, 23(13), 6028, 2023.06. [Paper]
Indoor Scene Change Captioning Based on Multimodality Data, Yue Qiu, Yutaka Satoh, Ryota Suzuki, Kenji Iwata, Hirokatsu Kataoka. Sensors, vol.20, 17, pp.4761-4778, 2020.08. [Paper]
3D-Aware Scene Change Captioning from Multiview Images, Yue Qiu, Yutaka Satoh, Ryota Suzuki, Kenji Iwata, Hirokatsu Kataoka. IEEE Robotics and Automation Letters, vol.5, 3, pp.4743-4750, 2020.07. [Paper]
Multi-View Visual Question Answering with Active Viewpoint Selection, Yue Qiu, Yutaka Satoh, Ryota Suzuki, Kenji Iwata, Hirokatsu Kataoka. Sensors, vol.20, 8, pp.2281-2294, 2020.04. [Paper]

Peer Reviewed Conference Papers

DailySTR: A Daily Human Activity Pattern Recognition Dataset for Spatio-temporal Reasoning, Yue Qiu, Shusaku Egami, Ken Fukuda, Natsuki Miyata, Takuma Yagi, Kensho Hara, Kenji Iwata, Ryusuke Sagawa, International Conference on Intelligent Robots and Systems (IROS), 2024. (accepted)
Subtle-Diff: A Dataset for Precise Recognition of Subtle Differences Among Visually Similar Objects, Fumiya Matsuzawa, Yue Qiu, Yanjun Sun, Kenji Iwata, Hirokatsu Kataoka, Yutaka Satoh, International Conference on Intelligent Robots and Systems (IROS), 2024. (accepted)
Indoor Scene Change Understanding (SCU): Segment, Describe, and Revert Any Change, Mariia Khan, Yue Qiu, Yuren Cong, Bodo Rosenhahn, David Suter, Jumana Abu-Khalaf, International Conference on Intelligent Robots and Systems (IROS), 2024. (accepted)
The STVchrono Dataset: Towards Continuous Change Recognition in Time, Yanjun Sun*, Yue Qiu*, Mariia Khan, Fumiya Matsuzawa, Kenji Iwata; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024. (*equal contribution) [Paper]
Guided by the Way: The Role of On-the-route Objects and Scene Text in Enhancing Outdoor Navigation, Yanjun Sun, Yue Qiu, Yoshimitsu Aoki, Hirokatsu Kataoka; IEEE International Conference on Robotics and Automation (ICRA), 2024.
Graph Representation for Order-Aware Visual Transformation, Yue Qiu, Yanjun Sun, Fumiya Matsuzawa, Kenji Iwata, Hirokatsu Kataoka; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Paper]
Question Generation to Disambiguate Referring Expressions in 3D Environment, Fumiya Matsuzawa, Ryo Nakamura, Kodai Nakashima, Yue Qiu, Hirokatsu Kataoka, Yutaka Satoh; CVPR 2023 Embodied AI workshop, 2023. [Paper]
Boosting Outdoor Vision-and-Language Navigation with On-the-route Objects, Yanjun Sun, Yue Qiu, Yoshimitsu Aoki, Hirokatsu Kataoka; CVPR 2023 Embodied AI workshop, 2023. [Paper]
Question Generation for Uncertainty Elimination of Referring Expression in 3D Environment, Fumiya Matsuzawa, Yue Qiu, Kenji Iwata, Hirokatsu Kataoka, Yutaka Satoh, IEEE International Conference on Robotics and Automation (ICRA), 2023.
3D Change Localization and Captioning from Dynamic Scans of Indoor Scenes, Yue Qiu, Shintaro Yamamoto, Ryosuke Yamada, Ryota Suzuki, Hirokatsu Kataoka, Kenji Iwata, Yutaka Satoh, IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023. [Paper]
VirtualHome Action Genome: A Simulated Spatio-Temporal Scene Graph Dataset with Consistent Relationship Labels, Yue Qiu, Yoshiki Nagasaki, Kensho Hara, Hirokatsu Kataoka, Ryota Suzuki, Kenji Iwata, Yutaka Satoh, IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023. [Paper]
Multi-object Multi-step Visual Transformation, Yue Qiu, Fumiya Matsuzawa, Kenji Iwata, Hirokatsu Kataoka, ECCV 2022 Causality in Vision Workshop (ECCVW CIV), 2022.
Scene Change Captioning in Real Scenarios, Yue Qiu, Kodai Nakashima, Yutaka Satoh, Ryota Suzuki, Kenji Iwata, Hirokatsu Kataoka, 24nd International Conference on Humancomputer Interaction (HCI), pp. 405-419, 2022. [Paper]
Home Action Genome Challenge: Task 2, Kensho Hara, Yasufumi Kawano, Yoshiki Nagasaki, Hirokatsu Kataoka, Yue Qiu, International Challenge on Activity Recognition (ActivityNet), CVPR 2021 Workshop, Home Action Genome Challenge: Task 2, [Slide]
Describing and Localizing Multiple Changes with Transformers, Yue Qiu, Shintaro Yamamoto, Kodai Nakashima, Ryota Suzuki, Kenji Iwata, Hirokatsu Kataoka, Yutaka Satoh, International Conference on Computer Vision (ICCV), 2021. [Project page]
3D-Aware Scene Change Captioning From Multiview Images, Yue Qiu, Yutaka Satoh, Ryota Suzuki, Kenji Iwata, Hirokatsu Kataoka, International Conference on Intelligent Robots and Systems (IROS), 2020. [Paper]
Multi-view Visual Question Answering Dataset for Real Environment Applications, Yue Qiu, Yutaka Satoh, Ryota Suzuki and Kenji Iwata, 22nd International Conference on Humancomputer Interaction (HCI), pp. 384-395, 2020. [Paper]
Single Image Contrast Enhancement by Training the HDR Camera data, Kenji Iwata, Ryota Suzuki, Yue Qiu and Yutaka Satoh, 22nd International Conference on Human-computer Interaction (HCI), pp.585-595, 2020. [Paper]
Incorporating 3D Information Into Visual Question Answering, Yue Qiu, Yutaka Satoh, Hirokatsu Kataoka and Ryota Suzuki, 2019 International Conference on 3D Vision (3DV), Québec City, QC, Canada, pp. 756-765, 2019. [Paper]
Incorporating 3D Information Into Visual Question Answering, Yue Qiu, Yutaka Satoh, Kazuma Asano, Kenji Iwata, Ryota Suzuki and Hirokatsu Kataoka, ICCV 2019 3rd Workshop (ICCVW) on Closing the Loop Between Vision and Language, 2019.
Incorporating Depth into Visual Question Answering, Yue Qiu, Hirokatsu Kataoka, Ryota Suzuki, CVPR 2019 Visual Question Answering and Dialog Workshop (CVPRW VQA), 2019.
Visual Question Answering with RGB-D Images, Yue Qiu, Hirokatsu Kataoka, CVPR 2019 Women in Computer Vision Workshop (CVPRW WiCV), 2019. [Paper]
Image Generation Associated With Music Data, Yue Qiu, Hirokatsu Kataoka, CVPR 2018 Sight and Sound Workshop (CVPRW), 2018. [Paper]
AI-Based VR Earthquake Simulator, Ryota Suzuki, Ryoki Iitoi, Yue Qiu, Kenji Iwata, Yutaka Satoh, 20th International Conference on Human-computer Interaction (HCI), pp. 213222, 2018. [Paper]
Fashion Culture Database: Construction of Database for World-wide Fashion Analysis, Kaori Abe, Munekata Minoguchi, Teppei Suzuki, Tomoyuki Suzuki, Naofumi Akimoto, Yue Qiu, Ryota Suzuki, Kenji Iwata, Yutaka Satoh, Hirokatsu Kataoka, 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp.1721-1726, 2018. [Paper]
Sensing and recognition of typical indoor family scenes using an RGB-D camera, Yue Qiu, Yutaka Satoh, Ryota Suzuki, Hirokatsu Kataoka, CVPR 2017 Women in Computer Vision Workshop (CVPRW WiCV), 2017.