cv

Basics

Name Juyi Lin
Label PhD Student in Computer Engineering
Email lin.juy@northeastern.edu
Phone (+1) 617-212-8191
Url https://lukelin-web.github.io
Summary PhD student at Northeastern University working on generative world models, video reasoning benchmarks, and efficient Vision-Language-Action models. Advisor: Prof. Yanzhi Wang.

Education

  • 2024.09 - Present

    Boston, US

    PhD student
    Northeastern University, Boston, US
    Computer Engineering
    • GPA: 3.92/4
    • Advisor: Prof. Yanzhi Wang
  • 2022.09 - 2024.05

    Thuwal, Saudi Arabia

    Master of Science
    King Abdullah University of Science and Technology
    Computer Science
    • GPA: 3.71/4
    • Advisor: Marco Canini
  • 2018.09 - 2022.06

    Hangzhou, China

    Bachelor of Engineering
    Zhejiang University
    Electronic Engineering
    • GPA: 3.75/4

Work

  • 2026.05 - 2026.09
    Research Intern
    Futurewei Technologies, Inc.
    Research Intern, Generative AI & World Modeling team.
    • Built LEAP end to end on Qwen3-Omni-30B-A3B for hour-scale audio-visual QA: the localization and answer stages, their two LoRAs, and the evaluation harness behind all reported numbers.
    • Method: per-block localization picks evidence windows; one bounded answer pass re-encodes only those windows.
    • Results: +4.5–16.8 pp over the Qwen3-Omni baseline on TraceAV, LVOmni, VideoOdyssey (1–4 h) and MMOU; transfers to MiniCPM-o 4.5 (+3.1–13.0 pp over its published results); answer input and peak context stay independent of recording duration; supports causal/streaming queries without streaming-specific training.
  • 2022.03 - 2022.07
    Infrastructure Engineering Intern
    Beijing VirtAI Tech
    • Integrated the PaddlePaddle distributed training library and Deep Graph Library (DGL) into the in-house performance measurement system, extending it to two new framework backends.
    • Profiled PaddlePaddle distributed training and reported its scaling bottlenecks to the platform team.

Projects

  • 2025.09 - 2026.03
    Physical Reasoning Benchmark for Generative World Models
    NEU, Sept 2025 – Mar 2026
    • Proposed and built PhyGround, a criteria-grounded benchmark for physical reasoning in generative video world models built on 250 curated prompts and a taxonomy of 13 physical laws (mechanics, fluids, optics); evaluated 8 video models against it.
    • Led a large-scale human annotation study: 459 annotators, 5,796 complete annotations, 37.4K+ fine-grained labels, with split-half ranking correlation Spearman's ρ > 0.90.
    • Trained and released PhyJudge-9B, an open physics-specialized VLM judge reaching 3.3% aggregate relative bias vs. 16.6% for Gemini-3.1-Pro.
  • 2025.09 - 2026.01
    Video Reasoning Benchmark
    NEU, Sept 2025 – Jan 2026
    • Proposed and co-led (team of 22) VBVR-EvalKit, a reasoning benchmark for video generation models, evaluating 9 models (4 proprietary, 5 open-weight).
    • Designed the data-generation and benchmark framework, set the roadmap, and contributed core code and evaluation metrics; shipped an open-source ecosystem with 100+ synthetic data generators.
    • Built a dataset of 200 curated reasoning tasks and 1M+ video clips, 1000× larger than prior datasets; released eval suite = 100 tasks × 5 samples (500 videos).
  • 2025.01 - 2025.09
    Vision Language Action (VLA) Model
    NEU & Funded by EmbodyX, Jan 2025 – Sept 2025
    • Proposed VOTE, a fine-tuning framework for parallel VLA action prediction, using an ensemble voting strategy over sampled actions to cut compute while improving success and generalization; adopted by Cisco and EmbodyX.
    • +20% average success over OpenVLA across four LIBERO suites, +7% over the state-of-the-art VLA model on SimplerEnv WidowX, and 39× faster action generation on NVIDIA Jetson Orin.
    • Pretrained Llama3.2-1B into a VLM and fine-tuned it with VOTE, beating 7B OpenVLA by 16% average success across the four LIBERO suites.

Publications

Volunteer

  • 2023.01 - Present

    Reviewer & Program Committee
    ICLR / ICANN / AAAI / WACV / EuroSys
    • ICLR-27 Reviewer, NeurIPS-26 DiffuLM Workshop Reviewer, ICANN-26 Reviewer, AAAI-26/27 & WACV-27 LVR Workshop Program Committee, EuroSys'23 Shadow PC Reviewer
    • Artifact Evaluation: MLSys'23, EuroSys'24/25, OSDI'24 & ATC'24
    • Open Source Promotion Plan 2023

Skills

Programming Languages
Python
C++
Golang
Bash
Matlab
SQL
C
Tools
Git
LaTeX
Docker
Libraries/Frameworks
PyTorch
LoRA
Transformers
Diffusers
Opencompass
LLaMA-Factory
ms-swift
Numpy