Search results

Async evaluation for HF models (async_hf_model backend)

enhancementNew feature or requestNew feature or request

Status: Open.

#1126 In EvolvingLMMs-Lab/lmms-eval;

· GeoffreyChen777 opened on Feb 21, 2026

When I tested Qwen-2.5-vl-7B on the Videomme dataset, ValueErrorr: The decoder prompt (length 163270) is longer

Status: Open.

#988 In EvolvingLMMs-Lab/lmms-eval;

· LyuQi127 opened on Jan 12, 2026

MVBench dataset average result

Status: Open.

#925 In EvolvingLMMs-Lab/lmms-eval;

· ylllllll opened on Dec 8, 2025

用vllm和不用vllm结果差的很多

Status: Open.

#921 In EvolvingLMMs-Lab/lmms-eval;

· Fu-Fu-Fu-Fu opened on Dec 3, 2025

The LLM Judge function takes too long, resulting in low GPU utilization.

Status: Open.

#908 In EvolvingLMMs-Lab/lmms-eval;

· Fu-Fu-Fu-Fu opened on Nov 20, 2025

Error while runnig lava-onevision-qwen2-7b example

Status: Open.

#860 In EvolvingLMMs-Lab/lmms-eval;

· gabrielsantosrv opened on Oct 17, 2025

Performance gap between python and vLLM backends using the same Qwen2-VL-2B-Instruct model on ChartQA task

Status: Open.

#698 In EvolvingLMMs-Lab/lmms-eval;

· mikittt opened on May 30, 2025

internvl 2.5 8b 和qwen2.5vl的结果

discussion

Status: Open.

Feature

#603 In EvolvingLMMs-Lab/lmms-eval;

· yunzhuzhang0918 opened on Mar 27, 2025