-
Notifications
You must be signed in to change notification settings - Fork 614
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
pip install ships task configs without their extensionless _*_yaml include files → FileNotFoundError breaks all task loading
bugSomething isn't workingSomething isn't workingStatus: Open.#1350 In EvolvingLMMs-Lab/lmms-eval;OpenAI chat adapter drops text-task ctx, causing lm-eval-harness task mismatch
bugSomething isn't workingSomething isn't workingStatus: Open.#1319 In EvolvingLMMs-Lab/lmms-eval;Add Gemma4 and Qwen3.6 support
enhancementNew feature or requestNew feature or requestStatus: Open.#1315 In EvolvingLMMs-Lab/lmms-eval;Add llama.cpp support
enhancementNew feature or requestNew feature or requestStatus: Open.#1312 In EvolvingLMMs-Lab/lmms-eval;qwen3_5是文本图像多模态模型，但目前只能测评文本
bugSomething isn't workingSomething isn't workingStatus: Open.#1300 In EvolvingLMMs-Lab/lmms-eval;- Status: Open.#1288 In EvolvingLMMs-Lab/lmms-eval;
- Status: Open.#1287 In EvolvingLMMs-Lab/lmms-eval;
MMMU test dataset can be evaluated locally now
enhancementNew feature or requestNew feature or requestStatus: Open.#1284 In EvolvingLMMs-Lab/lmms-eval;uv sync fails on IBM Power 10 linux ppc64le system
bugSomething isn't workingSomething isn't workingStatus: Open.#1283 In EvolvingLMMs-Lab/lmms-eval;- Status: Open.#1259 In EvolvingLMMs-Lab/lmms-eval;
- Status: Open.#1254 In EvolvingLMMs-Lab/lmms-eval;
- Status: Open.#1240 In EvolvingLMMs-Lab/lmms-eval;