4e292eaaae308068e9d40ac974feac2e9598c48c
model_backend.py was using Python-style exclusive end (layers[start:end]) while all callers (CLI, tests, QUICKSTART) use inclusive 0-based indexing. Result: 24-layer model with shard_end=23 ran only 23 layers and never set is_tail=True, so decode_tail() was never called and responses were empty. - is_tail: == total_layers → >= total_layers - 1 - _run_layers: layers[start:end] → layers[start:end+1] - Validation: > total_layers → >= total_layers (was also wrong) Inference confirmed: Qwen2.5-0.5B-Instruct now returns real LLM output. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Description
No description provided
Languages
Python
94.7%
HTML
5%
JavaScript
0.2%