python runtime_error ai_generated true

FAILED tests/test_b.py::test_uses_cache - KeyError: 'user:42' # 单独运行时通过: pytest tests/test_b.py::test_uses_cache

FAILED tests/test_b.py::test_uses_cache - KeyError: 'user:42' # passes when run alone: pytest tests/test_b.py::test_uses_cache

ID: python/pytest-flaky-ordering-dependency

其他格式: JSON · Markdown 中文 · English
80%修复率
87%置信度
0证据数
2024-07-30首次发现

版本兼容性

版本状态引入弃用备注
7.x active — — —
8.x active — — —

根因分析

test_b 依赖 test_a 写入的状态（模块级缓存、全局变量或共享数据库行），pytest 默认按文件顺序运行；单独运行或使用 -p 随机排序会改变顺序。

English

test_b relies on state written by test_a (module-level cache, global, or shared DB row) and pytest's default ordering runs them in file order; running in isolation or with -p randomly changes order.

generic

解决方案

  1. 95% 成功率 
    @pytest.fixture
def seeded_cache(cache):
    cache['user:42'] = {'name': 'Alice'}
    return cache

def test_uses_cache(seeded_cache):
    assert seeded_cache['user:42']['name'] == 'Alice'
  2. 85% 成功率 
    # pyproject.toml
[tool.pytest.ini_options]
addopts = "-p no:randomly"  # only in local dev

# CI:
pytest -p randomly --randomly-seed=random -x
# Then refactor tests that fail only under reordering

无效尝试

常见但无效的做法:

  1. 80% 失败

    A fixed seed gives the same order locally but CI may use a different seed; the inter-test dependency remains a latent bug.

  2. 75% 失败

    Couples tests by name and breaks under -p no:randomly or when parallelized with xdist.