GAUDI2_CI=1  RUN_SLOW=1 python3.10 -m pytest tests/test_text_generation_example.py -s -v -k generation_bf16_1x[token0-Qwen/Qwen2-7B-256

Stats:
----------------------------------------------------------------------------------
Input tokens
Throughput (including tokenization) = 8871.747465242199 tokens/second
Memory allocated                    = 62.52 GB
Max memory allocated                = 65.15 GB
Total memory available              = 94.62 GB
Graph compilation duration          = 10.456412034000095 seconds
----------------------------------------------------------------------------------

PASSED

========================================================================================================== warnings summary ===========================================================================================================
tests/test_text_generation_example.py::test_text_generation_bf16_1x[token0-Qwen/Qwen2-7B-256-False-8870.945160540245-True]
  /usr/lib/python3.10/inspect.py:288: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead
    return isinstance(object, types.FunctionType)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
============================================================================================ 1 passed, 65 deselected, 1 warning in 45.94s =============================================================================================