Skip to content

[Bug]: SDXL olive optimized and running 2nd have memory not enough #410

Open
@Jay19751103

Description

Checklist

  • The issue exists after disabling all extensions
  • The issue exists on a clean installation of webui
  • The issue is caused by an extension, but I believe it is caused by a bug in the webui
  • The issue exists in the current version of the webui
  • The issue has not been reported before recently
  • The issue has been reported before but has not been fixed yet

What happened?

System
AMD 7600XT 16GB VRAM
32GB System RAM
200GB swapping.

  1. When use olive directly, it can run every inference
  2. Using this webUI, 2nd will have following
    Olive implementation is experimental. It contains potentially an issue and is subject to change at any time.
    ONNX: processing=StableDiffusionProcessingTxt2Img, pipeline=OnnxStableDiffusionXLPipeline
    100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [02:48<00:00, 8.44s/it]
    2024-03-05 17:52:48.2647133 [E:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteKernel] Non-zero status code returned while running GroupNorm node. Name:'GroupNorm_22' Status Message: D:\a_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2571)\onnxruntime_pybind11_state.pyd!00007FFE7621DA68: (caller: 00007FFE769851B1) Exception(4) tid(5988) 8007000E Not enough memory resources are available to complete this operation.

Steps to reproduce the problem

Following SD 1.5 installation
and download sdxl sd_xl_base_1.0.safetensors from hugging face to copy into models\Stable-diffusion\sd_xl_base_1.0.safetensors
Changing
Setting ->OnnxRuntime -> Diffusers pipeline -> ONNX Stable Diffusion XL

What should have happened?

Should be same as olive inference

What browsers do you use to access the UI ?

No response

Sysinfo

sysinfo-2024-03-05-10-00.json

Console logs

2nd generate console log
Olive: Parameter change detected
Olive: Recompiling base model
WARNING: ONNX implementation works best with SD.Next. Please consider migrating to SD.Next.
Olive implementation is experimental. It contains potentially an issue and is subject to change at any time.
ONNX: processing=StableDiffusionProcessingTxt2Img, pipeline=OnnxStableDiffusionXLPipeline
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [02:48<00:00,  8.44s/it]
2024-03-05 17:52:48.2647133 [E:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteKernel] Non-zero status code returned while running GroupNorm node. Name:'GroupNorm_22' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2571)\onnxruntime_pybind11_state.pyd!00007FFE7621DA68: (caller: 00007FFE769851B1) Exception(4) tid(5988) 8007000E Not enough memory resources are available to complete this operation.

Additional information

No response

Metadata

Assignees

No one assigned

    Labels

    onnxAbout ONNXquestionFurther information is requested

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions