Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge releases/2024/5 into master #1174

Merged

Conversation

Wovchena
Copy link
Collaborator

@Wovchena Wovchena commented Nov 8, 2024

No description provided.

RyanMetcalfeInt8 and others added 30 commits November 4, 2024 05:47
wgzintel and others added 18 commits November 6, 2024 23:09
…or tensors initialization, compression, alpha-only mode, better diagnostics about errors.
…plementation of unet for initial NPU support (openvinotoolkit#1101)

For now, NPU can be used like this. The unet model must be reshaped to a
static shape before compile is invoked.

```cpp
std::filesystem::path root_dir = models_path;
auto pipe = ov::genai::Text2ImagePipeline::stable_diffusion(
    ov::genai::Text2ImagePipeline::Scheduler::from_config(root_dir / "scheduler/scheduler_config.json"),
    ov::genai::CLIPTextModel(root_dir / "text_encoder", "CPU"),
    ov::genai::UNet2DConditionModel(root_dir / "unet")
        .reshape(2, 512, 512, 77)
        .compile("NPU", ov::cache_dir("./cache")),
    ov::genai::AutoencoderKL(root_dir / "vae_decoder", "GPU", ov::cache_dir("./cache")));
ov::Tensor image = pipe.generate(prompt);
```
…1162)

Fixing the regression introduced in
openvinotoolkit#1118
CVS-156870

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Fix the issue when running stable-diffusion

[ INFO ] Traceback (most recent call last):
File
"/home/guozhong/openvino.genai_2024_5/openvino.genai/tools/llm_bench/benchmark.py",
line 202, in main
iter_data_list, pretrain_time, iter_timestamp =
CASE_TO_BENCH[model_args['use_case']](
File
"/home/guozhong/openvino.genai_2024_5/openvino.genai/tools/llm_bench/task/image_generation.py",
line 198, in run_image_generation_benchmark
image_gen_fn(image_param, num, prompt_idx_list[image_id], pipe, args,
iter_data_list, proc_id, mem_consumption)
File
"/home/guozhong/openvino.genai_2024_5/openvino.genai/tools/llm_bench/task/image_generation.py",
line 50, in run_image_generation
f'steps={input_args["num_inference_steps"]},
width={input_args["width"]}, height={input_args["height"]},
guidance_scale={input_args["guidance_scale"]}'
KeyError: 'guidance_scale'

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
@github-actions github-actions bot added category: llm_bench Label for tool/llm_bench folder category: text to image Text 2 image pipeline category: sampling Sampling / Decoding algorithms category: GHA CI based on Github actions category: cmake / build Cmake scripts category: samples GenAI samples category: GenAI C++ API Changes in GenAI C++ public headers labels Nov 8, 2024
@Wovchena Wovchena added this pull request to the merge queue Nov 8, 2024
Merged via the queue into openvinotoolkit:master with commit 4017c8f Nov 8, 2024
54 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: cmake / build Cmake scripts category: GenAI C++ API Changes in GenAI C++ public headers category: GHA CI based on Github actions category: llm_bench Label for tool/llm_bench folder category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: text to image Text 2 image pipeline
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants