Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Black and Blank Output #958

Open
2 tasks done
page29 opened this issue Sep 2, 2024 · 14 comments
Open
2 tasks done

Black and Blank Output #958

page29 opened this issue Sep 2, 2024 · 14 comments
Labels
bug Something isn't working help-wanted Extra attention is needed HIGH PRIORITY AAAAAAAAAAAAAAAAAAA!! vulkan Issues that concern with hardware and were open at least once after 2024-01-19

Comments

@page29
Copy link

page29 commented Sep 2, 2024

Checklist

Describe the Bug

Always get a blank/black image irrespective of the model used. No output file saved. Searched prior threads & followed all the steps but no resolution.
2

To Reproduce

Select a photo, model and click on upscayl

Upscayl Version (or commit hash)

2.11.5

Platform

Linux

OS Version

Windows 10 Enterprise

GPU Name

NVDIA RTX 2000 ADA Generation Laptop GPU

Expected Behavior

No response

Screenshots

No response

Logs

⚙️ Getting saveImageAs from localStorage:  jpg
⚙️ Getting model from localStorage:  {"label":"General Photo (Remacri)","value":"remacri"}
⚙️ Getting gpuId from localStorage:  1
🔀 Setting model to 
🔀 Setting model to remacri
⚙️ Getting saveImageAs from localStorage:  jpg
⚙️ Getting model from localStorage:  {"label":"General Photo (Remacri)","value":"remacri"}
⚙️ Getting gpuId from localStorage:  1
⚙️ Getting saveImageAs from localStorage:  jpg
⚙️ Getting model from localStorage:  {"label":"General Photo (Remacri)","value":"remacri"}
⚙️ Getting gpuId from localStorage:  1
🔀 Setting model to 
🔀 Setting model to remacri
🔄 Resetting image paths
🎒 BACKEND REPORTED:  🖼️ Updating Image Path:  C:\Users\um063688\Desktop\dji.jpg
🎒 BACKEND REPORTED:  📄 Selected File Path:  C:\Users\um063688\Desktop\dji.jpg
🖼 Selected Image Path:  C:\Users\um063688\Desktop\dji.jpg
📁 Selected Image Directory:  C:\Users\um063688\Desktop
🖼 imagePath:  C:\Users\um063688\Desktop\dji.jpg
🔤 Extension:  jpg
🔄 Resetting Upscaled Image Path
🏁 UPSCAYL
🎒 BACKEND REPORTED:  ✅ Upscayl Variables:  {"model":"remacri","gpuId":"1","saveImageAs":"jpg","inputDir":"C:\\Users\\um063688\\Desktop","fileNameWithExt":"dji.jpg","outputDir":"C:\\Users\\um063688\\Desktop","outFile":"C:\\Users\\um063688\\Desktop\\dji_upscayl_4x_remacri.jpg","fileName":"dji","scale":"4","compression":"0","customWidth":"","useCustomWidth":false,"tileSize":null}
🎒 BACKEND REPORTED:  📢 Upscayl Command:  -i,C:\Users\um063688\Desktop\dji.jpg,-o,C:\Users\um063688\Desktop\dji_upscayl_4x_remacri.jpg,-m,C:\Program Files\Upscayl\resources\models,-n,remacri,-g,1,-f,jpg,-c,0
🎒 BACKEND REPORTED:  👶 Updating Child Processes:  {"binary":"C:\\Program Files\\Upscayl\\resources\\bin\\upscayl-bin","args":["C:\\Program Files\\Upscayl\\resources\\bin\\upscayl-bin","-i","C:\\Users\\um063688\\Desktop\\dji.jpg","-o","C:\\Users\\um063688\\Desktop\\dji_upscayl_4x_remacri.jpg","-m","C:\\Program Files\\Upscayl\\resources\\models","-n","remacri","-g","1","-f","jpg","-c","0"]}
🎒 BACKEND REPORTED:  🛑 Updating Stopped:  false
🎒 BACKEND REPORTED:  [0 Intel(R) RaptorLake-S Mobile Graphics Controller]  queueC=0[1]  queueG=0[1]  queueT=0[1]
[0 Intel(R) RaptorLake-S Mobile Graphics Controller]  bugsbn1=0  bugbilz=0  bugcopc=0  bugihfa=0
[0 Intel(R) RaptorLake-S Mobile Graphics Controller]  fp16-p/s/a=1/1/1  int8-p/s/a=1/1/1
[0 Intel(R) RaptorLake-S Mobile Graphics Controller]  subgroup=32  basic=1  vote=1  ballot=1  shuffle=1

🚧 UPSCAYL_PROGRESS:  [0 Intel(R) RaptorLake-S Mobile Graphics Controller]  queueC=0[1]  queueG=0[1]  queueT=0[1]
[0 Intel(R) RaptorLake-S Mobile Graphics Controller]  bugsbn1=0  bugbilz=0  bugcopc=0  bugihfa=0
[0 Intel(R) RaptorLake-S Mobile Graphics Controller]  fp16-p/s/a=1/1/1  int8-p/s/a=1/1/1
[0 Intel(R) RaptorLake-S Mobile Graphics Controller]  subgroup=32  basic=1  vote=1  ballot=1  shuffle=1

🎒 BACKEND REPORTED:  [1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  queueC=2[8]  queueG=0[16]  queueT=1[2]
[1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  bugsbn1=0  bugbilz=0  bugcopc=0  bugihfa=0
[1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  fp16-p/s/a=1/1/1  int8-p/s/a=1/1/1
[1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  subgroup=32  basic=1  vote=1  ballot=1  shuffle=1

🚧 UPSCAYL_PROGRESS:  [1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  queueC=2[8]  queueG=0[16]  queueT=1[2]
[1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  bugsbn1=0  bugbilz=0  bugcopc=0  bugihfa=0
[1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  fp16-p/s/a=1/1/1  int8-p/s/a=1/1/1
[1 NVIDIA RTX 2000 Ada Generation Laptop GPU]  subgroup=32  basic=1  vote=1  ballot=1  shuffle=1

🎒 BACKEND REPORTED:  0.00%

🚧 UPSCAYL_PROGRESS:  0.00%


🎒 BACKEND REPORTED:  92.60%

🚧 UPSCAYL_PROGRESS:  92.60%

🎒 BACKEND REPORTED:  💯 Done upscaling
upscaledImagePath:  C:\Users\um063688\Desktop\dji_upscayl_4x_remacri.jpg
💯 UPSCAYL_DONE:  C:\Users\um063688\Desktop\dji_upscayl_4x_remacri.jpg
⚙️ Getting saveImageAs from localStorage:  jpg
⚙️ Getting model from localStorage:  {"label":"General Photo (Remacri)","value":"remacri"}
⚙️ Getting gpuId from localStorage:  1
@page29 page29 added the bug Something isn't working label Sep 2, 2024
Copy link

dosubot bot commented Sep 2, 2024

@page29 Hello there! I'm here to help you with any bugs, questions, or contributions you might have.

I found some similar issues that might be relevant to your problem:

  1. The problem is not upscaling the images: This issue was resolved by downgrading to version 2.5.5, as the problem seemed specific to version 2.7.5 [1].
  2. Small black image? Nothing saved, confused how to make work: This issue was related to GPU compatibility. The suggested solution was to check if the user had a GPU [2].
  3. 开始之后软件并没有运行就结束了任务: This issue was resolved by downloading the latest driver from the official website [3].

Here are some steps you can take to resolve the issue of getting a blank/black image with no output file saved:

  1. Ensure Vulkan Compatibility: Verify that your NVIDIA RTX 2000 ADA Generation Laptop GPU supports Vulkan by running VulkanCapsViewer.

  2. Set GPU ID:

    • Open Upscayl and attempt to upscale an image.
    • Go to the Settings tab and scroll down to the logs area to see the available GPU IDs.
    • Enter the appropriate GPU ID in the 'GPU ID' input box. Note that on Windows, this setting may be overridden if Upscayl is not set to performance mode under advanced display settings.
  3. Set the App to Performance Mode: Ensure that Upscayl is set to performance mode under advanced display settings.

  4. Disable Switchable Graphics: If your laptop has switchable graphics, disable them as per the instructions provided here.

  5. Enable Hardware-Accelerated GPU Scheduling: Follow the guide here.

  6. Reinstall Graphics Drivers: Reinstall your graphics drivers. Before doing this, run VulkanCapsViewer to ensure Vulkan support [4][5].

If these steps do not resolve the issue, you may need to check for any specific error messages or codes that indicate why an image might be blank or black. The upscayl-bin binary handles errors by logging them and sending error messages to the main window. Specific error messages or codes include:

  • Filename too long for Windows: Ensure the output filename does not exceed the maximum path length allowed by the operating system.
  • General error during processing: Check the logs for any "Error" or "failed" messages.
  • Error during batch processing: Ensure there are no issues with reading or writing files, such as incorrect paths or insufficient permissions [6][7][8].

Additionally, there are known issues and bugs in version 2.11.5 of Upscayl that could lead to the described problem. Subsequent versions have included relevant fixes and updates. For example, version 2.8.5 fixed several issues including scaling and conversion, grainy picture issue (#474), and compression. Version 2.8.1 addressed bugs such as the empty upscaled image bug and large image upscale performance bug [9].

Consider updating to a newer version if available, as it might resolve the issue.

To continue talking to Dosu, mention @dosu.

@github-staff github-staff deleted a comment from page29 Sep 4, 2024
@page29
Copy link
Author

page29 commented Sep 8, 2024

I tried all those steps and I still get black image.

@Kongsea
Copy link

Kongsea commented Sep 9, 2024

I tried all those steps and I still get black image.

I have met the same problem...

@OIRNOIR
Copy link

OIRNOIR commented Sep 10, 2024

I have this problem as well.

@page29
Copy link
Author

page29 commented Sep 10, 2024

Not sure why this is happening. It was working fine untill a few days ago and I was able to successfully upscale images. A few days ago I tried to upscale a 360 image which have a black output. Since then every photo gives a black output.

@NayamAmarshe
Copy link
Member

This is most likely a driver + Vulkan issue.

@aaronliu0130
Copy link
Member

aaronliu0130 commented Sep 10, 2024

@Kongsea @OIRNOIR Please go through the checklist.

The logs are all normal, assuming you trimmed the middle. Was there a recent driver update? Are you sure CapsViewer reports capabilities?

@aaronliu0130 aaronliu0130 added the vulkan Issues that concern with hardware and were open at least once after 2024-01-19 label Sep 10, 2024
@page29
Copy link
Author

page29 commented Sep 11, 2024

@Kongsea @OIRNOIR Please go through the checklist.

The logs are all normal, assuming you trimmed the middle. Was there a recent driver update? Are you sure CapsViewer reports capabilities?

This is what I get when I run VulcanCapsViewer. Not sure which line item shows Vulcan Compatibality.
image

@OIRNOIR
Copy link

OIRNOIR commented Sep 21, 2024

I have this problem as well.

I managed to resolve my issue. It was failing the same as before, despite many graphics driver updates. I then switched my KDE plasma desktop to performance mode (system tray -> power management) and re-ran upscayl and it worked. It might have been a change in the way the balanced power mode (which I usually keep my laptop at) handles intensive GPU tasks.

Running Upscayl on intel integrated graphics isn't fun (or fast) but it works now, thankfully.

@Apertur3
Copy link

Apertur3 commented Sep 21, 2024

I've got the exact same issue and can't seem to solve it, on a MBP (M1 Max, 64gb, Sonoma 14.5).
image

Log (I cut out most of the progress, but it did stop at 47.50%):

⚙️ Getting saveImageAs from localStorage:  png
⚙️ Getting model from localStorage:  {"label":"General Photo (Fast Real-ESRGAN)","value":"realesrgan-x4fast"}
⚙️ Getting gpuId from localStorage:  0
🔀 Setting model to 
🔀 Setting model to realesrgan-x4fast
⚙️ Getting saveImageAs from localStorage:  png
⚙️ Getting model from localStorage:  {"label":"General Photo (Fast Real-ESRGAN)","value":"realesrgan-x4fast"}
⚙️ Getting gpuId from localStorage:  0
⚙️ Getting saveImageAs from localStorage:  png
⚙️ Getting model from localStorage:  {"label":"General Photo (Fast Real-ESRGAN)","value":"realesrgan-x4fast"}
⚙️ Getting gpuId from localStorage:  0
🔀 Setting model to 
🔀 Setting model to realesrgan-x4fast
🔄 Resetting image paths
🎒 BACKEND REPORTED:  🖼️ Updating Image Path:  /Users/USERNAME/Downloads/v3-Recovered-Enhanced.jpg
🖼 Selected Image Path:  /Users/USERNAME/Downloads/v3-Recovered-Enhanced.jpg
📁 Selected Image Directory:  /Users/USERNAME/Downloads
🖼 imagePath:  /Users/USERNAME/Downloads/v3-Recovered-Enhanced.jpg
🔤 Extension:  jpg
🎒 BACKEND REPORTED:  📄 Selected File Path:  /Users/USERNAME/Downloads/v3-Recovered-Enhanced.jpg
🎒 BACKEND REPORTED:  🚫 Select Folder Operation Cancelled
🎒 BACKEND REPORTED:  📁 Updating Folder Path:  /Users/USERNAME/Downloads
🎒 BACKEND REPORTED:  📁 Selected Folder Path:  /Users/USERNAME/Downloads
🗂 Setting Output Path:  /Users/USERNAME/Downloads
🔄 Resetting Upscaled Image Path
🏁 UPSCAYL
🎒 BACKEND REPORTED:  ✅ Upscayl Variables:  {"model":"realesrgan-x4fast","gpuId":"0","saveImageAs":"png","inputDir":"/Users/USERNAME/Downloads","fileNameWithExt":"v3-Recovered-Enhanced.jpg","outputDir":"/Users/USERNAME/Downloads","outFile":"/Users/USERNAME/Downloads/v3-Recovered-Enhanced_upscayl_1x_realesrgan-x4fast.png","fileName":"v3-Recovered-Enhanced","scale":"1","compression":"0","customWidth":"","useCustomWidth":false,"tileSize":null}
🎒 BACKEND REPORTED:  📢 Upscayl Command:  -i,/Users/USERNAME/Downloads/v3-Recovered-Enhanced.jpg,-o,/Users/USERNAME/Downloads/v3-Recovered-Enhanced_upscayl_1x_realesrgan-x4fast.png,-s,1,-m,/Applications/Upscayl.app/Contents/Resources/models,-n,realesrgan-x4fast,-g,0,-f,png,-c,0
🎒 BACKEND REPORTED:  👶 Updating Child Processes:  {"binary":"/Applications/Upscayl.app/Contents/Resources/bin/upscayl-bin","args":["/Applications/Upscayl.app/Contents/Resources/bin/upscayl-bin","-i","/Users/USERNAME/Downloads/v3-Recovered-Enhanced.jpg","-o","/Users/USERNAME/Downloads/v3-Recovered-Enhanced_upscayl_1x_realesrgan-x4fast.png","-s","1","-m","/Applications/Upscayl.app/Contents/Resources/models","-n","realesrgan-x4fast","-g","0","-f","png","-c","0"]}
🎒 BACKEND REPORTED:  🛑 Updating Stopped:  false
🎒 BACKEND REPORTED:  🚀 Starting Upscayl - Copyright © 2024

🚧 UPSCAYL_PROGRESS:  🚀 Starting Upscayl - Copyright © 2024

🎒 BACKEND REPORTED:  ✨ Detected scale x4
✨ Using the default scale x4

🚧 UPSCAYL_PROGRESS:  ✨ Detected scale x4
✨ Using the default scale x4

🎒 BACKEND REPORTED:  [0 Apple M1 Max]  queueC=0[1]  queueG=0[1]  queueT=0[1]
[0 Apple M1 Max]  bugsbn1=0  bugbilz=242  bugcopc=0  bugihfa=0
[0 Apple M1 Max]  fp16-p/s/a=1/1/1  int8-p/s/a=1/1/1
[0 Apple M1 Max]  subgroup=32  basic=1  vote=1  ballot=1  shuffle=1

🚧 UPSCAYL_PROGRESS:  [0 Apple M1 Max]  queueC=0[1]  queueG=0[1]  queueT=0[1]
[0 Apple M1 Max]  bugsbn1=0  bugbilz=242  bugcopc=0  bugihfa=0
[0 Apple M1 Max]  fp16-p/s/a=1/1/1  int8-p/s/a=1/1/1
[0 Apple M1 Max]  subgroup=32  basic=1  vote=1  ballot=1  shuffle=1

🎒 BACKEND REPORTED:  0.00%

🚧 UPSCAYL_PROGRESS:  0.00%

🎒 BACKEND REPORTED:  0.04%

🚧 UPSCAYL_PROGRESS:  0.04%

🎒 BACKEND REPORTED:  5.68%

🚧 UPSCAYL_PROGRESS:  5.68%

⚙️ Getting saveImageAs from localStorage:  png
⚙️ Getting model from localStorage:  {"label":"General Photo (Fast Real-ESRGAN)","value":"realesrgan-x4fast"}
⚙️ Getting gpuId from localStorage:  0
🎒 BACKEND REPORTED:  5.72%

🚧 UPSCAYL_PROGRESS:  5.72%

🚧 UPSCAYL_PROGRESS:  47.46%

🎒 BACKEND REPORTED:  47.50%

🚧 UPSCAYL_PROGRESS:  47.50%

🎒 BACKEND REPORTED:  💯 Done upscaling
upscaledImagePath:  /Users/USERNAME/Downloads/v3-Recovered-Enhanced_upscayl_1x_realesrgan-x4fast.png
💯 UPSCAYL_DONE:  /Users/USERNAME/Downloads/v3-Recovered-Enhanced_upscayl_1x_realesrgan-x4fast.png

@aaronliu0130 aaronliu0130 added the HIGH PRIORITY AAAAAAAAAAAAAAAAAAA!! label Sep 21, 2024
@NayamAmarshe
Copy link
Member

I've got the exact same issue and can't seem to solve it, on a MBP (M1 Max, 64gb, Sonoma 14.5). image

Log (I cut out most of the progress, but it did stop at 47.50%):

Yours is a different problem. #447

@Apertur3
Copy link

Apertur3 commented Sep 22, 2024

I've got the exact same issue and can't seem to solve it, on a MBP (M1 Max, 64gb, Sonoma 14.5). image
Log (I cut out most of the progress, but it did stop at 47.50%):

Yours is a different problem. #447

For me it doesn't get stuck, it just stops and reports being finished. The resulted output is blank/black and nothing is saved to my drive. Also during the entire process my MB reports an excess of 20+gb of memory being free.

Should I create a separate issue for this?

@NayamAmarshe
Copy link
Member

I've got the exact same issue and can't seem to solve it, on a MBP (M1 Max, 64gb, Sonoma 14.5). image
Log (I cut out most of the progress, but it did stop at 47.50%):

Yours is a different problem. #447

For me it doesn't get stuck, it just stops and reports being finished. The resulted output is blank/black and nothing is saved to my drive. Also during the entire process my MB reports an excess of 20+gb of memory being free.

Should I create a separate issue for this?

No no, it's a memory issue within the NCNN backend. You're probably trying to upscale an image that is too large for the backend to handle. You should try downscaling it maybe.

@barf
Copy link

barf commented Oct 13, 2024

I am also struggling to get any output, it just says 'nah' during processing, reproducible on both Windows and Linux so I think Vulkan/driver issues can be ruled out.

How do we determine memory requirements or handle this type of error? It says the output was created but the file does not exist.

12:06:19.658 › 🎒 BACKEND REPORTED:  47.80%
12:06:19.660 › 🚧 UPSCAYL_PROGRESS:  47.80%
12:06:20.279 › 47.84%
12:06:20.280 › 🎒 BACKEND REPORTED:  47.84%
12:06:20.282 › 🚧 UPSCAYL_PROGRESS:  47.84%
12:06:20.898 › 47.88%
12:06:20.899 › 🎒 BACKEND REPORTED:  47.88%
12:06:20.901 › 🚧 UPSCAYL_PROGRESS:  47.88%
12:06:21.517 › 47.92%
12:06:21.518 › 🎒 BACKEND REPORTED:  47.92%
12:06:21.520 › 🚧 UPSCAYL_PROGRESS:  47.92%
12:06:22.137 › 47.96%
12:06:22.139 › 🎒 BACKEND REPORTED:  47.96%
12:06:22.141 › 🚧 UPSCAYL_PROGRESS:  47.96%
12:09:10.983 › 💯 Done upscaling
12:09:10.990 › 🎒 BACKEND REPORTED:  💯 Done upscaling
12:09:10.991 › upscaledImagePath:  /home/barf/Desktop/photo-bbox-2022-10k_upscayl_2x_realesrgan-x4plus.png
12:09:10.991 › 💯 UPSCAYL_DONE:  /home/barf/Desktop/photo-bbox-2022-10k_upscayl_2x_realesrgan-x4plus.png

@aaronliu0130 aaronliu0130 added the help-wanted Extra attention is needed label Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help-wanted Extra attention is needed HIGH PRIORITY AAAAAAAAAAAAAAAAAAA!! vulkan Issues that concern with hardware and were open at least once after 2024-01-19
Projects
None yet
Development

No branches or pull requests

8 participants
@barf @Kongsea @aaronliu0130 @NayamAmarshe @OIRNOIR @Apertur3 @page29 and others