Intel Arc Graphics Thread #476
Replies: 73 comments 189 replies
-
|
UPDATE:
Before Intel update it, the code needs to be modified like this to avoid reporting errors: - match operation:
- case "multiply":
- output[top:bottom, left:right] = destination_portion * source_portion
- case "add":
- output[top:bottom, left:right] = destination_portion + source_portion
- case "subtract":
- output[top:bottom, left:right] = destination_portion - source_portion
+ if operation == "multiply":
+ output[top:bottom, left:right] = destination_portion * source_portion
+ elif operation == "add":
+ output[top:bottom, left:right] = destination_portion + source_portion
+ elif operation == "subtract":
+ output[top:bottom, left:right] = destination_portion - source_portionOf course not modifying it doesn't seem to affect normal usage. |
Beta Was this translation helpful? Give feedback.
-
|
I added this fix to master: 476d543 |
Beta Was this translation helpful? Give feedback.
-
|
About Karras scheduler: Currently using it causes a -996 "uses-fp64-math" error, which may be fixed in the next IPEX release (intel/intel-extension-for-pytorch#285) Until then, can specify to use # comfy/samplers.py
- sigmas = k_diffusion_sampling.get_sigmas_karras(n=steps, sigma_min=self.sigma_min, sigma_max=self.sigma_max, device=self.device)
+ sigmas = k_diffusion_sampling.get_sigmas_karras(n=steps, sigma_min=self.sigma_min, sigma_max=self.sigma_max, device="cpu") |
Beta Was this translation helpful? Give feedback.
-
|
is it Linux only or can you use this on a win10 machine? |
Beta Was this translation helpful? Give feedback.
-
|
You should be able to use WSL, but I haven't tested it. |
Beta Was this translation helpful? Give feedback.
-
|
So again, sharing the good news. An XPU version of their Pytorch extension with Pytorch 2.0 support,
Hats off to ComfyUI for being the only Stable Diffusion UI to be able to do it at the moment but there are a bunch of caveats with running Arc and Stable Diffusion right now from the research I have done. As of the time of posting: 1.) Setup can still be complicated in some respects and can randomly not work because Intel is only really verifying for enterprise Linux distributions and Ubuntu. My base Linux Fedora 38 install has the RPMs installed but I get a cryptic error regarding the runtime saying 2.) From what I have read at intel/intel-extension-for-pytorch#398, there is no native Windows version for some wheels to get 3.) Intel Arc right now has a huge problem with allocating more than 4GB of VRAM in IPEX even though the card has more VRAM in the case of the A750/A770 according to intel/intel-extension-for-pytorch#325. This seems to have mitigations elsewhere in Intel's oneAPI stack like their OpenCL compute runtime where anything you compile, you can work your code to go around the restriction via some flags and changed code according to intel/compute-runtime#627. No workarounds, it seems, until someone gets Intel to fix it. 4.) Because of that, experimenting with other Stable Diffusion UIs, it seems like every once in a while, Arc will occasionally run out of VRAM if you decide to not use lower VRAM flags and throw a 5.) Intel has an equivalent to I'm not even sure if I'm sure that Intel GPU support will not a big priority at the moment for the project, given the big blocker at this point is the 4GB VRAM limit which needs to be fixed by Intel. But that being said, things should be working a lot better than it is at the moment, maybe not average user ready, but should be ready for any mildly technical person. I really want to play with ComfyUI more but I really don't want to restart the application server for every several image I might want to generate even or rolling a dice for SDXL to actually finish a workflow. But the Arc cards are strong. I managed to equal the Nvidia RTX 3070 Ti in certain Stable Diffusion workflows with my 16 GB Intel Arc A770 so I look forward to the future when things are more mature and all the stars are aligned. Also not sure what issues need to be open here but there is potentially 2-3 of them that could be made from my report. Edit: Added a caveat I forgot to mention and filled in some information and fixed some typos. |
Beta Was this translation helpful? Give feedback.
-
|
Maybe it doesn't like the shifting from ram to vram, try running it with --highvram |
Beta Was this translation helpful? Give feedback.
-
|
That's really counterintuitive. But yeah, it works for single image generation, was able to generate 5 images in a row without crashing. It does still crash when I tried to enable a batch of 2 because I decided to push my luck and may still crash like the other UIs when IPEX decides to randomly stop working but maybe that is to be expected given what I mentioned above about VRAM allocation and etc. But yeah, I think that brings this from theoretically useful to possibly useful. I'll file the |
Beta Was this translation helpful? Give feedback.
-
|
@simonlui From what I found
Quote from the last link: |
Beta Was this translation helpful? Give feedback.
-
|
I followed you steps, only used the updated version and then I got this issue can you tell me whats wrong? |
Beta Was this translation helpful? Give feedback.
-
|
So this took me a bit of time, but I have the Docker image I used published here so hopefully someone can find it useful. Some things to note I've found while poking and experimenting with things. 1.) A lot of the issues are gone mentioned before by @kwaa months ago like the Karras scheduler not working, where it is working now even with the new dpmpp_3 schedulers, or noise issues if not using split attention which is gone for the most part unless your graphics driver has crashed too many times and a restart of the computer fixes that. Anyways, hope people have good success with it like I did. I might try and see why ipexrun is failing but for now, I am going to take a break. Edit: Added in a caveat I forgot to mention and fixed some typos. |
Beta Was this translation helpful? Give feedback.
-
|
In the event anyone else missed it: I seem to be missing the file that gets sourced from /opt/intel, too... may edit this post once I figure it out. |
Beta Was this translation helpful? Give feedback.
-
|
Because Arch only packages the basekit and disaggregates all the other toolkits into seperate components which is kinda confusing why. Also, opt/intel/oneapi/setvars.sh should be part of the basekit package as you can see here. You may need to do a reinstall of the basekit if you don't see the file. |
Beta Was this translation helpful? Give feedback.
-
|
I may update this guide in the near future. |
Beta Was this translation helpful? Give feedback.
-
|
Well, short story. After spend whole day to install Arch Linux on Windows 10 WSL (2 in my case). After all procedures, I stuck on
The installer reach a 87% and starts roll back all changes, because intel-oneapi-basekit not contain library libtbb.so.12 that needed to install oneAPI AI Analytics Toolkit v2023. The packgage that contains needed library is intel-oneapi-compiler-shared-runtime but it conflict with intel-oneapi-basekit. Because the istall procedure can't finish with intel-oneapi-basekit, I install intel-oneapi-compiler-shared-runtime. ComfyUI runs: [{user}@pc ArchLinux]$ But if i try to generate image I get an next error: As can see, I tries params like --force-fp16 --bf16-vae --lowvram --use-split-cross-attention --highvram but it's have no effect. So, models are loaded, but KSampler are crashes. And that's my dead end, because I have no idea what's going on. Not in ComfyUI itself, and also there more in Linux Arch. But I suppose this can be a kind of report. |
Beta Was this translation helpful? Give feedback.
-
|
Well, first off, there's no reason for you to use Arch Linux on WSL2 anyways, because you can pick Ubuntu and it's the only supported distribution that Intel supports for non-enterprise users anyways so using anything else is going to be painful and with WSL, it's a fool's errand because it won't gives you any additional benefits like speed and etc. like you may think it does. Secondly, that's what I made my Docker image for because it's very easy to mess up the install and there are a lot of chances to go wrong. Just on a cursory glance, you have the wrong package probably for TBB and the compiler runtime conflict is probably the issue. If you do want to fix the issue, you're going to have to reinstall everything correctly. |
Beta Was this translation helpful? Give feedback.
-
|
Doesn't work on Windows too, unfortunatelly. Do a step-by-step and get "missing startup.sh". Because this error is not specific, without code of error - kind of common for docker using - it's have no specific result in google. Fixing that case basing only on your tutorial not seems possible. |
Beta Was this translation helpful? Give feedback.
-
|
@roflosaur Sorry, it took a while to diagnose because I needed to set up a virtual machine to debug the issue you ran into but I found the root issue which was git was changing the line endings of the files based on OS where startup.sh needed to be tied to Unix line endings only. I have set up a .gitattributes to fix this. I would advise you to do a clean checkout again via deleting and cloning my repository again or if you know the command line, you can re-checkout the repository with the new .gitattributes applied. Thanks for reporting the issue. |
Beta Was this translation helpful? Give feedback.
-
|
Here is an error when build the app. I also downloaded and installed manually Intel One API Base Kit version 2023.1.0.47256 but useless. Can't build an app thus. |
Beta Was this translation helpful? Give feedback.
-
|
Welp, aren't you unlucky on your timing here? Intel has broken their GPG key for OneAPI repository and that means nothing from oneAPI can be downloaded from said repository. I unfortunately can't help you here since my image depends on downloading those packages fresh from Intel for updating reasons. So until they get their stuff together over there, you're stuck as am I. If you want to follow progress on when a fix might come, see this issue |
Beta Was this translation helpful? Give feedback.
-
|
I don't use Windows, but all the pieces should be together to run ComfyUI on Windows now without any horrible downsides like no AOT compilation or missing packages since a new unofficial Intel Extension for Python package has been released without needing any installation of external dependencies and bundling it all together. It remains to be seen whether there will ever be an official package that does this so this package is the best chance anyone has at actually using Arc on Windows natively. According to reports, it is a bit faster than WSL2 but slower than Linux native. The rough steps to do this should be roughly the same as the process outlined in the opening post for Linux minus platform-specific things. 1.) Make sure you install an Intel driver that is 4952 or newer. The latest driver can be found here python -m ensurepip --upgrade3.) Install git from here using the GUI installer or other means. cd <location where to place ComfyUI>
git clone https://github.com/comfyanonymous/ComfyUI.git
cd ComfyUI5.) Download non-official Intel Extension for Pytorch packages here and install the packages with pip. Assuming they are all put in the root of the ComfyUI repository, run this command line. pip install intel_extension_for_pytorch-2.0.110+git0f2597b-cp310-cp310-win_amd64.whl torch-2.0.0a0+gite9ebda2-cp310-cp310-win_amd64.whl torchvision-0.15.2a0+fa99a53-cp310-cp310-win_amd64.whlAgain, I will need to remind you this is unofficial and does have a degree of risk but it should be mostly safe. 6.) Finish the rest of the installation pip install -r requirements.txtAt this point, you should be done with the installation. To run ComfyUI each time from scratch, open a terminal/command prompt. Then run the following command lines replacing <> with your own input: cd <location of ComfyUI>
python main.py <Any extra ComfyUI arguments you want to use> |
Beta Was this translation helpful? Give feedback.
-
|
When I try to install this node modifications, it's destroy my ComfyUI build. Because just rolling back all changes was not possible, I completely wiped out Python and Anaconda (as I thought, because despite deleting entries from the registry in AppData\Roaming\Python\Python310\site-packages something strange was still going on), and then follow to next procedure. This is not "ture github way", but at least this can help to someone, who want to launch ComfyUI on Intel Arc for Windows.
Then go to step 9, if no error occured. If you have any problems at this step, such messages like: or See the image:
and go to: To figure out for commented names. If names have "~" at start - remove it. Goto step 8 (copy, enter, and wait to end): 8.
or instead last command, if you have less than 16 Gb memory:
At this point, if all works fine, you can use DDU again, and install latest Intel Arc drivers. Should to work. Also you can optional install WAS node suite, by running "install.bat" in the "ComfyUI\custom_nodes\was-node-suite-comfyui-main" folder. REMEMBER: any additions for ComfyUI can destroy your ComfyUI installation for Intel Arc, because them build for CUDA mostly part, and trying to install it can destroy your Python dependences, critical for ComfyUI working. Don't forget download models! |
Beta Was this translation helpful? Give feedback.
-
|
I used IPEX v2.1.10 but it's not working as expected can you tell me whats wrong? |
Beta Was this translation helpful? Give feedback.
-
|
Sorry for the late reply but you are using the wrong version of Python and you didn't read my 2nd instruction point properly.
Do not use the newest 3.11 or 3.12 and use version 3.10 with the non-official packages, this will hold until IPEX updates again but it does not work correctly with the latest ComfyUI and IPEX package at the moment. |
Beta Was this translation helpful? Give feedback.
-
|
Yes, but I also used cp311 version of ipex, which is for cpython 3.11 right? |
Beta Was this translation helpful? Give feedback.
-
|
Yes, which is the core root of the problem. You aren't using the modified packages I have suggested in my instructions and that has not changed from the older v2.0.110+xpu version packages someone else has provided as the newest version of IPEX v2.1.10 does not work with ComfyUI on any OS platform. |
Beta Was this translation helpful? Give feedback.
-
|
Reinstall in forced mode, needed dll in place, but still get this error. Can it be relevant to folder rights or upper or lower letter case in "user"? |
Beta Was this translation helpful? Give feedback.
-
|
I found out about what is causing it. It's a dependency issue with libuv. I will overhaul the tutorial based on that shortly. For you, you'll need to uninstall the oneAPI GUI installed components and then backtrack and follow steps 3 onwards but then the method I will provide should replace that in a much more easy manner. |
Beta Was this translation helpful? Give feedback.
-
|
There really needs to be a better, more updated tutorial for this. Much of the information is stretched out over the thread and mixed up with information between Linux and Windows |
Beta Was this translation helpful? Give feedback.
-
|
I'll consider writing one for Ubuntu because it's the only Linux distro on the consumer side supported officially by Intel unless you pay the big money for Red Hat and SUSE support with their enterprise GPUs. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks, should to try too. |
Beta Was this translation helpful? Give feedback.
-
|
The whole thing about installing the OneAPI AI Analytics toolkit didn't seem necessary though. On a fresh install of Arch, All I did was install Torch 2.0.1 and intel-compute-runtime-bin from Arch repositories, then install the Intel extension for pytorch with the code below
And then from a terminal in the directory where ComfyUI is installed I used
And that line above I added to a start.sh script, which can include launch options for easier usage. But yeah, that was all I had to do and it takes me about 4 seconds to do 20 steps at 512x768. I'm not even sure I needed to get anything from Arch's repository, if so, those packages should be available in any repository, which would make the install fairly simple for any distro. |
Beta Was this translation helpful? Give feedback.
-
|
@burntbyhellfire If you don't use Intel Python, you don't need to install the AI Kit. |
Beta Was this translation helpful? Give feedback.
-
|
If we both have a GPU of the same specs we could both run some benchmark prompts and settings to see if there really are any performance improvements with doing it that way. I just got a Sparkle A770 16GB. |
Beta Was this translation helpful? Give feedback.
-
|
To install on Ubuntu. 1.) Install Linux drivers with the following instructions provided by Intel here sudo apt install python3-pip git3.) Install ComfyUI with the following terminal commands replacing the <> portion with a selection of your choice. cd <Location to put ComfyUI>
git clone https://github.com/comfyanonymous/ComfyUI.git
cd ComfyUI4.) Install all the Intel Extension for Pytorch pip Python packages first with this terminal command. python -m pip install torch==2.0.1a0 torchvision==0.15.2a0 intel-extension-for-pytorch==2.0.110+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/5.) Finish the rest of the dependency installation with this terminal command: pip install -r requirements.txtInstallation should be done at this point. To run ComfyUI, one can type in the following terminal commands replacing <> with your own input: cd <location of ComfyUI>
python main.py <Any extra ComfyUI arguments you want to use>For other Linux distros outside of Arch Linux or Ubuntu, one will need to manually install the Intel compute runtime, git, a Python with a version supported by Intel Extension for Pytorch like 3.10 as of the time of this writing or using Intel's Python from the AI Kit which will provide that, pip, and any other dependencies required according to your own Linux distribution's package manager or install scripts but one should be able to then just follow step 3 and onwards without any issue afterwards. |
Beta Was this translation helpful? Give feedback.
-
|
I've updated the Arch Linux setup guide for the latest IPEX and ComfyUI, without oneAPI AI Kit. If anyone wants to uninstall the previously installed AI Kit, it's available: cd /opt/intel/oneapi/installer
sudo ./installer --action remove --product-id intel.oneapi.lin.aikit.product --product-ver 2023.1.0-31760
# if you don't need
paru -Rsc libxcrypt-compat |
Beta Was this translation helpful? Give feedback.
-
New Patch!Thanks to vladmandic/automatic for the code. contributors Basically, you just need to copy Then modify try:
import intel_extension_for_pytorch as ipex
if torch.xpu.is_available():
xpu_available = True
+ from attention import attention_init
+ ok, e = attention_init()
except:
passIt could partially fix intel/intel-extension-for-pytorch#325. (so f**k you, intel) |
Beta Was this translation helpful? Give feedback.
-
|
That's more of a workaround, I've seen his code but I didn't think @comfyanonymous would enjoy special casing his code with a specific attention implementation that would work for Intel GPUs only for working around the issue which is why I didn't submit a variant it when I wrote the patches for enhanced IPEX support. Doing manual memory management like this is a pain in Python and doesn't look particularly nice. I think Intel has to fix it on their end, asking end users of IPEX to do this to every project that implements IPEX is untenable. |
Beta Was this translation helpful? Give feedback.
-
|
I couldn't find any performance gains with Ipex in tests I ran in ComfyUI before, and after setting up an environment and running Comfy from it. |
Beta Was this translation helpful? Give feedback.
-
|
interesting tho, that i didn't do anything with modules/intel/ipex/attention.py, but problem with 4GB limit is gone after patching p.s. error still continue to occur ^_^ |
Beta Was this translation helpful? Give feedback.
-
|
It seems that only older versions of |
Beta Was this translation helpful? Give feedback.
-
|
Cool... Got it working with WSL2 using Arch. Followed the instructions at the top, as well as installed jemalloc paru(root/native environment), openmp via pip(venv). There are issues with the env vars as Arch is pulling my windows env vars through. So I some times have to re run the setvars.sh. I get warnings about libpng when I run via python or ipexrun. Everything still works though. I generally run through ipexrun but add xpu to the command i.e.
Apart from some memory overruns I've had no issues the last few days. |
Beta Was this translation helpful? Give feedback.
-
|
anybody can tell where intel store their patches for pytorch? |
Beta Was this translation helpful? Give feedback.
-
|
You can find these "patches" here but it's really not that much different over just compiling the source tree provided. |
Beta Was this translation helpful? Give feedback.
-
|
thanks! |
Beta Was this translation helpful? Give feedback.
-
|
Yes, and pytorchvision and other associated packages. |
Beta Was this translation helpful? Give feedback.
-
|
Hi Simon I just wanted to circle back on this one...see if you'd had time
to upstream the code you mentioned. Thanks much!
…On Mon, Dec 16, 2024 at 4:01 PM Simon Lui ***@***.***> wrote:
You need to use ONEAPI_DEVICE_SELECTOR environment variable. I believe
you need ONEAPI_DEVICE_SELECTOR=gpu:0 in your specific scenario. See the
full details for usage here:
https://github.com/intel/llvm/blob/sycl/sycl/doc/EnvironmentVariables.md#oneapi_device_selector
I actually coded something for this to include for ComfyUI similar to
--cuda-device for CUDA that would make using this easier for something
else but I forgot about this until this point which should make this
easier. I will clean it up and upstream it when I have time soon.
—
Reply to this email directly, view it on GitHub
<#476 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BNYG66EX6YTGFI4VQYQXYZD2F5ES7AVCNFSM6AAAAAAWZ5LOZKVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTCNJYGYZTIMA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Beta Was this translation helpful? Give feedback.
-
|
Yep. Was committed right before Christmas in c6b9c11 |
Beta Was this translation helpful? Give feedback.
-
|
So i got hunyuan to run and complete today. and this is the workflow i ran: videos_00001.mp4I'm running nightly build pytorch implementation |
Beta Was this translation helpful? Give feedback.
-
|
不知道有没有帮助，关于4G错误， 我使用很久没有更新的SD1.5模型，在大约5121440出图就会报错， 我使用的是， 没有修改model_management.py |
Beta Was this translation helpful? Give feedback.
-
|
Prompt executed in 602.83 seconds videos_00001.mp4 |
Beta Was this translation helpful? Give feedback.
-
|
running gguf q4_0 peak memory usage dropped by 25-30% to approx 30GB but generation time went up slightly videos_00002.mp4 |
Beta Was this translation helpful? Give feedback.
-
|
I have tested SDXL T2I on B580 and A770.
The performance of B580 is quite impressive, it is almost fast as RTX3090 (or RTX4070 I guess),
|
Beta Was this translation helpful? Give feedback.
-
|
You mean, portable is still too slow, right? There are not so many Arc users, so it is difficult to troubleshoot. |
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
hmm. I am not sure what make it slow. I am the only person using B580 around me. However, it is not that much like minute. Do you test with 1024x1024 resolution and 20ish steps right? One another I suspect is that B580 may become slow when CPU is not recent. I saw some benchmarks about it. But not sure, too. |
Beta Was this translation helpful? Give feedback.
-
|
It's fine now. Just need to tinker a bit with comfyUI setting instead to make it bearable at least. But some question, I got green artifact if I'm genning while watching youtube video. Is it fine or is it my GPU dying? |
Beta Was this translation helpful? Give feedback.
-
|
I wonder how's that even possible.. |
Beta Was this translation helpful? Give feedback.
-
|
More test on B580. FLUX1 Dev.I could run Flux on B580 with
It is faster than A770, and RTX4060Ti. However, I couldn't use GGUF quants. WAN2.1I could run I2V 480P, and I2V 720P with smaller frames. Based on ComfyUI Example I2V 480P workflow,
Yes, fp8_e4m3fn was slower. Based on ComfyUI Example I2V 720P workflow, I had to change frame to 41.
I couldn't use kijai's WAN Wrapper becuase it's codes are based on CUDA. I am attaching the result. (I conveted to MP4 from WEBP format so there might be loss) I2V_480P.mp4I2V_720P_44frames.mp4 |
Beta Was this translation helpful? Give feedback.
-
if you mean kijai's wan wrapper, kijai is great custom node maker, it would be very ashamed if there's backdoor. |
Beta Was this translation helpful? Give feedback.
-
|
i think you are spreading misinformations. I've been using @kijai wrappers for a long time and never had issues |
Beta Was this translation helpful? Give feedback.
-
|
i was just sharing from the links i got from a patreon email from a AIfutureBenji, hadn't hasd a chance to look into the code in question only did a quick overview of the convo in the links. not spreading disinformation, trying to keep the community safe, especially after the previous issues that required securing comfyui 3rd party nodes. like i said just passing it on as an fyi, must've been a false positive since both posts were deleted in under 24hrs |
Beta Was this translation helpful? Give feedback.
-
|
That's good. security always matter, so even if it is not true, you did good job. ;) |
Beta Was this translation helpful? Give feedback.
-
Because the user this originated from is a known conspiracy theorist nutjob, offered zero proof and in general just didn't know what they were talking about. Despite that, we doublechecked that the files they mentioned have not been altered from the originals. |
Beta Was this translation helpful? Give feedback.
-
|
how are you guys making it even run? i hjave intel-compute-runtine version 25.*** sdnext is working fine but this i get this error i installed it via and then error above is shown, is there some working installatio nisntructions? not even on the main README Work for me, i am on Gentoo with B580 |
Beta Was this translation helpful? Give feedback.
-
|
Would you try the below? |
Beta Was this translation helpful? Give feedback.
-
|
tried, with same error somethings are different but same outcome |
Beta Was this translation helpful? Give feedback.
-
|
I ran into similar issues when trying to build Docker images based on openSUSE or Fedora. My working image: Intel's: |
Beta Was this translation helpful? Give feedback.
-
|
damn, i have no idea what to do now |
Beta Was this translation helpful? Give feedback.
-
|
Did you get it workng already? If not try this: pip uninstall torch then pip install torch==2.7.0+xpu --index-url https://download.pytorch.org/whl/test/xpu if you have the standard torch installed the install command won't override the installed version so you have to uninstall it first |
Beta Was this translation helpful? Give feedback.
-
|
Fedora user here with B580, but can you try installing vpl-gpu-rt. Also had some issues with intel-level-zero. Outside of Ubuntu, you'll have to track down the miscellaneous other libraries needed. |
Beta Was this translation helpful? Give feedback.
-
|
I just made a portable package for running ComfyUI with XPU on windows: Also, a Docker image for XPU: |
Beta Was this translation helpful? Give feedback.
-
|
Oh sweet, big fan of your work for other backends with ComfyUI Docker. That means I can deprecate my repository finally with you having an XPU Docker image that uses the new pip tooling and etc. since most of the dependencies can no longer be installed independently. Thanks a lot. |
Beta Was this translation helpful? Give feedback.
-
|
The larger than 4GB memory issue on any older Intel Arc GPUs than Lunar Lake and Battlemage has had the fix for that land in Pytorch's code repository so you are able to test it by installing Pytorch nightly 2.8.0.dev20250321+xpu, (2.8.0.dev20250325+xpu is broken at the time of writing this). It is highly suggested to have a new clean Python virtual environment for this to not break a working install. But to install this, you can run the following:
Append
Granted, it took a long time even with tricks (over 53 minutes) but this was better than only being able to generate slightly more than a frame before erroring out without the 4GB fix. I will note that unfortunately, the memory efficiency is still a bit lower than CUDA, I tried some settings a 4060 Ti 16GB could do that the A770 16GB could not and had to drop number of frames to fit (from 81 frames to 53). The other unfortunate thing is some tricks are unavailable. I am testing something out here I may release later but no guarantees. This gets less effective for smaller VRAM GPUs but nevertheless is still useful. Edit: The slated release that the 4GB fix will appear in for a stable release is the Pytorch 2.7 and the accompanying version of Intel's Extension for Pytorch that will come with that. |
Beta Was this translation helpful? Give feedback.
-
|
really impeccable performance, but now I have a problem. the first renders are super fast, then they become super slow. this on windows, regardless of the version of torch, or comfyui |
Beta Was this translation helpful? Give feedback.
-
|
I hope this an appropriate place to come for help getting my Arc A770 16GB working with ComfyUI. Recently I acquired an A770 to use for text and image generation because I wanted to be able to use larger models and produce larger images than I was able with my 4060 Ti 8GB card. I had read that it would be more work getting the Arc card to work, which was fine. But I seem to be hitting walls everywhere I turn. I'm wondering if there is some secret recipe of Linux distro/version, IPEX version, and PyTorch version to get decent performance that I just haven't stumbled across yet. At work and home I use RHEL and Fedora, but most of what I've run across in my searches refer to using Ubuntu (Intel's own documentation is heavily geared toward Ubuntu), so I installed Ubuntu 24.10 on a separate computer to test all of this out. I've tried running ComfyUI with various versions of IPEX and PyTorch with fairly wildly different performance results. After cloning the ComfyUI, my steps for the different PyTorch versions would be:
I ran some simple image generation tests using the "Image Generation" workflow from Workflow -> Browse Templates -> Basics. The two models I used were sdXL_v10.safetensors and v1-5-pruned-emaonly.safetensors, leaving everything else in the workflow the defaults. For reference, the results I got from my 4060 Ti 8GB running the same tests were: Here are my results from my A770 for each PyTorch version I tried: 2.5.1 2.6.10 2.8.0.dev20250321 v1-5-pruned-emaonly.safetensors 512x512 2.5.1 2.6.10 2.8.0.dev20250321 Each time the ComfyUI startup reported "Device: xpu", so it seems it was correctly using the GPU rather than the CPU. In my SDXL tests, Is this level of performance to be expected, or am I just completely screwing something up? Thanks for any help. |
Beta Was this translation helpful? Give feedback.
-
|
I tested again, this time using Ubuntu 22.04 LTS with the 6.8.0-52-generic kernel. These results were slightly better for SD1.5 and SDXL, and this time I also tested Flux. The A770 beat out the 4060 Ti 8GB when it came to Flux, and I assume that is due to the higher amount of VRAM on the A770. I test PyTorch 2.3.1 and PyTorch 2.8.0dev20250321. 2.3.1 out performed 2.8.0dev20250321 on all tests except one. My guess is that is due to lack of IPEX for 2.8.0. 2.8.0dev20250321 succeeded on the Flux 1920x1080 test, whereas 2.3.1 failed, which I assume is due to 2.8.0 overcoming the 4GB VRAM block limitation. I still feel like there is some performance being left on the table, so if anyone has insights in to a solid way to get this card to perform well on Linux I'd love to hear it. Here are my results from Ubuntu 22.04 LTS A770 command line: python ./main.py --listen 0.0.0.0 SDXL 512x512 SD1.5 512x512 SDXL 1024x1024 FLUX FP8 1152x896 FLUX FP8 1920x1080 |
Beta Was this translation helpful? Give feedback.
-
|
Hi to all, i'm also here to trying to understand if ipex is good enough for my arc a770, 'cause for what i evaluated so far, and as simonlui suggest, the dev nightly 2.8xxx version of torch works better than ipex 2.6+xpu. I tested in an ipex2.6+xpu venv, with sdxl-1,0-base, both in comfyui and in jupyter stablediffusionXLpipeline, with 34 seconds average for a 768 img with 30 steps, So i'm asking if i need to declaree some flags when starting comfy or when importing the models in the pipeline for activating the real performance that ipex should offer? i'm missing something? or we have to stay with nightly xpu pytorch versions? It will be also great if comfyui could implement openvino, as it seems for my experience with my arc a770 the better option in terms of performance. |
Beta Was this translation helpful? Give feedback.
-
|
Hey, I saw that you successfully set up and used ComfyUI on your system. I’m trying to set it up on my Windows 10 Pro machine with 64 GB RAM and an Arc A750 GPU, but I’m running into some issues. I trying to set it up up for 2 days now. If all things go right the generation doesn't work. |
Beta Was this translation helpful? Give feedback.
-
|
i'm on linux, so i followed the installation instructions on https://github.com/comfyanonymous/ComfyUI, you have to setup an python venv or conda environment, with ipex or better without it, use the nightly 2.8xxx+xpu version,then clone the comfyui github and run the requirements.txt in the venv but put a # to disable the packages already in your venv, and install the remaining with --no-deps, check if torch sees your 'xpu' in python : |
Beta Was this translation helpful? Give feedback.
-
File "C:\ComfyUI2\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\cuda_init_.py", line 971, in current_device C:\ComfyUI2\ComfyUI_windows_portable>pause |
Beta Was this translation helpful? Give feedback.
-
|
Does anybody have a list of stable diffusion models compatible with a B580? |
Beta Was this translation helpful? Give feedback.
and others
-
ComfyUI now supports Intel Arc Graphics. (#409)
Since the installation tutorial for Intel Arc Graphics is quite long, I'll write it here first.
Intel Extension for PyTorch is currently only available for Linux, so you will need to have a Linux or WSL environment.
Arch Linux (with
paru) are used here as example operating systems.Install Python and PIP:
Install Intel Compute Runtime and Intel oneAPI Base Kit:
Install ComfyUI:
Install Dependencies (via
venv):python -m venv venv source venv/bin/activate pip install torch==2.0.1a0 torchvision==0.15.2a0 intel-extension-for-pytorch==2.0.120+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/ pip install -r requirements.txtFor the second start and beyond, venv needs to be reactivated:
source venv/bin/activateSet oneAPI vars:
source /opt/intel/oneapi/setvars.shRunning ComfyUI (via
python):Running ComfyUI (via
ipexrun):Beta Was this translation helpful? Give feedback.
All reactions