“To combat promotional content” I do not include name of the tool I run locally. Or should I? I’m new to using AI, I’m trying to play with local models and one tool when in ‘use CPU’ mode works more or less. But when I try to run image generation on NVIDIA via Vulkan, I get OutOfDeviceMemory for generation of 512x512 images (256x works) whereas in ‘use CPU’ mode RAM usage for 512 of the tool is much less than total GPU memory (~70%). Is it typical - I mean models use GPU RAM much more than CPU RAM? If yes, why? I marked post as technical and I want technical details. TIA submitted by /u/alex20_202020
Originally posted by u/alex20_202020 on r/ArtificialInteligence
You must log in or # to comment.