http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture Support for the k-Wave MATLAB toolbox en-US Tue, 12 May 2026 23:01:48 +0000 http://bbpress.org/?v=1.0.2 q http://www.k-wave.org/forum/search.php http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-6823 Thu, 04 Apr 2019 13:40:12 +0000 Jiri Jaros 6823@http://www.k-wave.org/forum/ <p>Hi both,<br /> I've just answered this question in </p> <p><a href="http://www.k-wave.org/forum/topic/running-on-aws-tesla-instances#post-6815" rel="nofollow">http://www.k-wave.org/forum/topic/running-on-aws-tesla-instances#post-6815</a></p> <p>Simply said, you have to recompile the code with latest CUDA.</p> <p>Jiri </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-6818 Tue, 02 Apr 2019 03:09:35 +0000 qjk 6818@http://www.k-wave.org/forum/ <p>DLam, I received exactly the same error message when trying to run using Tesla V100 using AWS. The exact same code and data file ran perfectly on an AWS Tesla K80 instance.</p> <p>I was using Ubuntu 18 for this. </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-6817 Mon, 01 Apr 2019 17:00:57 +0000 DLam 6817@http://www.k-wave.org/forum/ <p>Hi Brad, Jiri,</p> <p>Sorry for necro'ing, but this thread seems the most relevant.<br /> I'm getting the same error of "Error : All CUDA-capable devices are busy or unavailable".</p> <p>My cluster's GPU is a Tesla V100 (Volta archi) running Linux (CentOs 7). I'm wondering if it's a build problem on my side as well? </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-5818 Fri, 20 Jan 2017 09:54:13 +0000 Jiri Jaros 5818@http://www.k-wave.org/forum/ <p>Hi Julien,<br /> I run a couple of tests and it appears the error only occurs on Pascal GPUs. It is likely to be caused by the fact the code was compiled by CUDA 7.5 and Pascal natively supports CUDA 8.0.</p> <p>I will have to take a closer look at the problem next week. </p> <p>Jiri </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-5817 Thu, 19 Jan 2017 12:10:25 +0000 Julien S. 5817@http://www.k-wave.org/forum/ <p>Hi Jiri,</p> <p>With my Titan X GPU, I have theoretically 12288MB of total memory and 12189MB of total dedicated memory (when checking nvidia-settings). I'm running nonlinear simulations in a homogeneous medium. I ran some tests to see what is the limit of gridsize I can reach and what are the corresponding computational resources displayed by k-wave when the cuda code initializes.</p> <p>For a grid of total size (PML included) 960 x 240 x 240 the code runs and I obtain :<br /> - Current host memory in use : 4029MB<br /> - Current device memory in use : 4352MB</p> <p>For a grid of size 1160 x 240 x 240 the code runs and I obtain :<br /> - Current host memory in use : 4800MB<br /> - Current device memory in use : 5212MB</p> <p>For a grid of size 1360 x 240 x 240 the error message appears and I obtain :<br /> - Current host memory in use : 5569MB<br /> - Current device memory in use : 6074MB</p> <p>For bigger gridsizes the code does not run.</p> <p>If FFT takes another 1GB to run the simulation, my 12000MB GPU still should have enough memory to run a bigger simulation, isn't it ? It seems that the code does not run anymore when I exceed 50% of used dedicated memory (i.e. 6000MB).</p> <p>Thank you again,</p> <p>Julien </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-5816 Wed, 18 Jan 2017 18:41:35 +0000 Jiri Jaros 5816@http://www.k-wave.org/forum/ <p>Hi Julien,<br /> this is going to be an out-of-memory problem. cuFFT (CUDA 3D FFT) needs some scratch place to calculate FFTs in a fast way and I think there's not enough space for it.<br /> This domain size in a fully heterogeneous absorbing case consumes about 6.7 GB of RAM for raw data. FFT can take another 1GB, so if you have less than 8GB, you won't be able to run such a big simulation.</p> <p>Jiri </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-5814 Tue, 17 Jan 2017 16:43:38 +0000 Julien S. 5814@http://www.k-wave.org/forum/ <p>Hi Brad,</p> <p>First of all, thank you for your reply and for the new version of your GPU code. Indeed I'm using Linux and I've tried your new version of the code for Pascal GPUs. I have actually one problem when running some simulations. When I increase the number of gridpoints I get this error :</p> <p>Error : Failed to execute an cuFFT on the GPU for Execute_FFT_3D_R2C.</p> <p>For example, with a grid of size 800 x 256 x 256, the code runs properly, but when designing a grid of size 900 x 256 x 256, the code does not start to run and returns this error message.</p> <p>Do you have any idea of what the problem could be ?</p> <p>Julien </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-5798 Wed, 04 Jan 2017 14:03:31 +0000 Bradley Treeby 5798@http://www.k-wave.org/forum/ <p>Hi Julien,</p> <p>Are you using linux? We've just uploaded a GPU binary for Pascal GPUs. Let me know if it doesn't work.</p> <p>Brad. </p> http://www.k-wave.org/forum/topic/run-cuda-simulation-on-gpu-with-pascal-architecture#post-5794 Fri, 23 Dec 2016 16:11:09 +0000 Julien S. 5794@http://www.k-wave.org/forum/ <p>Hi,</p> <p>I am trying to use the kspaceFirstOrdre3D-CUDA code to simulate non-linear acoustics on a Titan X GPU. With my old graphic card GeForce GT 730 the code worked even if the GPU was not powerfull enough to speed up the execution. But now with my new Titan X card, I systematically get that error when I try to launch the code :<br /> "Error : All CUDA-capable devices are busy or unavailable".</p> <p>I read in the K-wave documentation that the CUDA code is complied for Maxwell graphic cards. My Titan X has a Pascal architecture. Is it why the code execution returns that error ? If so, is it possible to make the CUDA code work with a Pascal card, and how to do so ?</p> <p>Thanks in advance for your reply. </p>