Low Memory Error during Photoconsistency

[sam3d]

I've been following the photoconsistency tutorial to try and improve a detailed mesh but am running out of memory during the final stage with images at 100% resolution. Is it possible to determine if the issue is with my system of video RAM from the log? It's no big deal if i can't complete it but i'd be interested to know how much more memory i'd need in this case as i'm planning to put together a new PC soon.

Log file is attached with partial details below:
Log_2020_02_14_12_34_12.txt

[15:14:04] CUDA device : 1/2

[15:14:04] CUDA device name : GeForce GTX 980 Ti

[15:14:04] CUDA runtime version : 10.0

[15:14:04] CUDA driver version : 10.2

[15:14:04] CUDA free memory : 5321

[15:14:04] CUDA total memory : 6144

[15:14:04] CUDA blocks properties : 2147483647x65535x65535

[15:14:04] CUDA threads properties : 1024x1024x64 (max 1024)

[15:14:04] CUDA capabilities : 5.2

[15:14:04] CUDA runtime capabilities : 5.0

[15:14:04] CUDA device : 2/2

[15:14:04] CUDA device name : GeForce GTX 980 Ti

[15:14:04] CUDA runtime version : 10.0

[15:14:04] CUDA driver version : 10.2

[15:14:04] CUDA free memory : 5998

[15:14:04] CUDA total memory : 6144

[15:14:04] CUDA blocks properties : 2147483647x65535x65535

[15:14:04] CUDA threads properties : 1024x1024x64 (max 1024)

[15:14:04] CUDA capabilities : 5.2

[15:14:04] CUDA runtime capabilities : 5.0

[15:14:10] Used device : GeForce GTX 980 Ti [ID 0] [RS 4000]

[15:14:13] SysInfo | Cpu: 12.03 %; Disk (U/T): 185186/857982 MB (672796 MB free, 21.58 % used); Memory (U/T): 10990/16280 MB (6140 MB free, 67.51 % used)

[15:14:17] Used device : GeForce GTX 980 Ti [ID 1] [RS 4000]

[15:14:18] +++ BAD ALLOC ERROR +++

[15:14:18] +++ ERROR +++ (not enough host memory)

[15:14:19] Photoconsistency ERROR!

[Andrea Alessi]

Hi sam,

unfortunately raising the parameters this much has the drawback that it requires more system memory. You ran out of RAM (your computer memory, not your video card memory) (not enough host memory).

I would recommend adding at least 16 more GB of ram if you're going to run at 100% PC values. If you can't, make sure you have no other applications open and/or lower the photoconsistency resolution value.

I hope this helps!

[sam3d]

Hey Andrea

Thanks for the feedback. Glad it's just the system RAM as I was planning to retain the old GPUs when i replace the PC.

Maybe Dragonfruit will help too ?

[Andrea Alessi]

Yes dragonfruit will have a lower memory footpring but i would still recommend at least 32GB of ram though!

[DanielMuirhead]

Hi sam3d,

In case it is of interest: my computer has 32GB RAM, with Windows 10 operating system. There is an option within Windows 10 pertaining to 'virtual memory' and/or 'paging file'. I have 1TB SSD boot drive, but ~230GB of that permanently set aside for 'virtual memory', so in effect I have 32GB physical RAM + 230GB virtual = ~256GB total.

More often than not, with the data sets I've been processing - input count 2k-5k - my Memory usage within 3DF regularly goes above ~400% (i.e. 128GB RAM). I have a 35K input file that, when I load it into 3DF, goes close to 200GB RAM usage.

Now, I must strongly state that I am not advising you to alter your system settings! It may be highly inadvisable for someone to alter their system settings as I have done, I willingly took the risk with my hardware, for all I know this might be drastically reducing the life span of my SSD and/or my computer might blow up tomorrow. Also, the 3DF staff would be better placed to advise in respect of this matter. However, it was to provide some insight into how I exceed the limits of my (physical) RAM through the use of virtual memory/page file.

[sam3d]

Hi Daniel

THanks for the information; I'll check it out. No worries, i wont hold you to anything if it goes up in smoke I've recently changed my C drive to a 1tb SSD too so it might be an option. I had noticed the size of some of the datasets for your Sketchfab models and wondered how you were managing it.

BTW - you could do with a getting a camera up in the air