Putting this out to the community to see if there are any tips or tricks for processing large datasets
We are processing 11GB of imagery using a dual core i7 laptop with hyperthreading but can’t get it to process the imagery with more than (the equivalent of) 1 core (25%). We and have configured the processing options > resources to the maximum available 4 CPU threads.
We have the option of moving the processing into the cloud, if anyone can provide any recommended specifications on VM configurations that would be awesome.
*Edit Memory specs and some additional information
16GB RAM 256GB SSD
Using an attached 1TB USB3 drive as the source. This ran successfully at 100% for a 2GB dataset.
Thanks
John P
Solved! Go to Solution.
We ended up moving to a Virtual Machine and had much better success with processing. - Using SSD instead of External HDD certainly assisted with processing data
hardware specs ok? chip type is fine, but you don't mention your ram nor ssd drive space
16GB RAM 256GB SSD.
We have been using an attached 1TB USB3 drive as the source. This ran successfully at 100% for a 2GB dataset.
John,
What is the resolution of the imagery & how much time did it take to process?
I'm using a Win 10 PC with i7-4790 @ 3.6GHz CPU 16Gb RAM with 256Gb SSD drive with 36 x 7Mb 4592x3056pixel 24bit colour jpgs files and this takes approx 21minutes to process into a 3D textured mesh.
Thanks
We ended up moving to a Virtual Machine and had much better success with processing. - Using SSD instead of External HDD certainly assisted with processing data