{{ message }}
Repository navigation
Training time of MAISI VAE #2009
Description
Hi, I am trying to train the MAISI VAE from scratch using my dataset.
I wonder how long it takes to train on such a large dataset?
When I use 30k CT scans, it takes nearly 20 hours for 1 epoch on two A100. Is it correct? I use DDP, but I found it was even slower when I increased the GPU number.
If so, is there any method to accelerate the training process?
Activity
Can-Zhao commentedon Aug 14, 2025
It is slow. We trained it with 16 A100 gpus. That is why we released MAISI VAE, we hope users can fine-tune from it rather than training from scratch