I am currently using the JupyterLab that you provide, and I was wondering how many nodes we are each allowed to use when running code in parallel using modules like multiprocess or pathos in python?
Best,
Emma
Dylan Nelson
15 Feb '21
Hi Emma,
The Lab service isn't meant for such large computations in general. The limit is 1 CPU (on 1 node). If you want to run very expensive calculations, it may be better to think about using the Lab to extract the relevant data, then running the analysis on your local cluster.
Hi,
I am currently using the JupyterLab that you provide, and I was wondering how many nodes we are each allowed to use when running code in parallel using modules like multiprocess or pathos in python?
Best,
Emma
Hi Emma,
The Lab service isn't meant for such large computations in general. The limit is 1 CPU (on 1 node). If you want to run very expensive calculations, it may be better to think about using the Lab to extract the relevant data, then running the analysis on your local cluster.
Hi Dylan,
That is good to know. Thank you!
Best,
Emma