There is a numerical benchmark reported in Fig. 4 with absolute runtimes and memory usages that can directly be reproduced with the provided source code. The benchmark was performed on the author's computer, and since numerical performance and parallel scaling can be somewhat hardware-dependent, it would be of interest to see whether a performance that is comparable to the one reported in the paper can be reproduced by others on their own computers in practice. The benchmark simulates a growing tissue from one to 10,000 cells in just ten minutes, so this offers an easy entry point into tissue modeling and simulation. No input data is needed to reproduce the output. The program has no dependencies.
This paper proposes a probabilistic planner that can solve goal-conditional tasks such as complex continuous control problems. The approach reaches state-of-the-art performance when compared to current deep reinforcement learning algorithms. However, the method relies on an ensemble of deep generative models and is computationally intensive. It would be interesting to reproduce the results presented in this paper on their robotic manipulation and navigation problems as these are very challenging problems that current reinforcement learning methods cannot easily solve (and when they do, they require a significantly larger number of experiences). Can the results be reproduced out-of-the-box with the provided code?
If all went right, the analysis should be fully reproducible without the need to make any adjustments. The paper aims to find optimal locations for new parkruns, but we were not 100% sure how 'optimal' should be defined. We provide a few examples, but the code was meant to be flexible enough to allow potential decision makers to specify their own, alternative objectives. The spatial data set is also quite interesting and fun to play around with. Cave: The full analysis takes a while to run (~30+ min) and might require >= 8gb ram.