There as always other ways although I agree with the use of containers in the end. But there are other elements of notebooks that tackle some of the key items you highlighted.

For example `jupytext` to make nbs more VCS friendly, python-dotenv for better secrets management and even using the "!" operator to run "!conda list" or "!pip freeze" or there equivalent.

As for modularity there is Papermill.

Data Scientist and Chartered Aeronautical Engineer (MEng CEng EUR ING MRAeS) with over 15 years experience in the Aerospace, Defence and Rail Industry.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Ashraf Miah

Data Scientist and Chartered Aeronautical Engineer (MEng CEng EUR ING MRAeS) with over 15 years experience in the Aerospace, Defence and Rail Industry.