How can you transition from photo-type or exploratory research software to production code? Can you? I've been discussing this with my guest Duncan McGregor. In the first part of our discussion we touch on how you can effectively analyse large data sets that are distributed over different locations with tools like Dask. Links:https://www.youtube.com/@PairingWithDuncan Duncan's YouTube channelhttps://www.oneeyedmen.com Duncan's websitehttps://github.com/dmcg and his GitHubhttps://www.dask.org Daskhttps://github.com/aws-solutions-library-samples/distributed-compute-on-aws-with-cross-regional-dask cross regional programming with Daskhttps://aws.amazon.com/blogs/big-data/build-efficient-cross-regional-i-o-intensive-workloads-with-dask-on-aws/https://blog.dask.org/2022/07/19/dask-multi-cloudhttps://zarr.readthedocs.io/en/stable/ Zarr formathttps://en.wikipedia.org/wiki/NetCDF NetCDFhttps://www.ecmwf.int European Centre for Medium Range Weather Forecastshttps://github.com/ecmwfhttps://www.eumetsat.inthttps://pangeo.iohttps://testbook.readthedocs.io/en/latest/ Unit testing with Jupyterhttps://github.com/nteract/testbookConferences/Events:https://dhrse2025.er.kcl.ac.uk King's College London: summer school for digital humanities. 30 June - 4 July, Londonhttps://www.software.ac.uk/workshop/collaborations-workshop-2025-cw25 The annual Collaborations Workshop of the Software Sustainability Institute UK, 13-15 May, University of Sterling, Scotlandhttps://www.helmholtz-hirse.de/events/2025_06_13-rsehpcatisc.html The RSE workshop (13 June) at the ISC conference in Hamburg, Germany https://nordic-rse.org Nordic RSE Conference, Gothenburg, Sweden 20-21 MayGet in touchThank you for listening! Merci de votre écoute! Vielen Dank für´s Zuhören! Contact Details/ Coordonnées / Kontakt: Email mailto:[email protected] UK RSE Slack (ukrse.slack.com): @code4thought or @piddie Bluesky: https://bsky.app/profile/code4thought.bsky.social LinkedIn: https://www.linkedin.com/in/pweschmidt/ (personal Profile)LinkedIn: https://www.linkedin.com/company/codeforthought/ (Code for Thought Profile) This podcast is licensed under the Creative Commons Licence: https://creativecommons.org/licenses/by-sa/4.0/
No persons identified in this episode.
This episode hasn't been transcribed yet
Help us prioritize this episode for transcription by upvoting it.
Popular episodes get transcribed faster
Other recent transcribed episodes
Transcribed and ready to explore now
3ª PARTE | 17 DIC 2025 | EL PARTIDAZO DE COPE
01 Jan 1970
El Partidazo de COPE
13:00H | 21 DIC 2025 | Fin de Semana
01 Jan 1970
Fin de Semana
12:00H | 21 DIC 2025 | Fin de Semana
01 Jan 1970
Fin de Semana
10:00H | 21 DIC 2025 | Fin de Semana
01 Jan 1970
Fin de Semana
13:00H | 20 DIC 2025 | Fin de Semana
01 Jan 1970
Fin de Semana
12:00H | 20 DIC 2025 | Fin de Semana
01 Jan 1970
Fin de Semana