Search
Items tagged with: DVC
#DataEngineering for #MobilityDataScience (with #Python and #DVC) session stream recording is now online
http://anitagraser.com/2023/09/16/data-engineering-for-mobility-data-science-with-python-and-dvc/
#GISChat #SpatialDataScience
http://anitagraser.com/2023/09/16/data-engineering-for-mobility-data-science-with-python-and-dvc/
#GISChat #SpatialDataScience
Data engineering for Mobility Data Science (with Python and DVC)
This summer, I had the honor to β once again β speak at the OpenGeoHub Summer School. This time, I wanted to challenge the students and myself by not just doing MovingPandas but by intrβ¦Free and Open Source GIS Ramblings
The materials of my #MovementDataAnalytics with #MovingPandas and #DVC are openly available at:
https://github.com/movingpandas/movingpandas-examples/tree/opengeohub2023
The session recording will be made available as well, in the near future. Follow @opengeohub for updates
https://github.com/movingpandas/movingpandas-examples/tree/opengeohub2023
The session recording will be made available as well, in the near future. Follow @opengeohub for updates
GitHub - movingpandas/movingpandas-examples at opengeohub2023
Example notebooks illustrating MovingPandas use cases - GitHub - movingpandas/movingpandas-examples at opengeohub2023GitHub
#DataScience proof of concept blog post is finally ready:
https://anitagraser.com/2023/02/25/tracking-geoprocessing-workflows-with-qgis-dvc/
including source code and demo video
Let me know what you think. Is it worth looking into automatic #QGIS modeler to #DVC export?
#gischat #datascience #geoprocessing #dataengineering #gis
https://anitagraser.com/2023/02/25/tracking-geoprocessing-workflows-with-qgis-dvc/
including source code and demo video
Let me know what you think. Is it worth looking into automatic #QGIS modeler to #DVC export?
#gischat #datascience #geoprocessing #dataengineering #gis
Tracking geoprocessing workflows with QGIS & DVC
Todayβs post is a geeky deep dive into how to leverage DVC (not just) data version control to track QGIS geoprocessing workflows. βWhy is this great?β you may ask. DVC tracks dataβ¦Free and Open Source GIS Ramblings
Next level #DataScience proof of concept:
Turned a simple QGIS Processing model into a #DVC data-versioned #geoprocessing workflow
"Why is this great?" you may ask β
DVC tracks data, parameters, and code. If anything changes, we simply rerun the process and DVC will figure out which stages need to be recomputed and which can be skipped by re-using cached results.
This can lead to huge time savings compared to re-running the whole model π©βπ»π₯³
Turned a simple QGIS Processing model into a #DVC data-versioned #geoprocessing workflow
"Why is this great?" you may ask β
DVC tracks data, parameters, and code. If anything changes, we simply rerun the process and DVC will figure out which stages need to be recomputed and which can be skipped by re-using cached results.
This can lead to huge time savings compared to re-running the whole model π©βπ»π₯³