PyData & Scientific Libraries Stack
10 talks from the 2023 edition.
-
Apache Arrow: connecting and accelerating dataframe libraries across the PyData ecosystem
Joris Van den Bossche
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing, and is becoming the de facto standard for tabular data. This talk will give an overview of the recent developments...
-
Geospatial Data Processing with Python: A Comprehensive Tutorial ▶ Recording 📝 Transcript
Martin Christen
In this tutorial, you will learn about the various Python modules for processing geospatial data, including GDAL, Rasterio, Pyproj, Shapely, Folium, Fiona, OSMnx, Libpysal, Geopandas, Pydeck, Whitebox, ESDA, and...
-
Let's contribute to pandas (3 hours) #1
Noa Tamir, Patrick Hoefler
PyData Berlin are excited to bring you this open source workshop dedicated to contributing to pandas. This tutorial is 3 hours. We will have a break and continue with the same group of people. pandas is a data...
-
Let's contribute to pandas (3 hours) #2
Noa Tamir, Patrick Hoefler
PyData Berlin are excited to bring you this open source workshop dedicated to contributing to pandas. This tutorial is 3 hours. We will have a break and continue with the same group of people. pandas is a data...
-
Observability for Distributed Computing with Dask ▶ Recording 📝 Transcript
Hendrik Makait
Debugging is hard. Distributed debugging is hell. Dask is a popular library for parallel and distributed computing in Python. Dask is commonly used in data science, actual science, data engineering, and machine...
-
Pandas 2.0 and beyond ▶ Recording 📝 Transcript
Joris Van den Bossche, Patrick Hoefler
Pandas has reached a 2.0 milestone in 2023. But what does that mean? And what is coming after 2.0? This talk will give an overview of what happened in the latest releases of pandas and highlight some topics and major...
-
Shrinking gigabyte sized scikit-learn models for deployment ▶ Recording 📝 Transcript
Pavel Zwerschke, Yasin Tatar
We present an open source library to shrink pickled scikit-learn and lightgbm models. We will provide insights of how pickling ML models work and how to improve the disk representation. With this approach, we can...
-
The Beauty of Zarr ▶ Recording 📝 Transcript
Sanket Verma
In this talk, I’d be talking about [Zarr](https://zarr.dev/), an open-source data format for storing chunked, compressed N-dimensional arrays. This talk presents a systematic approach to understanding and...
-
Unlocking Information - Creating Synthetic Data for Open Access. ▶ Recording 📝 Transcript
Antonia Scherz
Many good project ideas fail before they even start due to the sensitive personal data required. The good news: a synthetic version of this data does not need protection. Synthetic data copies the actual data's...
-
You've got trust issues, we've got solutions: Differential Privacy
Vikram Waradpande, Sarthika Dhawan
As we are in an era of big data where large groups of information are assimilated and analyzed, for insights into human behavior, data privacy has become a hot topic. Since there is a lot of private information which...