PyCon DE & PyData Berlin 2023
– · bcc Berlin Congress Center
The 2023 edition of PyCon DE & PyData Berlin took place 17–19 April 2023 at the bcc Berlin Congress Center. Every session is listed below, with the speakers on their own page. Revisit the original conference site.
-
Recording available. BHAD: Explainable unsupervised anomaly detection using Bayesian histograms
The detection of outliers or anomalous data patterns is one of the most prominent machine learning use cases in industrial applications. I present a…
-
Recording available. Polars - make the switch to lightning-fast dataframes
In this talk, we will report on our experiences switching from Pandas to Polars in a real-world ML project. Polars is a new high-performance dataframe…
-
Recording available. An unbiased evaluation of environment management and packaging tools
Python packaging is quickly evolving and new tools pop up on a regular basis. Lots of talks and posts on packaging exist but none of them give a…
-
Recording available. Fear the mutants. Love the mutants.
Developers often use code coverage as a target, which makes it a bad measure of test quality. Mutation testing changes the game: create mutant versions of…
-
You've got trust issues, we've got solutions: Differential Privacy
As we are in an era of big data where large groups of information are assimilated and analyzed, for insights into human behavior, data privacy has become…
-
Recording available. Driving down the Memray lane - Profiling your data science work
When handling a large amount of data, memory profiling the data science workflow becomes more important. It gives you insight into which process consumes…
-
Recording available. Most of you don't need Spark. Large-scale data management on a budget with Python
The Python data ecosystem has matured during the last decade and there are less and less reasons to rely only large batch process executed in a Spark…
-
Recording available. Streamlit meets WebAssembly - stlite
Streamlit, a pure-Python data app framework, has been ported to Wasm as "stlite". See its power and convenience with many live examples and explore its…
-
Recording available. How to connect your application to the world (and avoid sleepless nights)
Let’s say you are the ruler of a remote island. For it to succeed and thrive you can’t expect it to be isolated from the world. You need to establish…
-
Let's contribute to pandas (3 hours) #1
PyData Berlin are excited to bring you this open source workshop dedicated to contributing to pandas. This tutorial is 3 hours. We will have a break and…
-
Recording available. The CPU in your browser: WebAssembly demystified
In the recent years we saw an explosion of usage of Python in the browser: Pyodide, CPython on WASM, PyScript, etc. All of this is possible thanks to the…
-
Recording available. Giving and Receiving Great Feedback through PRs
Do you struggle with PRs? Have you ever had to change code even though you disagreed with the change just to land the PR? Have you ever given feedback…
-
Recording available. MLOps in practice: our journey from batch to real-time inference
I will present the challenges we encountered while migrating an ML model from batch to real-time predictions and how we handled them. In particular, I…
-
Recording available. Software Design Pattern for Data Science
Even if every data science work is special, a lot can be learned from similar problems solved in the past. In this talk, I will share some specific…
-
Recording available. Writing Plugin Friendly Python Applications
In modern software engineering, plugin systems are a ubiquitous way to extend and modify the behavior of applications and libraries. When software is…
-
Recording available. FastAPI and Celery: Building Reliable Web Applications with TDD
In this talk, we will explore how to use the FastAPI web framework and Celery task queue to build reliable and scalable web applications in a test-driven…
-
Recording available. How to teach NLP to a newbie & get them started on their first project
The materials presented during this tutorial are open source and can be used by coaches and tutors who want to teach their students how to use Python for…
-
Recording available. Great Security Is One Question Away
After a decade of writing code, I joined the application security team. During the transition process, I discovered that there are many myths about…
-
Recording available. Maps with Django
Keeping in mind the **Pythonic** principle that _“simple is better than complex”_ we'll see how to create a web **map** with the **Python** based _web…
-
Recording available. Hyperparameter optimization for the impatient
In the last years, Hyperparameter Optimization (HPO) became a fundamental step in the training of Machine Learning (ML) models and in the creation of…
-
Recording available. Methods for Text Style Transfer: Text Detoxification Case
Global access to the Internet has enabled the spread of information throughout the world and has offered many new possibilities. On the other hand,…
-
Recording available. The bumps in the road: A retrospective on my data visualisation mistakes
We will delve into the importance of effective data visualisation in today's world. We will explore how it can help convey insights from data using…
-
Recording available. Thou Shall Judge But With Fairness: Methods to Ensure an Unbiased Model
Is your model prejudicial? Is your model deviating from the predictions it ought to have made? Has your model misunderstood the concept? In the world of…
-
Recording available. Unlocking Information - Creating Synthetic Data for Open Access.
Many good project ideas fail before they even start due to the sensitive personal data required. The good news: a synthetic version of this data does not…
-
Recording available. Aspect-oriented Programming - Diving deep into Decorators
The aspect-oriented programming paradigm can support the separation of cross-cutting concerns such as logging, caching, or checking of permissions. This…
-
Recording available. How to baseline in NLP and where to go from there
In this talk, we will explore the build-measure-learn paradigm and the role of baselines in natural language processing (NLP). We will cover the common…
-
Recording available. Performing Root Cause Analysis with DoWhy, a Causal Machine-Learning Library
In this talk, we will introduce the audience to [DoWhy](https://www.pywhy.org/dowhy), a library for causal machine-learning (ML). We will introduce…
-
Recording available. The State of Production Machine Learning in 2023
As the number of production machine learning use-cases increase, we find ourselves facing new and bigger challenges where more is at stake. Because of…
-
Recording available. WALD: A Modern & Sustainable Analytics Stack
The name **WALD**-stack stems from the four technologies it is composed of, i.e. a cloud-computing **W**arehouse like Snowflake or Google BigQuery, the…
-
What could possibly go wrong? - An incomplete guide on how to prevent, detect & mitigate biases in data products
Within this talk, I want to look at the topic of data ethics with a practical lens and facilitate the discussion about how we can establish ethical data…
-
Accelerate Python with Julia
Speeding up Python code has traditionally been achieved by writing C/C++ — an alien world for most Python users. Today, you can write high performance…
-
Recording available. Accelerating Python Code
Python is a beautiful language for fast prototyping and and sketching ideas quickly. People often struggle to get their code into production though for…
-
Advanced Visual Search Engine with Self-Supervised Learning (SSL) Representations and Milvus
Image retrieval is the process of searching for images in a large database that are similar to one or more query images. A classical approach is to…
-
Recording available. Apache StreamPipes for Pythonistas: IIoT data handling made easy!
The industrial environment offers a lot of interesting use cases for data enthusiasts. There are myriads of interesting challenges that can be solved by…
-
Recording available. Bayesian Marketing Science: Solving Marketing's 3 Biggest Problems
In this talk I will present two new open-source packages that make up a powerful and state-of-the-art marketing analytics toolbox. Specifically, PyMC-…
-
Recording available. BLE and Python: How to build a simple BLE project on Linux with Python
Bluetooth Low Energy (BLE) is a part of the Bluetooth standard aimed at bringing wireless technology to low-power devices, and it's getting into…
-
Bringing NLP to Production (an end to end story about some multi-language NLP services)
Models in Natural Language Processing are fun to train but can be difficult to deploy. The size of their models, libraries and necessary files can be…
-
Recording available. Building Hexagonal Python Services
The importance of enterprise architecture patterns is all well-known and applicable to varied types of tasks. Thinking about the architecture from the…
-
Recording available. From notebook to pipeline in no time with LineaPy
The nightmare before data science production: You found a working prototype for your problem using a Jupyter notebook and now it's time to build a…
-
Recording available. Geospatial Data Processing with Python: A Comprehensive Tutorial
In this tutorial, you will learn about the various Python modules for processing geospatial data, including GDAL, Rasterio, Pyproj, Shapely, Folium,…
-
Recording available. Haystack for climate Q/A
How can NLP and Haystack help answer sustainability questions and fight climate change? In this talk we walkthrough our experience using Haystack to build…
-
Recording available. Introduction to Async programming
Asynchronous programming is a type of parallel programming in which a unit of work is allowed to run separately from the primary application thread. Post…
-
Recording available. Maximizing Efficiency and Scalability in Open-Source MLOps: A Step-by-Step Approach
This talk presents a novel approach to MLOps that combines the benefits of open-source technologies with the power and cost-effectiveness of cloud…
-
Recording available. Modern typed python: dive into a mature ecosystem from web dev to machine learning
Typing is at the center of „modern Python“, and tools (mypy, beartype) and libraries (FastAPI, SQLModel, Pydantic, DocArray) based on it are slowly eating…
-
Recording available. Neo4j graph databases for climate policy
In this talk we walkthrough our experience using Neo4j and Python to model climate policy as a graph database. We discuss how we did it, some of the…
-
Recording available. Practical Session: Learning on Heterogeneous Graphs with PyG
Learn how to build and analyze heterogeneous graphs using PyG, a machine graph learning library in Python. This workshop will provide a practical…
-
Recording available. Raised by Pandas, striving for more: An opinionated introduction to Polars
Pandas is the de-facto standard for data manipulation in python, which I personally love for its flexible syntax and interoperability. But Pandas has…
-
Recording available. Teaching Neural Networks a Sense of Geometry
By taking neural networks back to the school bench and teaching them some elements of geometry and topology we can build algorithms that can reason about…
-
Recording available. The Beauty of Zarr
In this talk, I’d be talking about [Zarr](https://zarr.dev/), an open-source data format for storing chunked, compressed N-dimensional arrays. This talk…
-
Recording available. Using transformers – a drama in 512 tokens
“Got an NLP problem nowadays? Use transformers! Just download a pretrained model from the hub!” - every blog article ever As if it’s that easy, because…
-
Recording available. What are you yield from?
Many developers avoid using generators. For example, many well-known python libraries use lists instead of generators. The generators themselves are…
-
Workshop on Privilege and Ethics in Data
Data-driven products are becoming more and more ubiquitous. Humans build data-driven products. Humans are intrinsically biased. This bias goes into the…
-
You are what you read: Building a personal internet front-page with spaCy and Prodigy
Sometimes the internet can be a bit overwhelming, so I thought I would make a tool to create a personalized summary of it! In this talk, I'll demonstrate…
-
“Who is an NLP expert?” - Lessons Learned from building an in-house QA-system
Innovations such as sentence-transformers, neural search and vector databases fueled a very fast development of question-answering systems recently. At…
-
Accelerating Public Consultations with Large Language Models: A Case Study from the UK Planning Inspectorate
Local Planning Authorities (LPAs) in the UK rely on written representations from the community to inform their Local Plans which outline development needs…
-
Recording available. Actionable Machine Learning in the Browser with PyScript
PyScript brings the full PyData stack in the browser, opening up to unprecedented use cases for interactive data-intensive applications. In this scenario,…
-
Apache Arrow: connecting and accelerating dataframe libraries across the PyData ecosystem
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing, and is becoming the de facto standard for tabular…
-
Recording available. Ask-A-Question: an FAQ-answering service for when there's little to no data
Doing data science in international development often means finding the right-sized solution in resource-constrained settings. This talk walks you through…
-
Recording available. AutoGluon: AutoML for Tabular, Multimodal and Time Series Data
AutoML, or automated machine learning, offers the promise of transforming raw data into accurate predictions with minimal human intervention, expertise,…
-
Behind the Scenes of tox: The Journey of Rewriting a Python Tool with more than 10 Million Monthly Downloads
tox is a widely-used tool for automating testing in Python. In this talk, we will go behind the scenes of the creation of tox 4, the latest version of the…
-
Building a Personal Assistant With GPT and Haystack: How to Feed Facts to Large Language Models and Reduce Hallucination.
Large Language Models (LLM), like ChatGPT, have shown miraculous performances on various tasks. But there are still unsolved issues with these models:…
-
Recording available. Cloud Infrastructure From Python Code: How Far Could We Go?
Discover how Infrastructure From Code (IfC) can revolutionize Cloud DevOps automation by generating cloud deployment templates directly from Python code.…
-
Recording available. Code Cleanup: A Data Scientist's Guide to Sparkling Code
Does your production code look like it’s been copied from Untitled12.ipynb? Are your engineers complaining about the code but you can’t find the time to…
-
Recording available. Common issues with Time Series data and how to solve them
Time-series data is all around us: from logistics to digital marketing, from pricing to stock markets. It’s hard to imagine a modern business that has no…
-
Recording available. Create interactive Jupyter websites with JupyterLite
Jupyter notebooks are a popular tool for data science and scientific computing, allowing users to mix code, text, and multimedia in a single document.…
-
Recording available. Data-driven design for the Dask scheduler
Historically, changes in the scheduling algorithm of Dask have often been based on theory, single use cases, or even gut feeling. Coiled has now moved to…
-
Recording available. evosax: JAX-Based Evolution Strategies
Tired of having to handle asynchronous processes for neuroevolution? Do you want to leverage massive vectorization and high-throughput accelerators for…
-
Recording available. Getting started with JAX
Deepminds JAX ecosystem provides deep learning practitioners with an appealing alternative to TensorFlow and PyTorch. Among its strengths are great…
-
Grokking Anchors: Uncovering What a Machine-Learning Model Relies On
Assessing the robustness of models is an essential step in developing machine-learning systems. To determine if a model is sound, it often helps to know…
-
Honey, I broke the PyTorch model >.< - Debugging custom PyTorch models in a structured manner
When building PyTorch models for custom applications from scratch there's usually one problem: The model does not learn anything. In a complex project, it…
-
Recording available. How Chatbots work – We need to talk!
Chatbots are fun to use, ranging from simple chit-chat (“How are you today?”) to more sophisticated use cases like shopping assistants, or the diagnosis…
-
Recording available. How to increase diversity in open source communities
Today state of the art technology and scientific research strongly depend on open source libraries. The demographic of the contributors to these libraries…
-
Recording available. Improving Machine Learning from Human Feedback
Large generative models rely upon massive data sets that are collected automatically. For example, GPT-3 was trained with data from “Common Crawl” and…
-
Recording available. Incorporating GPT-3 into practical NLP workflows
In this talk, I'll show how large language models such as GPT-3 complement rather than replace existing machine learning workflows. Initial annotations…
-
Recording available. Introducing FastKafka
FastKafka is a Python library that makes it easy to connect to Apache Kafka queues and send and receive messages. In this talk, we will introduce the…
-
Recording available. Machine Learning Lifecycle for NLP Classification in E-Commerce
Running machine learning models in a production environment brings its own challenges. In this talk we would like to present our solution of a machine…
-
Recording available. Monorepos with Python
Working with python is fun. Managing python packaging, linters, tests, CI, etc. is not as fun. Every maintainer needs to worry about consistent styling,…
-
Recording available. Observability for Distributed Computing with Dask
Debugging is hard. Distributed debugging is hell. Dask is a popular library for parallel and distributed computing in Python. Dask is commonly used in…
-
Recording available. Pandas 2.0 and beyond
Pandas has reached a 2.0 milestone in 2023. But what does that mean? And what is coming after 2.0? This talk will give an overview of what happened in the…
-
Recording available. Postmodern Architecture: The Python Powered Modern Data Stack
The Modern Data Stack has brought a lot of new buzzwords into the data engineering lexicon: "data mesh", "data observability", "reverse ETL", "data…
-
Recording available. Pragmatic ways of using Rust in your data project
Writing efficient data pipelines in Python can be tricky. The standard recommendation is to use vectorized functions implemented in Numpy, Pandas, or the…
-
Recording available. Rusty Python: A Case Study
Python is a very expressive and powerful language, but it is not always the fastest option for performance-critical parts of an application. Rust, on the…
-
Recording available. Shrinking gigabyte sized scikit-learn models for deployment
We present an open source library to shrink pickled scikit-learn and lightgbm models. We will provide insights of how pickling ML models work and how to…
-
Specifying behavior with Protocols, Typeclasses or Traits. Who wears it better (Python, Scala 3, Rust)?
In this talk, we will explore the use of Python's `typing.Protocol`, Scala's Typeclasses, and Rust's Traits. They all offer a very powerful & elegant…
-
Recording available. Staying Alert: How to Implement Continuous Testing for Machine Learning Models
Proper monitoring of machine learning models in production is essential to avoid performance issues. Setting up monitoring can be easy for a single model,…
-
Recording available. The Battle of Giants: Causality vs NLP => From Theory to Practice
With an average of 3.2 new papers published on Arxiv every day in 2022, causal inference has exploded in popularity, attracting large amount of talent and…
-
Recording available. The future of the Jupyter Notebook interface
Jupyter Notebooks have been a widely popular tool for data science in recent years due to their ability to combine code, text, and visualizations in a…
-
Visualizing your computer vision data is not a luxury, it's a necessity: without it, your models are blind and so do you.
Are you ready to take your Computer Vision projects to the next level? Then don't miss this talk! Data visualization is a crucial ingredient for the…
-
Recording available. When A/B testing isn’t an option: an introduction to quasi-experimental methods
Identification of causal relationships through running experiments is not always possible. In this talk, an alternative approach towards it, quasi-…
-
Why GPU Clusters Don't Need to Go Brrr? Leverage Compound Sparsity to Achieve the Fastest Inference Performance on CPUs
Forget specialized hardware. Get GPU-class performance on your commodity CPUs with compound sparsity and sparsity-aware inference execution. This talk…
-
Recording available. 5 Things about fastAPI I wish we had known beforehand
An exchange of views on fastAPI in practice. FastAPI is great, it helps many developers create REST APIs based on the OpenAPI standard and run them…
-
Exploring the Power of Cyclic Boosting: A Pure-Python, Explainable, and Efficient ML Method
We have recently open-sourced a pure-Python implementation of Cyclic Boosting, a family of general-purpose, supervised machine learning algorithms. Its…
-
Data Kata: Ensemble programming with Pydantic #1
Write code as an ensemble to solve a data validation problem with Pydantic. Working together is not just about code - learn how to listen to colleagues,…
-
Data Kata: Ensemble programming with Pydantic #2
Write code as an ensemble to solve a data validation problem using Pydantic. Working together is not just about code - learn how to listen to colleagues,…
-
Let's contribute to pandas (3 hours) #2
PyData Berlin are excited to bring you this open source workshop dedicated to contributing to pandas. This tutorial is 3 hours. We will have a break and…
-
Keynote - A journey through 4 industries with Python: Python's versatile problem-solving toolkit Keynote
In this keynote, I will share the lessons learned from using Python in 4 industries. Apart from machine learning applications that I build in my day to…
-
Keynote - Lorem ipsum dolor sit amet Keynote
A life without joy is like software without meaningful test data - it's uncertain and unreliable. The search for the perfect test data is a challenge.…
-
Keynote - Towards Learned Database Systems Keynote
Database Management Systems (DBMSs) are the backbone for managing large volumes of data efficiently and thus play a central role in business and science…
-
Recording available. A concrete guide to time-series databases with Python
We evaluated time-series databases and complementary services to stream-process sensor data. In this talk, our evaluation will be presented. The final…
-
Recording available. Cooking up a ML Platform: Growing pains and lessons learned
What is a ML platform and do you even need one? When should you consider investing in your own ML platform? What challenges can you expect building and…
-
Recording available. Delivering AI at Scale
Everybody knows our yellow vans, trucks and planes around the world. But do you know how data drives our business and how we leverage algorithms and…
-
Have your cake and eat it too: Rapid model development and stable, high-performance deployments
At the boundary of model development and MLOps lies the balance between the speed of deploying new models and ensuring operational constraints. These…
-
Recording available. How Python enables future computer chips
At the semiconductor division of Carl Zeiss it's our mission to continuously make computer chips faster and more energy efficient. To do so, we go to the…
-
Recording available. How to build observability into a ML Platform
As machine learning becomes more prevalent across nearly every business and industry, making sure that these technologies are working and delivering…
-
Keynote - How Are We Managing? Data Teams Management IRL Keynote
The title “Data Scientist” has been in use for 15 years now. We have been attending PyData conferences for over 10 years as well. The hype around data…
-
Recording available. The Spark of Big Data: An Introduction to Apache Spark
Get ready to level up your big data processing skills! Join us for an introductory talk on Apache Spark, the distributed computing system used by tech…
-
Recording available. Use Spark from anywhere: A Spark client in Python powered by Spark Connect
Over the past decade, developers, researchers, and the community have successfully built tens of thousands of data applications using Spark. Since then,…
-
Recording available. Dynamic pricing at Flix
In the talk we give a brief overview of how we use Dynamic Pricing to tune the prices for rides based on demand, time of purchase, unexpected events…
-
Recording available. Large Scale Feature Engineering and Datascience with Python & Snowflake
[Snowflake](https://www.snowflake.com/en/) as a data platform is the core data repository of many large organizations. With the introduction of…
-
Recording available. PyLadies Panel Session. Tech Illusions and the Unbalanced Society: Finding Solutions for a Better Future
During this panel, we’ll discuss the significant role PyLadies chapters around the world have played in advocating for gender representation and…
-
Recording available. Contributing to an open-source content library for NLP
Bricks is an open-source content library for natural language processing, which provides the building blocks to quickly and easily enrich, transform or…
-
Recording available. PyLadies Workshop
A workshop for PyLadies members with the Berlin Tech Workers Council discussing the legal frameworks on contracts and termination agreements, as well as…
-
Enabling Machine Learning: How to Optimize Infrastructure, Tools and Teams for ML Workflows
In this talk, we will explore the role of a machine learning enabler engineer in facilitating the development and deployment of machine learning models.…
-
Prompt Engineering 101: Beginner intro to LangChain, the shovel of our ChatGPT gold rush."
A modern AI start-up is a front-end developer plus a prompt engineer" is a popular joke on Twitter. This talk is about LangChain, a Python open-source…
-
Recording available. Rethinking codes of conduct
Did you know that the Python Software Foundation Code of Conduct is turning 10 years old in 2023? It was voted in as they felt they were “unbalanced and…