PyCon DE & PyData Berlin 2024
– · bcc Berlin Congress Center
The 2024 edition of PyCon DE & PyData Berlin took place 22–24 April 2024 at the bcc Berlin Congress Center. Every session is listed below, with the speakers on their own page. Revisit the original conference site.
-
Recording available. Content Recommendation with Graphs: From Basic Walks to Neural Networks
Discover how graph algorithms are transforming content recommendation in this insightful talk. We'll journey from the basics of graph-based models,…
-
Recording available. When and how to start coding with kids
Our world is driven by technology and there are many reasons to teach our kids how to code. For example, coding allows them to develop logical reasoning…
-
Recording available. Power structures. The fair advantage
Humans are complex. As developers, we wanna ignore that ... but to do our job right, we cannot. Let's talk about power, motivation, techno-sociology,…
-
Recording available. Enhance your balcony power plant with Python
Plug-in solar systems, so-called balcony power plants, are getting more popular. This talk will cover the basics of such a system, how to figure out the…
-
Recording available. Unleashing Confidence in SQL Development through Unit Testing
As the landscape of data-driven applications expands, the need for robust SQL development practices becomes increasingly critical. This conference talk…
-
Recording available. Streamlining Python Development: A Guide to a Modern Project Setup
Designed for beginners, this presentation demystifies Python project management using [Hatch](https://hatch.pypa.io/) and delves into `pyproject.toml` for…
-
Recording available. Leveraging the Art of Parallel Unit Testing in Django
Unit testing is a fundamental practice in software development, ensuring the reliability and maintainability of code. However, in the context of monolith…
-
Recording available. Replacing Callbacks with Generators: A Case Study in Computer-Assisted Live Music
*Callbacks* have become an ubiquitous programming technique that we use every day without even thinking about it. They are definitely handy in many…
-
Tailored and Trending: Key learnings from 3 years of news recommendations
Every day, we engage with news, and more often, these are curated by recommendation engines. Building such an algorithm poses some unique challenges,…
-
Recording available. A conceptual and practical introduction to Hilbert Space Gaussian Process (HSGP) approximation methods
In this talk, we explore a new method to approximate Gaussian processes using spectral analysis methods, known as the Hilbert Space Gaussian process…
-
525 days working full-time on FOSS: lessons learned
I've been working full-time on a Python FOSS project for 525 days, so what did I learn? Am I a better (Python) programmer? Am I a better teammate? Am I a…
-
Recording available. Breaking AI Boundaries: Fairness Metrics in Unstructured Data Domains
This presentation addresses the rare use of machine learning fairness metrics in domains with indirect human impact, e.g., automotive engineering. We…
-
Recording available. I achieved peak performance in python, here's how ...
In the ever-evolving landscape of software development, crafting code that not only functions flawlessly but also operates at peak performance is a skill…
-
Recording available. Missing Data, Bayesian Imputation and People Analytics with PyMC
We demonstrate a range of different approaches to missing data imputation in employee engagement survey data. Contrasting frequentist style full-…
-
Recording available. No More Raw SQL: SQLAlchemy, ORMs & asyncio
Managing a database and synchronizing service data representation with the database can be tricky. In this workshop, you’ll learn how to use SQLAlchemy, a…
-
Recording available. Python Monorepos: The Polylith Developer Experience
What if writing software could be more like building with LEGO bricks? A more playful and productive developer experience. For me, that is all about…
-
Recording available. The pragmatic Pythonic data engineer
Learn to make practical decisions in data engineering with Python's vast ecosystem. Avoid blindly following market guidelines and consider the reality of…
-
Recording available. There is a Better Way to Automate and Manage Your (Fluid) Simulations
This is a story about applying Python and the “hacker mindset” to Computer Aided Engineering (CAE), an emerging domain within the Python ecosystem. Shell…
-
Recording available. Build TikTok's Personalized Real-Time Recommendation System in Python with Hopsworks
The real-time recommendations engine in Tiktok, Monolith, is so good it has been described as "digital crack" (by Andrej Karpathy, former head of AI at…
-
Recording available. From idea to production in a day: Leveraging Azure ML and Streamlit to build and user test machine learning ideas quickly
Getting a machine learning solution in front of users usually takes some time. The data science tech stack is full of time traps and infrastructure issues…
-
Recording available. Functional Python
Python supports multiple programming paradigms. In addition to the procedural and object-oriented approach, it also provides some features that are…
-
Recording available. How to Do Monolingual, Multilingual, and Cross-lingual Text Classification in April, 2024
In 2023, the field of NLP was again flurried -- the appearing of powerful closed- and opens-source LLMs opened new possibility for texts processing.…
-
Recording available. Lessons learned from deploying Machine Learning in an old-fashioned heavy industry
About 5 years ago my co-founder and I launched alcemy, a Machine Learning startup to help decarbonize the cement and concrete supply chain. I experienced…
-
Recording available. Pandas + Dask DataFrame 2.0 - Comparison to Spark, DuckDB and Polars
Dask is a library for distributed computing with Python that integrates tightly with pandas. Historically, Dask was the easiest choice to use (it’s just…
-
Recording available. Python 3.12's new monitoring and debugging API
Python 3.12 introduced a new low-impact monitoring API with [PEP669](https://peps.python.org/pep-0669/), which can be used to implement far faster…
-
Recording available. Securing Python: Race Condition Vulnerabilities
This workshop addresses the critical and often underestimated topic of race conditions in Python, with a focus on their security implications. We begin…
-
Recording available. That’s it?! Dealing with unexpected data problems
Drawing on experience with multiple consulting projects, this talk shares experiences on how to deal with unexpected data problems. We are discussing how…
-
Recording available. Best of both worlds - How we built an AI-aided content creation tool for language learning
Discover how Babbel bridged the gap between tailored language learning and scalability through an AI-aided content creation tool. Our approach amalgamates…
-
Recording available. Better safe than sorry: Threat Modeling for Python Developers
Every developer wants to write good code. Good code, that also means security against attackers and their threats. But how secure is your code really? The…
-
Recording available. Bridging the worlds: pixi reimplements pip and conda in Rust
Pixi is a modern package manager that bridges the worlds of conda and pip package management. A from-scratch implementation of a SAT solver that works for…
-
Bulletproof Python - Property-Based Testing with Hypothesis
Do you find yourself working through pages of copied and pasted tests to accommodate a simple code change? Does your software frequently break in…
-
Recording available. Encoding Charactersets - may the force be with you
Understanding and repairing garbled text (Mojibake) is despite Unicode a permanent ongoing task in IT projects. Garbled text is the result of text being…
-
From LLM as oracle to LLM as translator - our journey from theory to everyday’s practice in a corporate setting with dmGPT (and python)
Last year, dm-drogeriemarkt was among the first big German companies launching a tool for the coworkers to be able to unlock the power of LLMs in a secure…
-
Recording available. Machine Learning on microcontrollers using MicroPython and emlearn
This presentation will show you how to deploy machine learning models to affordable microcontroller-based systems - using the Python that you already…
-
Recording available. Performant, scientific computation in Python and Rust
A tutorial session on how to build scientific packages for numerical calculus and algorithms in Python and Rust. It walks through the process of packaging…
-
Recording available. Personalizing Carousel Ranking on Wolt's Discovery Page: A Hierarchical Multi-Armed Bandit Approach
Wolt's Discovery page serves as the primary gateway for millions of weekly users exploring diverse cuisines and products. With over 130,000 merchants in…
-
Recording available. Select ML from Databases
This talk introduces a new workflow for building your machine learning models using the capabilities of modern databases that support machine learning use…
-
Recording available. The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
With the latest advancements in Natural Language Processing and Large Language Models (LLMs), and big companies like OpenAI dominating the space, many…
-
Recording available. The key to reliability - Testing in the field of ML-Ops
Testing is a de facto standard in modern software development. With increasing awareness that comes with ML-Ops, testing becomes more important for the…
-
Recording available. The Secret Life of Metaclasses
Metaclasses. What are they? Where do they live? How do they reproduce? Did you know that you can make your classes receive keyword arguments, just like…
-
Using ML to find out the "Why"? A Tutorial in Causal Machine Learning
Machine learning is mostly used for predicting outcome variables. But in many cases, we are interested in causal questions: Why do customers churn? What…
-
Recording available. A deep dive into the Arrow Columnar format with pyarrow and nanoarrow
Apache Arrow has become a de-facto standard for efficient in-memory columnar data representation. You might have heard about Arrow or using Arrow, but do…
-
Recording available. Acknowledging Women’s Contributions in the Python Community Through Podcast
The Python community has been making efforts in improving the diversity and representation among its members. There are examples of success stories such…
-
Recording available. Advanced Observability with OpenTelemetry and Python
As Python expands into serverless and cloud environments, popularizing distributed microservice architectures, we often face observability challenges that…
-
Recording available. Analyzing COVID-19 Protest Movements: A Multidimensional Approach Using Geo-Social Media Data
The COVID-19 pandemic and associated policy measures lead to world-wide protest movements that were singled out by the spread of misinformation and…
-
Recording available. Async Awaits: Mastering Asynchronous Python in FastAPI
In this talk, we delve into the transformative world of asynchronous programming in Python, tailored specifically for the FastAPI framework. This session…
-
Recording available. AsyncApp. My contribution to hype Pythons asyncio a bit more
Asyncio use is now everywhere in the Python world, ... .. or is it? Being there since version 3.4 my impression is, that it is still not the go to…
-
Recording available. Boost your app to Flash speed by mastering performance tricks
In this talk, we discuss computational operations and memory utilization in Python and what is the connection between them. Additionally, we will provide…
-
Recording available. Boost your Data Science skills with the new Python in Excel
Python in Excel is the new integration created by Microsoft that brings Python programming directly into Excel workbooks, for advanced data analytics.…
-
Recording available. Build an AI Document Inquiry Chat with Offline LLMs
As we descend from the peak of the hype cycle around Large Language Models (LLMs), chat-based document inquiry systems have emerged as a high-value…
-
Recording available. Data valuation for machine learning
Data valuation techniques compute the contribution of training points to the final performance of machine learning models. They are part of so-called…
-
Recording available. Django loves strawberries
Explore the dynamic duo of GraphQL Strawberry and Django in an immersive workshop! Discover the seamless integration of Strawberry with Django, mastering…
-
Recording available. High Performance Data Visualization for the Web
In this talk, we will put together a simple but full-featured website using [Perspective](https://perspective.finos.org). Perspective is an open source…
-
Recording available. How Python helped us uncover secrets of protein motion
This presentation will give an overview of the scientific project that focuses on understanding how proteins move and function. Along the way a very large…
-
Recording available. How to Improve the Python Development Experience for Millions of Ubuntu Users
Have you ever tried to install a different Python version on Ubuntu or tried to upgrade your current one? Lots of posts exist, many are outdated, and some…
-
Recording available. Improve LLM-based Applications with Fallback Mechanisms
While RAG addresses the common LLM pitfalls, challenges like handling out-of-domain queries still persist. Learn the significance of fallback mechanisms…
-
Recording available. Is GenAI All You Need to Classify Text? Some Learnings from the Trenches
In recent times, GenAI has sparked fervent excitement, sometimes touted as the panacea for all natural language processing (NLP) tasks. This presentation…
-
Recording available. Jupyter Notebooks for Print Media
In this talk, we will discuss leveraging Jupyter Notebooks to generate print media - books, magazine and newspaper articles, business reports, academic…
-
Recording available. Lose your fear of equations!
The skill of quickly judging what a formula does and how changing a parameter will affect the result is crucial when dealing with real-life data science -…
-
Recording available. Marketing Media Mix Models with Python & PyMC: a Case Study
In today's digital landscape, traditional analytics struggle with understanding marketing ROI, especially with evolving privacy norms. But Python and its…
-
Recording available. Moving from Offline to Online Machine Learning with River
The foundations of machine learning were built on offline batch processing techniques for model training and inference. As organisations become more…
-
Recording available. Next Stop: Insights! How Streamlit and Snowflake Power Up Data Stories
Data stories transform complex data insights into clear, actionable and context rich narratives to drive business value. The presentation of data stories…
-
Recording available. Polars and Time Series: what it can do, and how to overcome any limitation
Time series analysis is ubiquitous in applied data science because of the value it delivers. In order to do effective time series analysis, you need to…
-
Recording available. PyO3 101 - Writing Python modules in Rust
In this interactive workshop, we will cover the very basics of using PyO3. There will be hands-on exercises to go from how to set up the project…
-
Recording available. pytest tips and tricks for a better testsuite
pytest lets you write simple tests fast - but also scales to very complex scenarios: Beyond the basics of no-boilerplate test functions, this training…
-
Recording available. RAG for a medical company: the technical and product challenges
[RAG (Retrieval Augmented Generation)](https://www.pinecone.io/learn/retrieval-augmented-generation/) is the process of querying a (large) set of…
-
Recording available. Refactoring Large Programs
One of the most challenging tasks in software engineering is cleaning up a complex software with 10,000-100,000 lines of code. The problem gets worse, if…
-
Recording available. Reinforcement Learning: Bridging The Gap Between Research and Applications
Reinforcement learning (RL) has great potential for industrial applications, but few mature software frameworks exist to facilitate its use. This talk…
-
Recording available. Robust Configuration Management with Pydantic's Data Validation
As applications grow, so do the amount of configurable features. Managing consistent defaults, maintaining user and developer documentation, and ensuring…
-
Recording available. The evolution of Feature Stores
Feature Stores have become an important component of the machine learning lifecycle. They have been particularly pivotal in bridging the gap between data…
-
Recording available. Using LLMs to Create Knowledge Graphs From a Large Corpus of Parliamentary Debates
Large Language Models (LLMs) have proven to be incredibly powerful on a range of tasks. They do however, have certain limitations when the input context…
-
Recording available. Would you rely on ChatGPT to dial 911? A talk on balancing determinism and probabilism in production machine learning systems
In the last year there hasn’t been a day that passed without us hearing about a new generative AI innovation that will enhance some aspect of our lives.…
-
Recording available. µDjango, an asynchronous microservices technique.
A standard Django project involves working with multiple files and folders from the start. Let's see how the work with a Django project changes when we…
-
Recording available. 🌳 The taller the tree, the harder the fall. Determining tree height from space using Deep Learning and very high resolution satellite imagery 🛰️
A case study of how we use Deep Learning based photogrammetry to calculate the height of trees from very high resolution satellite imagery. We show the…
-
Everything you need to know about change-point detection
Change-point detection is a crucial processing step when dealing with long and non-stationary time series. It has been applied in many contexts, such as…
-
Recording available. Your Model _Probably_ Memorized the Training Data
I know you probably don't want to hear about it, but your deep learning model probably memorized some of its training data. In this talk, we'll review…
-
Recording available. Safeguarding Privacy and Mitigating Vulnerabilities: Navigating Security Challenges in Generative AI
Generative AI (GenAI) has significantly improved our daily lives, prompting a focus on its integration into products and our routines. However, the…
-
Recording available. Streamlining Python Development: A Practical Approach to CI/CD with GitHub Actions
Crafting code for minimal dependencies and maximum portability is an art. This talk focuses on how continuous integration and delivery ensure project…
-
Recording available. Mostly Harmless Fixed Effects Regression in Python with PyFixest
This session introduces PyFixest, an open source Python library inspired by the "fixest" R package. PyFixest implements fast routines for the estimation…
-
Recording available. Building Professional Voice AI with Vocode
Dive into the world of AI voice agents with Vocode, the leading framework for creating interactive, voice-based AI assistants. In this talk, we'll explore…
-
Recording available. Deploying your Python application to Android
Since many years Android has held the top position as the most used OS with about 38% of the OS user share in 2023. Currently 3 major languages – C++,…
-
Recording available. FlixBus CitySnap: How we use GenAI and not only to collect captivating images for cities and confirm their locations
Have you ever wondered how travel e-commerce companies gather photos of cities? While I can't speak for everyone, I will demonstrate the innovative…
-
Recording available. Mojo 🔥 - Is it Python's faster cousin or just hype?
On 2023-05-02, the tech sphere buzzed with the release of Mojo 🔥, a new programming language developed by Chris Lattner, renowned for his work on Clang,…
-
Recording available. The Struggles We Skipped: Data Engineering for the TikTok Generation
In a world increasingly embracing Python, plug-and-play solutions and AI-generated code, our generation growing up with these advancements may not fully…
-
Recording available. Unlock the Power of Dev Containers: Build a Consistent Python Development Environment in Seconds!
In this talk, we will explore the basic concepts of Dev Containers and demonstrate how they can support your everyday development as a Python programmer,…
-
Recording available. A Retrieval Augmented Generation system to query the scikit-learn documentation
The scikit-learn website currently employs an "exact" search engine based on the Sphinx Python package, but it has limitations: it cannot handle spelling…
-
Recording available. Beyond Deployment: Exploring Machine Learning Inference Architectures and Patterns
This talk is about setting up robust and scalable machine learning systems for high-throughput real-time predictions and large numbers of users. It is…
-
Recording available. DDataflow: An open-source end-to-end testing framework for ML pipelines
In the realm of machine learning, the complexity of data pipelines often hinders rapid experimentation and iteration. This talk will introduce…
-
Recording available. Green Software Engineering
Did this question ever cross your mind that how green software engineering can help in environment sustainability? My talk will answer this exact…
-
Recording available. Tackling the Cold Start Challenge in Demand Forecasting
In this talk, we address the Cold Start problem in Demand Forecasting, focusing on scenarios where historical data is scarce or nonexistent. This…
-
(Un)leashed potential of AI in Government
As the world is being reshaped at an unprecedented speed through the rise of powerful (Generative) AI technologies that change the way we work and live,…
-
Recording available. Building accessible documentation sites
Your project's documentation site is one of the first places where new users will interact with your project; as such, it is essential that these are up-…
-
Recording available. Can ChatGPT convince you to get a COVID19 vaccine? Comparing ChatGPT to an expert system - which one is more convincing?
This study explores the efficacy of chatbots as dialogical argumentation systems for behaviour change, focusing on vaccine hesitancy during the COVID-19…
-
Recording available. Exploring Zarr: From Fundamentals to Version 3.0 and Beyond
A key feature of the Python data ecosystem is the reliance on simple but efficient primitives that follow well-defined interfaces to make tools work…
-
Recording available. Going beyond Parquet's default settings – be surprised what you can get
Apache Parquet has become the de facto format for storing tabular (DataFrame) data on disk. This is done through universal compression and efficient…
-
Recording available. How to embrace your Leadership role as a Data Nerd (or other creative types)
The transition from a hands-on creative job to a leadership role isn't always smooth. The tasks you excelled at are now handled by your team, and your new…
-
Recording available. Public Money, Public Experiment - open source processes in the public administration
Imagine a data lab in a federal ministry wants to publish python applications - how long could it possibly take? While open code is widely acknowledged as…
-
Put your RAG to the test: Component-per-component evaluation of our LLM-powered airplane manufacturing assistant
Your RAG-powered LLM application might look pretty convincing at first glance, but how do you really know if it’s any good? And how do you justify the…
-
Recording available. PyCon Community Backstage: A Decade of Camaraderie, Growth, and Lessons Learned
For the past decade, my journey as a dedicated community organizer has allowed me to immerse myself deeply in the Python community, experiencing its…
-
Recording available. Which kind of software tests do I really need?
Explore a variety of software testing methodologies, from Manual and A/B Testing to Unit and Performance Tests. Learn how to make informed decisions for…
-
Recording available. Whispered Secrets: Building An Open-Source Tool To Live Transcribe & Summarize Conversations
Are you secretly a spy and/or passionate about open-source? Maybe you don't trust a cloud-hosted service with your highly classified information, or…
-
Recording available. You shall not pass! 🧙 Strengthen your python code against attacks.
Have you ever thought about IT Security when coding your Python application? If not, you are not alone – but also not safe. Just recently, a research…
-
Recording available. Time series anomaly detection with a human-in-the-loop
In the cross-industry wide trend towards industry 4.0 solutions, the amount of gathered sensor data is ever growing. Through the sheer amount of data,…
-
Recording available. Connecting batteries with Python: Towards EV Charging with #zero emissions at #zero costs
This talk dives into how Python helps us to bridge the gap between automotive and energy industries. Learn how Python helps in integrating EV batteries…
-
Recording available. Keynote - A View From My Window - An Outside Perspective of Open Source Scientific Computing From the Inside Keynote
Twelve years as the Executive Director of NumFOCUS has given me a unique perspective of the open source scientific ecosystem. Building an organization to…
-
Recording available. Keynote - Safe Space or Trap? Creating Software like DuckDB in Academic Institutions Keynote
DuckDB is an in-process analytical data management system. DuckDB is free and open source and rather popular. It is one of the fastest growing data system…
-
Recording available. Keynote - Ten Key Questions that a Company Should Ask to have Responsible AI Keynote
Responsible AI covers mainly AI principles, governance & regulation, but most companies do not know how to implement all of these. Hence, in this…
-
Recording available. Keynote - The art and science of tending open source orchards Keynote
Over the history of free and open source software, we have gone through quite a few metaphors for open source projects: from homesteads in noosphere to…
-
Recording available. Better search relevance using Learning to Rank at mobile.de
At mobile.de, we aim to provide a satisfactory search experience so users can find the vehicles quickly they are looking for. We make it happen using our…
-
Recording available. Bridging the Gap: From Analytical Models to Operational Success
Deploying machine learning models in production carries its own unique set of challenges. Some challenges stem from different, and sometimes conflicting,…
-
Recording available. Build a personalized Bitcoin (BTC) virtual assistant in Python with Hopsworks and LLM function calling
The human ambitious desire to get rich without effort has been a major driving force behind the popularity of cryptocurrencies like Bitcoin and Ethereum.…
-
Recording available. Climate Crisis in Numbers
Climate change is one of the biggest and most daunting challenges that our and future generations are going to face. In order to mitigate climate change…
-
Recording available. Prescriptive Analytics in the Python Ecosystem with Gurobi
Join us as we guide you through integrating Gurobi and prescriptive analytics into your greater Python ecosystem. We’ll demonstrate model-building…
-
Recording available. Haystack 2.0: the story of a rewrite
To rewrite or not to rewrite: it's a major question. Releasing new software versions with breaking changes can be disruptive to a community, but sometimes…
-
Recording available. (PyLadies Panel) Reflecting Within: Challenging Narratives in Tech Feminism
For the third year in a role, the PyLadies Panel at PyCon PyData engages with a broader audience on critical issues related to gender disparities, ethics,…
-
Recording available. Community Conferences under the Hood. Perspectives and Best Practices in Volunteer Organization
PyCon DE & PyData Berlin is volunteer run. This session aims to underscore the significant role that volunteer organization plays in cultivating…
-
Recording available. Cloud? No Thanks! I’m Gonna Run GenAI on My AI PC
In this speech, we want to introduce an AI PC, a single machine that consists of a CPU, GPU, and NPU (Neural Processing Unit) and can run GenAI in…
-
Recording available. Documenting R&D Progress using jupyter-book - and feel safe for the next performance audit
Rosenxt has only just been founded, and yet we are already very busy researching great things and making them usable. The ideas are bubbling, the…