Turbodbc: Turbocharged database access for data scientists
This talk introduces the open source Python database module [LINK:https://github.com/blue-yonder/turbodbc] turbodbc . It uses standard ODBC drivers to connect with virtually any database and is a viable (and often faster) alternative to "native" Python drivers. Briefly recounting the painful story of how data scientists previously used our analytics database, I explain why turbodbc was created and what distinguishes it from other ODBC modules. Sketching the flow of data from databases via drivers and Python modules to consumable Python objects, I motivate a few extensions to the [LINK:https://www.python.org/dev/peps/pep-0249/] standard database API 2.0 that turbodbc has made. These extensions heavily use NumPy arrays and Apache Arrow tables to provide data scientists with both familiar and efficient binary data structures they can further work on. I conclude my talk with benchmark results for a few databases.