Builder ELT is an open-source application designed for visual creation, chaining, and scheduling of data loading workflows. The tool leverages native SQL within the target database for transformations, while Python handles non-standard sources and API integrations. A key feature of the software is that it does not store user data.
The project originated from a need to standardize ELT processes, which were previously fragmented and inconsistent across different projects. By implementing a standardized approach, the developer aimed to reduce development time and minimize errors. The tool allows analysts familiar with SQL to manage data loading independently, reducing reliance on specialized ELT engineers.
The technical architecture evolved from a collection of Python functions into a full-featured application. It includes a graphical user interface and a database for metadata management. To support workflow queuing, the system incorporates Celery and Redis, while Keycloak is utilized for authentication purposes.
