CommCare Data Pipeline continuously exports CommCare data into your own databases and BI platforms.
It is a self-hosted, standalone web application designed to manage a CommCare data warehouse over the command-line CommCare Data Export Tool.
This turnkey solution allows you to export data from CommCare and store it in a local or cloud-based database, including MySQL, PostgreSQL, Microsoft SQL Server, Amazon RDS, GCP Cloud SQL, and Azure SQL Database.
With CommCare Data Pipeline, you can utilise these key features:
-
Automated Configuration: Import a Data Export Tool (DET) configuration directly from CommCare.
-
Seamless Integration: Connect CommCare Data Pipeline to your CommCare project space(s) and database(s).
-
Scheduled Data Exports: Automate data transfers from CommCare to your database on a defined schedule.
-
Data Forwarding: Forward data automatically from your database to a RESTful JSON API on a scheduled basis.
-
Export Monitoring: Track and manage data export activities through CommCare Data Pipeline’s built-in log feature.
See the documentation for details on installing a development environment and setting up a test data pipeline.
See the commcare-sync-ansible documentation for details on installing and managing a production environment.