This page provides an introduction to workflows, which are core to the Daasity platform and enable you to build an integrated extraction and transformation process
What are workflows?
Workflows orchestrate all of the data extractions and transformation that occur within Daasity.
Each individual workflow can kick off a set of data extractions and then, once the data has been loaded, run any transformation code tied to the workflow.
Workflows are a powerful tool because you can tie transformation code to an extractor so that your SQL transformations kick off as soon as new data is ready. You can also configure them to kick off at different intervals and can chain workflows so that a subsequent workflow will start as soon as the chained workflow has completed.
We set up a daily incremental workflow for you when you set up Daasity, but you can also set up custom workflows that can run as often as once per hour.
You can get to the Workflows screen by navigating to the Workflows section on the left-nav of the Daasity app:
The daily incremental workflow
When you set up Daasity, a daily incremental workflow will automatically be created and will start running every night at midnight (according to the timezone you specify in the Daasity App settings). Any new integration that you set up will be added to the daily incremental workflow automatically.
Example of a Daily Incremental workflow for an account with only one Shopify and one Google Analytics integration.
When the daily incremental workflow starts, it will first extract data from all integrations included in the workflow and then load the data into your data warehouse.