Cloud Data Integration & Engineering

Data transfer tasks allow you to move data from a source, such as an on-premises database, to a target like a cloud data warehouse, with options to enhance data by integrating additional lookup sources. These tasks can also sort and filter data based on the source connection before loading it to the target, ensuring flexibility and adherence to specific data handling requirements.

Mapping tasks in data processing allow users to apply predefined data flow logic from an existing mapping or template to manipulate and manage data effectively. These tasks are configurable with both preset and user-defined parameters to enhance the flexibility and specificity of data handling during runtime.

SQL ELT (Extract, Load, Transform) involves transferring raw data directly into a target database or data warehouse, where the transformation is then performed using SQL queries. This method leverages the processing power of the target system, allowing for more efficient handling of large datasets and complex transformations.

Taskflow

A Taskflow allows control over the execution sequence of tasks, supporting parallel runs, advanced decision-making, and timing, enabling complex orchestrations.