- Learning Path
- Cloud Data Integration: Beginner
Informatica's Cloud Data Integration (CDI) supports high-performance, scalable analytics with advanced transformations; enterprise-grade asset management; and sophisticated data integration capabilities such as mass ingestion, advanced pushdown optimization, and advanced workload orchestrations. Improve and simplify your data integration processes with comprehensive and easy-to-use capabilities and designers.
The Beginner level constitutes videos, webinars, and other documents on introduction to CDI, its architecture, secure agent requirements and installation, log files, tasks, connections, and much more.
After you successfully complete all three levels of Informatica's CDI product learning, you will earn an Informatica Badge for Cloud Data Integration. So start your product learning right away!
This module covered IICS Architecture and terminologies, status page, secure agent requirements, agent installation and ports needed, Secure Agent logs and architecture, log files, Task monitoring, Data Synchronisation Task and options, Data Replication Tasks and options and connections.
You also explored the Cloud Mapping Designer Overview, Source and Target mapping example, Pre Post SQL, Administration, and user roles.
As a beginner, you have also learned about Advanced Connectors for Salesforce, Oracle, and MySQL.
Now move on to the next Intermediate level for your CDI product learning and learn more about the product.
Contents
In this video, you will learn about Informatica Cloud Architecture and Secure Agent. You will also be able to design an Agent architecture for your business and install the agent on your machine.
Status.Informatica.com displays the production status of all the Informatica Cloud products. All maintenance updates will be posted to this status page and will have the most current information.
To ensure you are notified of updates and outages, you can subscribe to a single component, a single incident, or the site as a whole. Subscribing to the site as a whole is the best way to be certain you never miss an update.
To subscribe, go to http://status.informatica.com and click Subscribe to Updates. You can then choose to receive notifications sent as emails, SMS text messages, webhooks, RSS feeds or any combination of the four.
Secure Agent Requirements
A Secure Agent is a lightweight program that runs all tasks that you configure in Informatica Intelligent Cloud Services and processes your company's data locally and securely. A Secure Agent must be running to run tasks. The following link will guide you through the prerequisites before you install a Secure Agent on your machine, such as the operating system that will support the Secure Agent, access to all remote directories and more.
Agent Installation and Ports Needed
Using the following links, understand how to download and install a Secure Agent, configure the proxy settings, configure login, and also uninstall the Secure Agent in Linux and Windows.
Secure Agent Logs and Architecture
While using Informatica Cloud Secure Agent, different types of log files can be found, such as session log, error log, success log, infaagent log, and tomcat log.
Click here to learn how to find the log files while using Informatica Cloud Secure Agent.
Advanced Serverless: Overview
Advanced Serverless enables customers to leverage serverless computing to process data integration pipelines. Users can run either their data integration or their Spark-based data integration jobs in serverless mode. This eliminates the need to manage hardware or software and simplifies DevOps and DataOps, allowing developers to focus on business logic and deploy new data pipelines quickly. We have launched Informatica Cloud Data Integration and Cloud Data Integration Elastic in Advanced Serverless deployment environments.
Key Benefits:
- No servers or software’s to manage
- Deploy new data pipelines quickly
- Consumption-based pricing
- Optimize cloud resources and costs with auto-scaling and auto-tuning
- Ability to Switch your existing CDI/CDI-E Mappings to execute on Advanced Serverless Runtime Environment
- Easy Setup in 2 mins
Get Started
- Start your advanced serverless journey with the documentation on serverless runtime environments. Learn about this advanced serverless deployment solution that doesn't require downloading, installing, configuring, and maintaining a Secure Agent or Secure Agent group.
- Watch this video that shows how to set up a Serverless Runtime Environment with the AWS CloudFormation template.
- Check out these doc links to discover how to create serverless runtime environments using AWS CloudFormation:
Serverless External Webinar
Watch this on-demand webinar to learn about Advanced Serverless Deployment with Informatica Cloud Data Integration.
Serverless Blog
Read this blog to understand how Advanced Serverless enables customers to focus on business logic rather than worry about scalability or server provisioning and maintenance. The blog delves into the key characteristics of serverless services, critical capabilities, and business benefits of advanced serverless.
83% of organizations aren't content with their data warehouse performance. Adopt the most comprehensive cloud data management solution with industry-leading best-of-breed cloud-native capabilities for cloud data warehousing and data lakes.
In an increasingly complex, multi-cloud world with data scattered across multiple environments, Informatica allows you to have self-service access to both reliable data and real-time analytics across any cloud, anywhere, and at any scale.
Log Files
Refer to the following links to learn more about the various log files:
HOW TO: Find the log files while using Informatica Cloud Secure Agent
FAQ: What is the use of asset logs in IICS? How to access it?
FAQ: What is the use of Security logs in IICS
FAQ: What are the search results of Asset logs in IICS?
Task Monitoring
IICS Task Monitoring explains how you can view and monitor jobs, imports, and exports that are running or have run in your organization.
Use the synchronization task to synchronize data between a source and a target. For example, you can read sales leads from your sales database and write them into Salesforce. You can also use expressions to transform the data according to your business logic or use data filters to filter data before writing it to targets.
You can use the database, flat file and salesforce source and target types in synchronization tasks.
The replication task and options can be used to replicate data to a target. You can replicate data to back it up or perform offline reporting. You can replicate data in Salesforce objects or database tables to databases or flat files.
You can also configure a task to replicate all rows of a source object each time the task runs or to only replicate the rows that changed since the last time the task was run. You can use a replication task to create as well as reset target tables.
Learn how to configure connections between Informatica Intelligent Cloud Services and Cloud and on-premise applications, platforms, databases, and flat files. It also lists the connection properties for all connectors that can be used with Informatica Intelligent Cloud Services.
It will guide you through Add on connectors, how to install them, connection configuration, connection properties and swagger file generation for REST V2 connectors.
Organizations need a better, faster, more reliable way to integrate and deliver timely data and analytics to their business. Learn about Informatica CDI-E’s advanced serverless computing and CLAIRE-powered auto-scaling and auto-tuning features that empower your organization to be productive, efficient, and hypercompetitive.
Turning enterprise data into a competitive advantage requires business users to quickly locate, understand, and utilize data to convert it into useful business intelligence. Informatica’s Integrated Cataloging gains end-to-end visibility, finds any data with a simple search, and uses data you can trust.
In this demo, you will learn how to use Cloud Data Integration Elastic to process data integration jobs in a fully managed Spark serverless environment.
A Cloud Mapping Designer is an easy-to-use, web-based interface for building mappings. Check out the links to explore more on the mapping designer, mapping templates, mappings tests, mapping maintenance, mapping revisions, and mappings tasks.
Cloud Mapping Designer Overview continued.
Check this video to identify business use cases for the cloud mapping designer, use the Cloud Mapping Designer to build a mapping, understand the transformations available to you and validate and test a mapping.
Know more about Pre and Post SQL commands by going through this video and know what are the benefits and business use cases where these attributes can be used.
A user is an individual Informatica Intelligent Cloud Services account that allows secure access to an organization. A user can perform tasks and access assets based on the roles that are assigned to the user.
You can assign roles directly to the user or to a group that the user is a member of. Refer to the following link to know more about user authentication, configure user details, creating user, assigning and un-assigning services, disabling, resetting and deleting a user or user groups.
User Roles
A role is a collection of privileges that you can assign to users and groups. To ensure that every user can access assets and perform tasks in your organization, assign at least one role to each user or user group. A role defines the privileges for different types of assets and service features. Learn more about the role details page, roles that can be assigned to the user or user groups and custom roles that you create based on the needs of your organization.
User Groups
A user group is a group of users in which all members can perform the same tasks and have the same access rights for different types of assets. Members of a group can perform tasks and access assets based on the roles that you assign to the group. Know more on how to get user group details, how to create a new user group, rename and delete them if need be.
Organization Hierarchy license enables you to create one or more sub-organizations within your organization. Create sub-organizations to represent different business environments within your company. Learn more on how to add, remove disable or enable a sub-organization.
The section will also guide you on how to switch to a different organization, deny parent organization access to a sub-organization, the add on connectors in sub-organization and how to export and import assets in sub-organizations.
You can create schedules to run tasks or taskflows at specified times or at regular intervals. You can also define a blackout period during which scheduled tasks or jobs do not run. Learn more on how to configure a blackout period, repeat frequency, time zones and schedules, and much more as you go through this link.
The Data Integration Salesforce Connector Guide contains information about how to set up and use Salesforce Connector. The guide explains how business users can use the Salesforce Connector to read data from and write data to Salesforce.
SQL Server
The Microsoft SQL Server Connector Guide contains information about how to set up and use Microsoft SQL Server Connector.
The guide explains how business users can use Microsoft SQL Server Connector to read data from and write data to Microsoft SQL Server databases.
Click here to learn how to do mapping, replication and synchronization tasks with Microsoft SQL Server Connector.
Oracle
The Oracle Connector Guide contains information about how to set up and use Oracle Connector. The guide explains how you can use Oracle Connector to read data from and write data to Oracle databases. Learn how to do mapping, replication and synchronization tasks with Oracle connector.
MySQL
The MySQL Connector Guide contains information about how to set up and use MySQL Connector. The guide explains how business users can use MySQL Connector to read data from and write data to MySQL databases. Learn how to do synchronization, mapping and replication tasks using MySQL connectors.
A Data Sheet provides highlights of the key features and benefits of Informatica products.
Click here to learn more about IICS API Management.
Click here to learn more about IICS Application Management.
Click here to learn more about Informatica Cloud B2B Gateway.
Click here to learn how to Accelerate Your Digital Transformation With a Modern Cloud Data Integration Solution
Here is a demo of data and application integration using intelligent APIs with Informatica’s iPaaS. It showcases an API administrator using IICS’s API Manager.
Watch this video to get a product overview of Informatica Cloud Integration Hub and the key benefits for organizations as a fully managed service in Informatica Intelligent Cloud Services (IICS).
Run data integration jobs in a serverless infrastructure using Integration At Scale, a new feature in the Summer 2019 release of Data Integration.
Go through the video to learn about the following:
- Creating an organization for each environment.
- Master the sub-org hierarchy as needed.
Go through the video to learn about the following:
- Create appropriate user groups and users and roles.
- Assign appropriate roles to the users as per the business requirements.
Go through the video to learn about the following:
- Configure Two-Factor Authentication for security
- Create and maintain password generation rules that meet organizational requirements and standards
Go through the video to learn about the following:
- Create and manage connections to databases and external applications
- Manage security and privileges
Go through the video to learn about the following:
- Create and manage schedules; Schedule black-out periods
- Install bundles; delete bundle; monitors bundle usage in the organization
Go through the video to learn about the following:
- Create and manage schedules; Schedule black-out periods.
- Install bundles; delete bundle; monitors bundle usage in the organization
This video discusses how to monitor jobs in CDI.
This video discusses how to create mappings in Informatica Cloud Mapping Designer.
Go through the video to learn how to create a mapping task and to create a task flow to run multiple tasks together.
Learn how to use Mapping Designer to configure a source to target mappings, add expression transformations, and sort transformations for cleansing.
This video explains how to accelerate your cloud analytics initiative by rapidly ingesting databases, files, and streaming data into a Cloud Data Warehouse or Data Lake with Informatica’s Cloud Mass Ingestion.
Because both your data source and target are in the same datastore, moving data out of Cloud Data Warehouse (CDW) for processing and then bringing it back in post-processing is inefficient and costly. This video explains how, by using Advanced Pushdown Optimization (APDO), you can process data directly in your CDW.
This video helps you discover your cloud analytics journey with an accurate picture of your data by demonstrating the steps involved in cleansing data for cloud analytics with Informatica Cloud Data Quality.
This video explains how to bring agility, productivity, speed, and efficiency to your business with Informatica cloud-native solutions that provide Continuous Integration/Continuous Delivery capabilities and help your organizations navigate the Agile-DevOps transformation journey.
Discover how to use Informatica Cloud-Native Data Management Solution with built-in intelligence and automation capabilities to enable organizations to see an even faster return on investment from the cloud data warehouse and data lake investment.
65% of organizations take a month or more to act on new insights, hand-coding their data pipelines with complex tools. Learn how an intelligent data management tool automates data pipelines and increases productivity, thereby lowering your total cost of ownership (TCO) and risk.
Without strong data management, over 80% of AI and ML projects fail to make it to production, much less deliver their potential value. Learn how to leverage Informatica's end-to-end MLOps (Machine Learning Operations) capabilities to succeed with your AI and ML initiatives.
Watch this video to learn how the Data Quality and Data Profiling services can be used to support your Data Integration and Data Migration requirements.
Power your Cloud Data Warehouse/Data Lake with IICS
Cloud Data Profiling - Using Rules and Dictionaries to Parse, Standardize, and Validate Data
