Informatica Data Engineering Integration (Big Data Management) delivers high-throughput data ingestion and data integration processing so business analysts can get the data they need quickly. Hundreds of prebuilt, high-performance connectors, data integration transformations, and parsers enable virtually any type of data to be quickly ingested and processed on big data infrastructure, such as Apache Hadoop, NoSQL, and MPP appliances. Beyond prebuilt components and automation, Informatica provides dynamic mappings, dynamic schema support, and parameterization for programmatic and templatized automation of data integration processes.
The Advanced Level will help you develop expertise in DEI. It constitutes of many videos, documents, and articles that will take you through performance tuning, monitoring, and troubleshooting in Sqoop, Blaze, Spark, DIS and more.
After completing this level, you will earn an Informatica Badge for Data Engineering Integration (Big Data Management). So continue with your product learning and earn your badge!
In this module, you learned about Sqoop performance tuning, SPARK performance tuning, Data Integration Service Tuning, and Model Repository Service Tuning. You also got a better understanding of monitoring Blaze engine, tab settings, configuring the Monitoring Settings to enable MRS to store Historical Data, using complex datatypes on Spark - Arrays, complex datatypes on Spark - Struct, ML-Based Parsing and Intelligent Structure Discovery, complex datatypes on Spark - Nested port and Machine Learning with Python transformation in DEI.
You have also learned about REST operations hub in DEI and dealing with executing REST queries to gather monitoring statistics, Spark history server, stateful computing in Spark, deployment automation, Creating/Deploying an application, Mass Ingestion into Amazon S3 using Data Engineering Integration and Troubleshooting, consisting of Analyst service, search service, DIS on Grid, Monitoring tool, Spark, and Blaze.
You have successfully completed all three levels of DEI onboarding and have earned your badge!