• Success
    Manage your Success Plans and Engagements, gain key insights into your implementation journey, and collaborate with your CSMs
    Success
    Success Accelerators
    Accelerate your Purchase to Value engaging with Informatica Architects for Customer Success
    My Engagements
    All your Engagements at one place
  • Communities
    A collaborative platform to connect and grow with like-minded Informaticans across the globe
    Communities
    Product Communities
    Connect and collaborate with Informatica experts and champions
    Discussions
    Have a question? Start a Discussion and get immediate answers you are looking for
    User Groups
    Customer-organized groups that meet online and in-person. Join today to network, share ideas, and get tips on how to get the most out of Informatica
    Get Started
    Community Guidelines
  • Knowledge Center
    Troubleshooting documents, product guides, how to videos, best practices, and more
    Knowledge Center
    Knowledge Base
    One-stop self-service portal for solutions, FAQs, Whitepapers, How Tos, Videos, and more
    Support TV
    Video channel for step-by-step instructions to use our products, best practices, troubleshooting tips, and much more
    Documentation
    Information library of the latest product documents
    Velocity (Best Practices)
    Best practices and use cases from the Implementation team
  • Learn
    Rich resources to help you leverage full capabilities of our products
    Learn
    Trainings
    Role-based training programs for the best ROI
    Certifications
    Get certified on Informatica products. Free, Foundation, or Professional
    Product Learning Paths
    Free and unlimited modules based on your expertise level and journey
    Experience Lounge
    Self-guided, intuitive experience platform for outcome-focused product capabilities and use cases
  • Resources
    Library of content to help you leverage the best of Informatica products
    Resources
    Tech Tuesdays Webinars
    Most popular webinars on product architecture, best practices, and more
    Product Availability Matrix
    Product Availability Matrix statements of Informatica products
    SupportFlash
    Monthly support newsletter
    Support Documents
    Informatica Support Guide and Statements, Quick Start Guides, and Cloud Product Description Schedule
    Product Lifecycle
    End of Life statements of Informatica products
    Ideas
    Events
    Change Request Tracking
    Marketplace
| Sign up

Cloud Data Warehouse & Data Lake

Last Updated Date Mar 16, 2020 |
Stages Cloud Data Warehouse & Data Lake Role

The Data Engineering Developer is responsible for the design, build and deployment of a project's Data Engineering components. A typical Data Warehouse or Data Lake effort usually involves multiple Data Engineering Developers developing the Informatica mappings, executing them to move and/or transform data and validating the initial results. These tasks involve data ingestion into storage technologies such as Hadoop, NoSQL, Cloud Storage or other storage mediums. Data Integration and Data Quality mappings will often be built and performed in these storage technologies as data is consolidated and harmonized. Data extraction may also be required as data from the Data Warehouse or Data Lake is used to feed a number of reporting, regulatory and analytic purposes.

 

Reports to:

  • Technical Project Manager

 

Responsibilities:

  • Uses Informatica Data Engineering to extract data from external sources and ingest them into storage technologies such as Hadoop, No SQL, or Cloud Storage
  • Uses Informatica Data Engineering to perform data integration operations on data within the selected storage medium
  • Uses Informatica Data Engineering to perform data quality operations on data within the selected storage medium
  • Develops Data Integration workflows and load processes.
  • Ensures adherence to locally defined standards for all developed components.
  • Performs data analysis for both Source and Target tables/columns/files to determine data movement, integration and quality needs
  • Provides technical documentation of Source to Target mappings.
  • Participates in design and development reviews.
  • Works with System owners to resolve source data issues and refine transformation rules.
  • Ensures performance metrics are met and tracked.
  • Writes and maintains unit tests.
  • Conduct QA Reviews.

 

Qualifications/Certifications

  • Understands data integration processes and with a working knowledge of the chosen Data Lake or Data Warehouse storage technology
  • Has a basic understanding of relevant data integration skills such as primary and foreign key relationships, transactional vs domain data, data refresh patterns and data recovery processes
  • Possesses excellent communications skills
  • Has the ability to develop work plans and follow through on assignments with minimal guidance
  • Has Informatica Data Engineering Platform and Informatica data integration mapping experience or experience with a similar object-based data integration technology
  • Has the ability to work with business and system owners to obtain requirements and manage expectations

 

Recommended training

  • Corresponding Data Storage technology training based on your organizations chosen platform (examples: Hadoop, Kafka, NoSQL, Snowflake, Redshift, Databricks, etc.)
  • Informatica University: Big Data for Developers
  • Informatica University: Big Data Streaming for Developers
  • Informatica University: Informatica Developer Tool for Big Data Developers
  • Informatica University: Data Quality: Data Quality Management for Developers

 

For more details on Informatica courses go to Informatica University Curriculum.

 

Previous
Next

Table of Contents

Success

Link Copied to Clipboard