This video explains how to collect Thread Dump on Spark driver and executor from SparkUI in CDI/CDI-E.

Reference
https://knowledge.informatica.com/s/article/Spark-UI-for-monitoring-and-troubleshooting-Spark-execution-in-Cloud-Data-Integration-Elastic-CDI-E-mappings?language=en_US

Expertise: Beginner, Intermediate, Expert
User type: Administrator, Developer, Architect
Category: Configuration, Performance, Administration
Project Phase: Implement, Configure
Problem Type: Performance, Crash/Hang, Connectivity