Data Pump uses a multiprocess architecture in which a master control process dispatches job items to one or more worker processes. These worker processes may use PX processes to move data.
Parallelism in this context refers to the total number of active worker processes and PX processes that are able to operate in parallel.
The default PARALLEL value is one. If Data Pump decides to use PX processes to load or unload a table, then the PX processes are counted against the degree of parallelism used by Data Pump, but the worker process that starts the PX processes is not since it is idle while the PX processes are executing the query. Also, if a worker process has been started but it is idle, it is not counted against the limit specified by the PARALLEL parameter.
Datapump Job, Master Control Process creates a pool of data pump worker processes.
The degree of parallelism can be increased or decreased during execution of export/ import job.
The decrease in parallelism reduces the number of parallel workers. It may take a while to reduce the workers jobs.
The increase in parallelism takes affects immediately;
Data Pump Import processes the database objects in the following order:
- The first worker begins to load all the metadata: the tablespaces, schemas, etc., until all the tables are created.
- Once the tables are created, the first worker starts loading data instead of metadata and the rest of the workers start loading data too.
- Once the table data is loaded, the first worker returns to loading metadata again. The rest of the workers are idle until the first worker loads all the metadata up to package bodies.
- Multiple workers load package bodies in parallel.
- One worker loads metadata up to and including secondary tables.
- Multiple workers load secondary table data.
- One worker loads the remaining metadata.
Bug 24423416 : IMPDP FOR SCHEMA_EXPORT/PACKAGE/PACKAGE_BODY TAKES HOURS
DataPump Import Is Extremely Slow When Importing Package Bodies (Doc ID 1452917.1)
If there are multiple partitions and subpartitions for a table, it takes high time to import the partition and subpartition segment information.
Here are things to perform speeding up the progress.
SQL> ALTER SYSTEM FLUSH SHARED_POOL;
SQL> ALTER SYSTEM SET STREAMS_POOL_SIZE=0;
SQL> ALTER SYSTEM SET STREAMS_POOL_SIZE=300M;
Use the parameter METRICS=Y to include additional logging information about the number of objects and the time it took to process them in the log file. With METRICS, additional information can be obtained about the number of objects that were processed and the time it took for processing them.
Tracing can be enabled by specifying an 7 digit hexadecimal mask in the TRACE parameter of expdp or impdp.TRACE does not add anything to the output of DataPump, it creates additional trace files in ADR_HOME location.
If there are multiple partitions and subpartitions for a table, it takes high time to import the partition and subpartition segment information.
Here are things to perform speeding up the progress.
SQL> ALTER SYSTEM FLUSH SHARED_POOL;
SQL> ALTER SYSTEM SET STREAMS_POOL_SIZE=0;
SQL> ALTER SYSTEM SET STREAMS_POOL_SIZE=300M;
Use the parameter METRICS=Y to include additional logging information about the number of objects and the time it took to process them in the log file. With METRICS, additional information can be obtained about the number of objects that were processed and the time it took for processing them.
Tracing can be enabled by specifying an 7 digit hexadecimal mask in the TRACE parameter of expdp or impdp.TRACE does not add anything to the output of DataPump, it creates additional trace files in ADR_HOME location.
10300 SHDW: To trace the Shadow process 20300 KUPV: To trace Fixed table 40300 'div' To trace Process services 80300 KUPM: To trace Master Control Process 100300 KUPF: To trace File Manager 200300 KUPC: To trace Queue services 400300 KUPW: To trace Worker process(es) 800300 KUPD: To trace Data Package 1000300 META: To trace Metadata Package 1FF0300 'all' To trace all components, full tracing |
eg:
expdp ..... EXCLUDE=statistics PARALLEL=16 TRACE=1FF0300