How do you optimize DataStage jobs?

To optimize an InfoSphere DataStage job, do the following steps:

1. Start the Designer client and attach to the project that contains the job.
2. Open the job that you want to optimize.
3. Set the options and properties that control optimization.
4. Optimize the job.
5. View the optimization log.
6. Save the optimized job as a new job.

Just so, how can I improve my DataStage performance?

The following are the points for DataStage best practices:

1. Select suitable configurations file (nodes depending on data volume)
2. Select buffer memory correctly and select proper partition.
3. Turn off Run time Column propagation wherever it's not required.
4. Taking care about sorting of the data.

Furthermore, how do I kill a DataStage job? If you want to kill the job go to director > cleanup resources> clear status file as said above. Sometimes even this won't work , in that case, simply stop and start the asb agent . It will kill the job forcefully.

Likewise, how do I compile a DataStage job?

Compiling Individual ETL Jobs

1. In DataStage Designer, navigate to the job you want to compile, open it, and click on the Compile button. Image: Compile Button.
2. If the job compiled with no errors, click Close. If the job compiled errors, click Re-Compile.
3. Repeat steps one and two for each job you wish to compile.

How do I reset multiple jobs in DataStage?

Procedure

1. Select the job or invocation you want to reset in the Job Status view.
2. Choose Job > Reset or click the Reset button on the toolbar. A message box appears.
3. Click Yes to reset the tables. All the files in the job are reinstated to the state they were in before the job was run.

Related Question Answers

Which are routines in the DataStage manager transformer stage?

DataStage Manager defines a collection of functions within a routine. There are basically three types of routines in DataStage, namely, job control routine, before/after subroutine, and transform function.

What is configuration file in DataStage?

The Datastage configuration file is a master management file (a text file which sits on the server side) for jobs which describes the parallel system resources and design. There is a default configuration file obtainable whenever the server is installed. The configuration files have extension “. apt”.

What is lookup Datastage?

The Lookup stage is a processing stage. It is used to perform lookup operations on a data set read into memory from any other Parallel job stage that can output data. Lookup stages do not require data on the input link or reference links to be sorted.

What is array size in Datastage?

The array size specifies the number of records to include in each batch that the read and write operations on the database process. The record count specifies the number of records to process in each transaction.

What is partitioning in Datastage?

Partitioning is the process of dividing an input data set into multiple segments, or partitions. Each processing node in your system then performs an operation on an individual partition of the data set rather than on the entire data set.

How do I compile multiple jobs in Datastage?

Procedure

1. From the DataStage Designer client, select Tools > Multiple Job Compile and specify the criteria for selecting items to compile. Choose one or more of the following:
2. Click Next.
3. Click Next.
4. Click Next.
5. Click Start Compile to start the compilation.
6. Click Finish.

How do I run a Datastage job in UNIX command line?

How to Run Datastage Job from Unix Command Line .?

1. This will change the location to the home directory.
2. This will run the dsenv file which contains all the environment variables.
3. After you have done this then you can use any Datastage command for interacting with the server.
4. Using the dsjob command you can start,stop,reset or run the job in validation mode.

How do I kill a DataStage job in Unix?

Log out of all IBM® InfoSphere® DataStage® clients. Try to end the process by using the Windows Task Manager or kill the process in UNIX. Stop and restart the InfoSphere DataStage Server Engine. Reset the job from the Director (see Resetting a Job).

How do you kill a process in Unix?

There's more than one way to kill a Unix process

1. Ctrl-C sends SIGINT (interrupt)
2. Ctrl-Z sends TSTP (terminal stop)
3. Ctrl- sends SIGQUIT (terminate and dump core)
4. Ctrl-T sends SIGINFO (show information), but this sequence is not supported on all Unix systems.

Which is process ID in Unix?

In Linux and Unix-like systems, each process is assigned a process ID, or PID. This is how the operating system identifies and keeps track of processes. This will simply query the process ID and return it. The first process spawned at boot, called init, is given the PID of “1”.

How do I find my Linux Job ID?

First log onto the node your job is running on. Using one of the test nodes is recommended. You can use the Linux commands ps -x to find the Linux process ID <PID> of your job. The last line of the output gives the total memory usage of the running process.

How do I get a list of all DataStage jobs?

In DataStage Manager, open the folder for which you would like the list of jobs. Click on any job in the list. Perform a Select All (ctrl-a). Right click on the highlighted jobs and select Usage Analysis.