SAP Network Blog: Comparing Performance of Mapping Programs

Introduction

Comparing the runtime performance and stability of 6 kinds of mapping programms is a frequently discussed theme around Netweaver / XI.

Message Mapping
Java Mapping (DOM)
Java Mapping (SAX)
XSL Styleheet in Java stack
ABAP Mapping (DOM)
XSLT running in ABAP stack

have been tested to compare capability and robustness.

Test Scenario

You will find here a short description of the test environment. For more details have a look to the appendix.

Hardware

The Web Application Server is running WIN 2000 OS with 2 GIG RAM using 2 CPUs with ~1 GHz.
System Information

Scenario

The message flow is quite simple.
The XI file adapter is reading a text file, tranfering it as XML to the Integration Engine. The corresponding mapping program will be executed and the result is routed to R/3 system via RFC adapter.
Component View

Mapping Task

The example was choosed as basic as possible. The file adapter converts 10 columns to fields f01 - f10. They are disposed in repeatable field Set . The mapping result must be understoodable by the RFC adapter, so it has to be valid for the XML schema, what was generated during import of RFC into IB Repository. Each 'Set' is now an 'item'. f01 will be mapped to FIELD1 .
Mapping Task

Test Cases

Performance: Sending of 80 messages (each 0,57 MB) in modus EOIO. Taking first start time and last end time. The performance was tested 3 times for each mapping program. The determined runtime is an average value.
Stability: Increasing the volume of single messages til appearing of runtime errors. Ambition was to find out volume of biggest success mesaage and smallest error message.

Results

Perfomance Test

Mapping Program	Average Runtime in sec for 80 Msg (0,57 MB)	Speed (MB/h)
Message Mapping	209	786
Java (DOM)	210	782
Java (SAX)	208	789
XSL/Java	201	817
ABAP (DOM)	281	584
XSL/ABAP	184	892

Stability Test

Mapping Program	Highest Volume (MB) Success Messages	Lowest Volume (MB) Error Messages
Message Mapping	50,2	57
Java (DOM)	42,8	50,2
Java (SAX)	79,8	95,8
XSL/Java	57	71,3
ABAP (DOM)	6,8	8,3
XSL/ABAP	6,8	8,3

Discussion

It should be clear that these results are not representative regarding absolute performance or stability as the results are strongly dependend from hardware parameters. The environment wasnt optimized for the tasks especially not for mappings running in the ABAP stack (ABAP Profile / transaction RZ10). The processing time was taken in SXMB_MONI for the whole processing at Integration Server and not only for the mapping. Probably the mapping took the biggest part of processing time. The tests should allow following assumptions:

XLS has the best performance, what was not expectable!
Please have a look to SAP XI Library / Designing Mappings / Overview / Comparing Mapping Program Types
Mappings running in the Java stack are much more stabil than mappings at ABAP stack

Appendix

R/3 Profil of WAS

Description of Error Messages

Message Mapping:

SXMB_MONI / Status: Recorded for Outbound Processing
SMQ2: SYSFAIL / TIME_OUT
ST22: TIME_OUT
The program "????????????????????????????????????????" has exceeded the maximum permitted runtime without interruption, and has therefore been terminated.- Short Dump because ABAP Profile Parameter rdisp/max_wprun_time: 600 sec

Java (DOM)

SXMB_MONI / Status: Automatic Restart
SMQ2: execute LUW again
Java stack crashes and has to be restarted (SMICM)

Java (SAX)

SXMB_MONI / Status System Error
SMQ2: SYSFAIL / HTTP_RESP_STATUS_CODE_NOT_OK
Java stack crashes and has to be restarted (SMICM)

XSL/Java

SXMB_MONI / Status System Error
SMQ2: SYSFAIL / HTTP_RESP_STATUS_CODE_NOT_OK
Java stack crashes and has to be restarted (SMICM)

ABAP and XSL/ABAP

SXMB_MONI / Status: Recorded for Outbound Processing
SMQ2: SYSFAIL / Unable to fulfil request for 7339212 bytes of memory space.
ST22: SYSTEM_NO_ROLL

Grafic Message Mapping

Source Code ABAP

METHOD if_mapping~execute.

DATA: ixml_obj TYPE REF TO if_ixml.
  ixml_obj = cl_ixml=>create( ).

DATA: stream_obj TYPE REF TO if_ixml_stream_factory.
  stream_obj = ixml_obj->create_stream_factory( ).

DATA: in_stream TYPE REF TO if_ixml_istream.
  in_stream = stream_obj->create_istream_xstring( source ).

DATA: in_dok TYPE REF TO if_ixml_document.
  in_dok = ixml_obj->create_document( ).

DATA: in_parser TYPE REF TO if_ixml_parser.
  in_parser = ixml_obj->create_parser( stream_factory = stream_obj
                                              istream = in_stream
                                             document = in_dok ).
  in_parser->parse( ).

DATA: out_dok TYPE REF TO if_ixml_document.
  out_dok = ixml_obj->create_document( ).

DATA: root_elm TYPE REF TO if_ixml_element.
  root_elm = out_dok->create_simple_element_ns( name = 'Z_SAVE_XI_DATA'
                                              prefix = 'ns1'
                                              parent = out_dok ).

DATA: ns_decl TYPE REF TO if_ixml_namespace_decl.
  ns_decl = out_dok->create_namespace_decl(
                       name = 'ns1'
                     prefix = 'xmlns'
                        uri = 'urn:sap-com:document:sap:rfc:functions' )
.
  root_elm->set_attribute_node_ns( new_attr = ns_decl ).

DATA: table_elm TYPE REF TO if_ixml_element.
  table_elm = out_dok->create_simple_element( name = 'TABLE'
                                            parent = root_elm ).

DATA: in_sets TYPE REF TO if_ixml_node_collection.
  in_sets = in_dok->get_elements_by_tag_name( 'Set' ).

DATA:
    is_iterator TYPE REF TO if_ixml_node_iterator,
    set      TYPE REF TO if_ixml_node,
    item_elm TYPE REF TO if_ixml_element,
    is_length   TYPE i,
    in_fs  TYPE REF TO if_ixml_node_list,
    field_elm TYPE REF TO if_ixml_element,
    f_name TYPE string,
    field_name TYPE string,
    fs_length TYPE i,
    fs_iterator TYPE REF TO if_ixml_node_iterator,
    f TYPE REF TO if_ixml_node,
    f_value type string.

is_length = in_sets->get_length( ).
  is_iterator = in_sets->create_iterator( ).

DO is_length TIMES.

set = is_iterator->get_next( ).

item_elm = out_dok->create_simple_element( name = 'item'
                                             parent = table_elm ).

in_fs = set->get_children( ).
    fs_length = in_fs->get_length( ).
    fs_iterator = in_fs->create_iterator( ).

DO fs_length TIMES.
      f = fs_iterator->get_next( ).
      f_name = f->get_name( ).

CONCATENATE
        'FIELD'
        f_name+2(1)
      INTO
      field_name.

if field_name = 'FIELD0'.
      field_name = 'FIELD10'.
      endif.

f_value = f->get_value( ).

field_elm = out_dok->create_simple_element( name = field_name
                                                parent = item_elm
                                                 value = f_value ).

ENDDO.
  ENDDO.

DATA: out_stream TYPE REF TO if_ixml_ostream.
  out_stream = stream_obj->create_ostream_xstring( result ).

DATA: renderer TYPE REF TO if_ixml_renderer.
  renderer = ixml_obj->create_renderer( ostream = out_stream
                                     document = out_dok ).
  renderer->render( ).
ENDMETHOD.

Source Code XSL

<?xml version="1.0" encoding="UTF-8"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
	<xsl:template match="/">
		<ns1:Z_SAVE_XI_DATA xmlns:ns1="urn:sap-com:document:sap:rfc:functions">
			<TABLE>
				<xsl:for-each select="//Set">
					<item>
						<FIELD1>
							<xsl:value-of select="f01"/>
						</FIELD1>
						<FIELD2>
							<xsl:value-of select="f02"/>
						</FIELD2>
						<FIELD3>
							<xsl:value-of select="f03"/>
						</FIELD3>
						<FIELD4>
							<xsl:value-of select="f04"/>
						</FIELD4>
						<FIELD5>
							<xsl:value-of select="f05"/>
						</FIELD5>
						<FIELD6>
							<xsl:value-of select="f06"/>
						</FIELD6>
						<FIELD7>
							<xsl:value-of select="f07"/>
						</FIELD7>
						<FIELD8>
							<xsl:value-of select="f08"/>
						</FIELD8>
						<FIELD9>
							<xsl:value-of select="f09"/>
						</FIELD9>
						<FIELD10>
							<xsl:value-of select="f10"/>
						</FIELD10>
					</item>
				</xsl:for-each>
			</TABLE>
		</ns1:Z_SAVE_XI_DATA>
	</xsl:template>
</xsl:stylesheet>

Source Code Java DOM

package jMapPackage;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.io.IOException;
import java.io.InputStream;
import java.io.OutputStream;
import java.util.Map;

import javax.xml.parsers.DocumentBuilder;
import javax.xml.parsers.DocumentBuilderFactory;
import javax.xml.parsers.ParserConfigurationException;
import javax.xml.transform.Transformer;
import javax.xml.transform.TransformerFactory;
import javax.xml.transform.dom.DOMSource;
import javax.xml.transform.stream.StreamResult;

import org.w3c.dom.Document;
import org.w3c.dom.Element;
import org.w3c.dom.Node;
import org.w3c.dom.NodeList;
import org.w3c.dom.Text;
import org.xml.sax.SAXException;

import com.sap.aii.mapping.api.StreamTransformation;
import com.sap.aii.mapping.api.StreamTransformationException;

public class JMap implements StreamTransformation{

public static void main(String[] args) throws Exception
	{
		try
		{
			FileInputStream fin =
				new FileInputStream("C:/Dokumente und Einstellungen/UMartens/Desktop/source.xml");
			FileOutputStream fout =
				new FileOutputStream("C:/Dokumente und Einstellungen/UMartens/Desktop/target.xml");
			JMap mapping = new JMap();
			mapping.execute(fin, fout);

}
		catch (Exception e)		{
			e.printStackTrace();
		}
	}

public void setParameter (Map param) {}

public void execute (InputStream in, OutputStream out)
	throws com.sap.aii.mapping.api.StreamTransformationException {

DocumentBuilderFactory factory = DocumentBuilderFactory.newInstance();
		Document documentIn = null;
		DocumentBuilder builder = null;
		try {
				builder = factory.newDocumentBuilder();
			} catch (ParserConfigurationException e1) {
				e1.printStackTrace();
			}
		try {
			Element itemNode = null;
			NodeList[] list_f=new NodeList[10];
			Element[] field=new Element[10];
			documentIn = builder.parse(in);

Document documentOut = builder.newDocument();
			Element rootNode = documentOut.createElementNS("urn:sap-com:document:sap:rfc:functions","ns1:Z_SAVE_XI_DATA");
			documentOut.appendChild(rootNode);
			Element tableNode = documentOut.createElement("TABLE");
			rootNode.appendChild(tableNode);

NodeList list_Set=documentIn.getElementsByTagName("Set");
			for(int j=1;j<10;j++){
				list_f[j-1]=documentIn.getElementsByTagName("f0"+j);
			}
            list_f[9]=documentIn.getElementsByTagName("f10");
			NodeList list_f01=documentIn.getElementsByTagName("f01");
			for (int i=0;i<list_Set.getLength();i++){
				itemNode=documentOut.createElement("item");
				tableNode.appendChild(itemNode);

for(int k=0; k<10;k++){
					Node f=list_f[k].item(i);
					f=f.getFirstChild();
					String str_f=f.getNodeValue();

Text text_f=documentOut.createTextNode(str_f);
					field[k]=documentOut.createElement("FIELD"+(k+1));
					field[k].appendChild(text_f);
					itemNode.appendChild(field[k]);
				}
			}
			TransformerFactory tf = TransformerFactory.newInstance();
			Transformer transform = tf.newTransformer();
			transform.transform(new DOMSource(documentOut), new StreamResult(out));
			} catch (SAXException e2) {
				e2.printStackTrace();
			} catch (IOException e2) {
				e2.printStackTrace();
			}catch (Throwable t) { throw new StreamTransformationException("error", t); }
	}
}

Source Code Java SAX

package jMapPackage;

import java.io.FileInputStream;
import java.io.FileOutputStream;

import com.sap.aii.mapping.api.StreamTransformation;
import java.io.*;
import java.util.Map; import javax.xml.parsers.*;
import org.xml.sax.*; import org.xml.sax.helpers.*;

public class JMapSax extends DefaultHandler implements StreamTransformation{
	private Map map;
	private OutputStream out;
	public static void main(String[] args) throws Exception{
		try{
			FileInputStream fin =
				new FileInputStream("C:/Dokumente und Einstellungen/UMartens/Desktop/source.xml");
			FileOutputStream fout =
				new FileOutputStream("C:/Dokumente und Einstellungen/UMartens/Desktop/target.xml");
			JMapSax mapping = new JMapSax();
			mapping.execute(fin,fout);
		}
		catch (Exception e){
			e.printStackTrace();
		}
	}
	public void setParameter (Map param){
		map = param;
	}
	public void execute (InputStream in, OutputStream out)
	throws com.sap.aii.mapping.api.StreamTransformationException {
		DefaultHandler handler = this;
		SAXParserFactory factory = SAXParserFactory.newInstance();
		try {
			SAXParser saxParser = factory.newSAXParser();
			this.out = out; saxParser.parse(in, handler);
		}
		catch (Throwable t){
			t.printStackTrace();
		}
	}
	private void write (String s) throws SAXException{
		try{
			out.write(s.getBytes()); out.flush();
		}
		catch (IOException e){
			throw new SAXException("I/O error", e);
		}
	}
	public void startDocument () throws SAXException{
		write("<?xml version=\"1.0\" encoding=\"UTF-8\"?>");
		write("<ns1:Z_SAVE_XI_DATA xmlns:ns1=\"urn:sap-com:document:sap:rfc:functions\"><TABLE>");
	}
	public void endDocument () throws SAXException {
		write("</TABLE></ns1:Z_SAVE_XI_DATA>");
		try { out.flush();
		}
		catch (IOException e) {
			throw new SAXException("I/O error", e);
		}
	}
	public void startElement (String namespaceURI, String sName, String qName, Attributes attrs)
	throws SAXException {
		String eName = sName;
		if ("".equals(eName))
			eName = qName;
		if(eName.equals("Set"))
			write("<item>");
		if(eName.substring(0,2).equals("f0"))
			write("<FIELD"+eName.substring(2,3)+">");
		if(eName.equals("f10"))
			write("<FIELD10>");
	}
	public void endElement (String namespaceURI, String sName, String qName) throws SAXException {
		String eName = sName;
		if ("".equals(eName))
			eName = qName;
		if(eName.equals("Set"))
			write("</item>");
		if(eName.substring(0,2).equals("f0"))
			write("</FIELD"+eName.substring(2,3)+">");
		if(eName.equals("f10"))
			write("</FIELD10>");
    }
	public void characters (char buf[], int offset, int len)
	throws SAXException {
		String s = new String(buf, offset, len);
		write (s);
	}
}

Showing messages 1 through 13 of 13.

Titles Only	Main Topics	Oldest First

Comparing Performance of Mapping Programs Udo Martens Business Card Posted on Aug. 23, 2006 05:22 AM in SAP Process Integration (PI), SAP NetWeaver Platform