XML debatch in pipeline

Last month I had a post were described how to debatch XML message in orchestration

using XPath. http://biztalk.kirakosyan.com/2010/02/debatching-records-from-wcf-sql-using.html

How I wrote it is not the best solution , in case if you will have hundreds of records the debatching using XPath will consume too much memory and processor.

In this post I am going to show how to debatch using pipeline.

The sample will fetch multiple records from MS SQL database and after debatching put them to folder.

How to create simple WCF-SQL ports and SQL polling you can read in my old post

http://biztalk.kirakosyan.com/2010/02/how-to-pull-database-using-wcf-sql.html

I will use the same procedure and table to generate Schemas and PortTypes

In generated schema change envelop type to yes

Next click on TypePolling which is the root for schema
In properties find Body XPath
and edit it as in picture is

Then change the last node to have Max Occurs = 1

Now we should remove hidden stones :-)

When you added adapter metadata from wizard to your project
PortType was generated, DO NOT use it while creating logical receive port in orchestration.

DO NOT Use multipart message type while creating Message
your mesage now has simple structure

Thats all
now in output folder you should have many files where each will contain a single record from SQL