Introduction

BizTalk Server provides a few out of the box pipeline components. For instance the S/MIME components for encrypting or decrypting messages. In case you need to do some pre- or post processing on a message and the functionality is not offered through the provided pipeline components you will need to built your own custom pipeline component. However there are quite a few available customized pipeline components available you can reuse and save you the time of building it yourself. This article provides you as developer all the resource available regarding custom pipeline components for BizTalk Server.

Resources

MSDN : Standard Pipeline Components out-of-the-box
Pipeline Component Wizard - This is a wizard to help you develop BizTalk pipeline components. It is particularly useful if you are new to pipeline components.
Winterdom Pipeline Testing library
Screencast: Building Pipeline Components with Forward Only Streaming
Custom Pipeline Components Best Practices
Understanding Design-Time Properties for Custom Pipeline Components
Context properties available from Recieve vs Send ports

Custom Pipeline Components

This list is intended to be a knowledge base of all Custom Pipeline Components that are available:

Tags	Name	Description
Archiving (£)	Atomic Scope - BizTalk Message Archiving Component	Archive messages to a file as they pass through a receive or send pipelines.
Archiving	Archiving to Windows Azure	Pipeline component for storing copies of BizTalk messages in the cloud in Azure blob storage.
Archiving	SQL Message Archiving Pipeline Component	Archive messages to a SQL database using Forward-Only Streaming
Archiving	BizTalk stream based archiving pipeline component	This example shows how to use a stream to archive received messages in a way that avoids reading the entire message into memory.
Archiving	BizTalk Archiving - SQL and File	BizTalk Message Archiving - it's a pipeline component that can be used for archiving incoming/outgoing message from any adapters. It provides an option to save the message to either file (local, shared, network) or in SQL Server.
Archiving	BizTalk Messaging Archive Custom Solution	This solution will provide two basic pipelines for archiving messages and their context to file. You can configure the pipelines to determine the file location where the messages coming into and going out BizTalk can be saved.
Archiving	SAB BizTalk Archiving Pipeline Component	The SAB BizTalk Archiving Pipeline Component can be added to any stage of receive and send ports to archive processed messages to file locations.
Context	Context Adder	Used at any pipeline stage (in either a receive or a send pipeline) to add context properties.
Context	BizTalk Context Adder Pipeline Component	Context Property Adder pipeline component, which utilize XML configuration.
Context	BizTalk Context Adder Pipeline Component (BRE)	BizTalk Context Property Adder pipeline component, which utilize BizTalk Rule Engine configuration.
Routing	OutboundTransportLocation	From SDK Examples. This pipeline component sets the OutboundLocation property of a message based on the file name.
Validation	Extended Xml Validation	Return all validation failures, not just the first. Also works with flat file schemas.
Validation	Schematron XmlValidator Pipeline Component	Schematron enables us to define constraints over XML documents that XSD on its own is not able to. Some examples of this constraints are: - Validate that two or more elements/attributes have related values (e.g. Sex and Title match - 'Female' and 'Miss' is valid, but 'Female' and 'Mr' is not) - Validate one node based on the presence of another - etc As constraints are expressed using XPath statements, one can add any constraint that can be expressed by using one or more XPath statements. This greatly increases the number and type of validation rules one can use.
Validation	XML Complete Validator	Implements a simple BizTalk Server Pipeline Component which can be used to validate complete message instances as they travel through a receive or send pipeline. Contrary to the out of the box xml validator component, this component returns all validation errors in one pass.
Encoding	CharacterTranscoder Pipeline Component	Transcode a stream from a configurable source encoding to a configurable target encoding.
Encoding	Encoding Transcoder	Convert incoming message from one encoding to another.
Encoding	Fix Encoding Pipeline Component	Custom pipeline component you can use to explicitly tell assemblers and disassemblers what encoding to use.
Encoding	Symmetric Crypto Pipeline Components for BizTalk 2006	Decoder/encoder components that use symmetric encryption for BizTalk 2006 pipelines.
Encryption	PGP Encryption Pipeline Component	PGP Encryption/Decryption using Bouncy Castle.
Encryption	PGP Encryption Pipeline Component	PGP Encyrption/Decryption using GNU Privacy Guard (BizTalk 2009 Pro Book)
Encryption	PGP Encryption Pipeline Component	PGP Encyrption/Decryption using GNU Privacy Guard
Encryption	GNUPGEncoder	PGP Encyrption using GNU Privacy Guard
Encryption	Symmetric Encryption Pipeline Component
	Custom recoverable interchange processing pipeline components	A typical scenario is a pipeline that consists of a XmlDisassembler and this custom RIP pipeline component. The interchange is received in the pipeline and disassembled into separate body messages by the XmlDisassembler. After that, for each body stream some processing is performed by the custom pipeline component. If this processing fails the single body instance needs to be suspended instead of the whole interchange.
	Delivery Notifications	In a Send port, cause BizTalk to generate ACK and NACK messages when the adapter reports a message as successfully delivered. No orchestrations required.
Web Services	CreateBodyPart Pipeline Component	Used to handle a null response from a web service. See details here.
Batch	Flat File Batch Disassembler	Split large messages into chunks of small messages based on configurable record count.
Batch	XML Batch Disassembler	Breaks messages as per a configurable batch size.
Zip	Multipart Message Attachments Zipper	Used in a send pipeline to replace all attachments of a multi-part message for its zipped equivalent.
Zip	Multi-Part Message Attachments Zipper Pipeline Component for BizTalk 2006/2009	Used in a send pipeline to replace all attachments of a multi-part message for its zipped equivalent.
Zip	BizTalk Pipeline Custom Component Message Unzippper	This Custom Pipeline Component for BizTalk Server 2010, receives a compressed message, unzips it and sends one message per each file that the compressed file as in it.
Zip	Unzip Files in a Custom Pipeline Component	In this article, I describe how to develop a custom pipeline component to unzip files in the disassemble stage in a BizTalk receive pipeline. This component has one property which allows the user to type a password to be used when unzipping the files. All files in the received archive are unzipped.
Zip	Zip Files in a Custom Pipeline Component	In this article, I describe how to develop a custom pipeline component to zip messages in the encode stage in a BizTalk send pipeline. This component has two properties which allow the user to type a password to the zip file and an extension to the entry in the zipped file.
Zip	Zipping files in a custom pipeline	This article will give you an idea of how to write a custom send pipeline component to compress a Zip file and encrypt it with a password.
Zip	UnzipDisassembler - A custom pipeline component for BizTalk Server 2004	A custom pipeline component in BizTalk Server 2004. Our component will receive a ZIP file, uncompress it, and send its contents to BizTalk Server.
	eliasen.eu.BizTalk. PipelneComponents - DevNull	This pipeline component will "swallow" everything that comes as input. This enables performance testing of stuff without concerns about adapter transport time at send port for instance.
Context	eliasen.eu.BizTalk. PipelneComponents - Promote	This component has four parameters, the name of a property, the namespace of the property, a constant and an XPath expression. The component will either use the constant or read in the value that corresponds to the XPath expression at runtime and promote it to the property given by the name and name space. This enables you to promote one element of a series of reoccurring elements.
Routing	eliasen.eu.BizTalk. PipelneComponents - SuspendAfterMap	In BizTalk 2009 (which is the only supported BizTalk version for this pipeline component) there has been added support for recoverable interchanges for errors occurring during mapping on receive ports after disassembling. This is achieved by setting a specific promoted property to “true”. I have created a pipeline component that will do this for you.
Debugging	eliasen.eu.BizTalk. PipelneComponents - WriteProperties	This pipeline component serves almost NO purpose at all, except I used it for debugging to see what properties existed on a message going through BizTalk. It will write out all context of a message to the event log, one event at a time.
Message Fix	eliasen.eu.BizTalk. PipelneComponents - SearchAndReplace	This component will perform a search and replace on the incoming stream, replacing some string with some other string. Optionally, you can decide to let the input string be a regular expression and replace based on that instead of normal string search and replace.
Message Fix	String Replacer	Some uses for it include: Replace a Trading Partner ID before BizTalk receives the file in the Message Box; Replace HEX Characters in a flat file; and Insert carriage returns in an EDI file as the Segment Terminator.
Message Fix	Search and Replace Pipeline Component
Message Fix	Remove Xml Namespace Pipeline Component	Turn <ns0:Blah xmlns:ns0="http://RemoveXmlNamespace.BTS.BlahMessage"> into <Blah>
Message Fix	BizTalk Custom Pipeline Component Sample - Find & Replace String	It is a very common requirement to use a custom pipeline in a BizTalk solution to replace a string in a message. However such a simple pipeline component is neither provided by Biztalk Server or the ESB tool kit. The sample code BizTalk Custom Pipeline Component Sample - Find & Replace String is to provide a pipeline component with basic find and replace function, and it can be further modified to handle complicated senario such as multiple string replacement.
Message Fix	BizTalk pipeline component: the Symbol Preprocessor	This BizTalk pipeline component works as a symbol preprocessor. I use it for preprocessing the EDI documents and Flat Files. It can be used for the Xml namespace replacement and for mediate any inconsistency in the data formats. It can change the control symbols. It can use the RegExes.
Message Fix	Custom Receive Pipeline Decoder	Sometimes, we came across situations where doesn't exist an out-of-the-box solution, so we must make a custom one. In this sample we will see a Custom Receive Pipeline Decoder, that handles special characters of a message, receive as parameter a Regular Expression and the value in order to replace the character
Message Fix	BizTalk 2006 Create Body Part Pipeline Component	A BizTalk 2006 receive pipeline component which interrogates a message to determine whether it has a message body. If a message body is not present, this component create a new body based on the component properties.
Message Fix	Change Namespace of a Message in a Custom Pipeline Component	In this article, I describe in detail how to develop a custom pipeline component to change the namespace of a message on BizTalk 2006 R2. In BizTalk 2009, there are existing components to add and remove namespaces
Message Fix	Biztalk Custom Pipeline Component: To Change RootNode and NameSpace	This sample pipeline component is used to change the RootNode and NameSpace of the incoming message.
	XChain	Brings the power of XSLT 2.0 and extensible tasks into the BizTalk environment.
Context, BAM	Dynamic BAM Pipeline Component	Allows for tracking context, message and custom method execution within a pipeline component.
	BizTalk 2006 R2 EDI Reporting Pipeline Components
Excel	BizTalk Excel Pipeline Component
Excel, PDF (£)	FarPoint Spread for BizTalk	Spread includes a pipeline disassembler that parses Excel data (XLS, Excel 2007 XML, CSV, TXT) into XML, and a pipeline assembler that creates Excel (XLS, Excel 2007 XML) and PDF documents from XML data in BizTalk Applications.
Excel	BizExcel	Excel components for BizTalk
Excel, Data	ODBC Pipeline Component	Custom Pipeline Component for Processing DBF, Excel and other ODBC types.
Excel	Excel 2007 BizTalk Pipeline	The purpose of this custom pipeline is to decode the xlsx files and convert it to xml. This component also adds a namespace and debatches the xml files into individual records.
Excel	Excel Reading Custom Pipeline for BizTalk Server	This document aims to discuss how to read an Excel file from a pipeline in BizTalk. A custom pipeline need to be developed to read Excel files. Excel file will be read by taking the file adaptor and the pipeline will process it.
Excel	BizTalk Custom Pipeline Component Sample - Export to Excel 2007/2010 Format	This sample is to provide a custom pipeline component to export a BizTalk message to an Excel file at office 2007/2010 format. The pipeline component reads FilePath property from custom pipeline and use the child node name of root node as the sheet name, the grand child node name as the column name, and the elements of the grand child as the actual list in the spread sheet.
	Multiple Flat File Schemas Disassembler
ESB, Message Fix	ESB Add Namespace	These can add and remove namespaces in the content of messages. This allows applications to repair conflicting namespaces or add missing namespaces to prevent namespace collisions within the Message Box database and application orchestrations. They also allow BizTalk to consume POX (Plain Old XML) without modifying external publishing systems.
ESB, Message Fix	ESB Remove Namespace	Remove namespaces from XML documents.
ESB, Routing	ESB Dispatcher	Use within inbound pipeline to dynamically set endpoint location properties for outbound messages.
ESB, Routing	ESB Dispatcher Disassemble	Use in inbound pipeline to dynamically set endpoint location properties for outbound messages. This component behaves in a very similar way to the ESB Dispatcher component, except that it transforms the result message (if you specify a value for the Transform property). The message passes through the XML Disassembler, which promotes properties and message types. The ESB Dispatcher Disassemble component also supports batched dispatch of multiple messages to different endpoints. For more information, see The ESB DispatcherDisassemble Component.
ESB, Routing	ESB Intinerary	Within a receive pipeline, promote ESB metadata properties from SOAP headers into the message context.
ESB	ESB Itinerary Cache	Cache itineraries and reapply them to response messages received within Solicit-Response send ports.
ESB, Encoding	ESB Exception Encoder	Send fault messages to the file system, InfoPath, or SharePoint. This component is part of the ESB exception handling mechanism, and it normalizes and enriches all exceptions processed by a send port. The component serializes exception information (including embedded persisted messages and context properties) into a canonical format so that all contained messages and the exception itself are available
ESB, BAM	ESB BAM Tracker	Intercept the fault message emitted from the ESB Exception Encoder and insert the data within the message into the BAM Primary Import table (using the BAM Event Stream in the pipeline). This component is part of the ESB exception handling mechanism.
Zip, Encryption, Encoding (£)	/n Software	Zip - PKZip/Winzip compatible Zip compression/decompression. Gzip - UNIX compatible (LZW/LZC) Gzip compression. ACH - Electronic Check (ACH) message processing. OpenPGP - Sign, Verify, Encrypt, and Decrypt though OpenPGP. AES - 128-bit, 192-bit, and 256-bit AES Encryption/Decryption. Tar - Tar archive Pipeline. Compatible with the UNIX tar and untar utilities. BZip2 - BZip2 compliant compression/decompression. ZCompress - LZC (UNIX Compress) compressor and decompressor.
PDF (£)	PDF Generator	The Codit PDF Generator allows customers to generate PDF documents in BizTalk, just by mapping XML to the XSL-FO standard. The PDF Generator will then generate these PDF documents in the pipeline and deliver it to the corresponding adapter. There is no need for customer printer drivers, acrobat installation, etc. Everything happens in process.
PDF	PDF to XML BizTalk pipeline	This is a component that transforms pdf content to xml that biztalk understands. I use itextsharp to extract the pdf content. First step transforms the pdf content to html. Step two uses an external xslt to transform the html to XML.
DB Lookup	Codit Transco component	This component allows developers to easily replace values in XML documents, by configuring (instead of developing!) lookup in the Transco Editor that comes with the Transco pipeline component. This component supports table lookups, stored procedures and custom SQL. The caching can easily be configured per pipeline.
Property Promotion	Codit Matrix component	The Codit Matrix pipeline component allows developers to promote complex lookups to the context of incoming messages. This is perfect for routing and prevents customers from developing custom pipeline components to do promotion in all of their projects. Results of database lookups, combination of XPath values, results of functions can be promoted. The resulting context can then also be validated against configurable rules.
Dedupe, Loopback, Validation, Zip (£)	BizTalk Implementation Framework	The Codit Implementation framework for BizTalk contains a set of pipeline components that can be used in BizTalk integration projects. This framework contains the different components that have been listed above (PDF Generator, Transco, Matrix) and more. DoubleChecker prevents duplicate messages of being sent, Loopback components allow to persist the context of messages when sending messages over an adapter, the XSD validator allows to mark invalid messages for routing, Sequence Controller allows orchestrations to be executed based on a sequence number in a message (preventing the usage of a SingleTon!)
Encryption, Encoding, PDF, Zip, MIME (£)	BizCrypto	PGP - encryption, digital signing, decryption and signature verification of the data using OpenPGP keys. PDF - encrypt, decrypt, compress, timestamp, sign and verify PDF documents using PKCS#7 algorithm and X.509 certificates. XML - security features, such as XML-compliant password-based, certificate-based and PGP-based encryption and certificate-based and PGP-based signing of your XML documents or any generic data. MIME and S/MIME - assemble, sign and encrypt or decrypt and verify e-mail messages. PKI - encrypt, decrypt, sign and verify any data using PKCS#7 algorithm and X.509 certificates. Zip -
Transformation	Streaming XslTransform pipeline component - suitable for very large files	The BizTalk Sever SDK comes with an interesting Pipeline component sample that allows executing Xsl mapping files in a pipeline. This functionality can be of interest when the receive port or send port mappings are not executed at the desired time! Receive port mappings are executed after the pipeline execution, send port mappings are executed before the pipeline execution. Thanks to this pipeline component you get control over the exact time when the map gets executed.
Transformation	Mapper Pipeline Component	This gave me an idea of developing the tranform concept in a pipeline component, wherein you don't have to actually create a map for transforming the message.
HL7	BizTalk HL7 Toolkit	BizTalk Advanced HL7 Pipelines - allows for easier development and monitoring of HL7 interfaces. The toolkit contains updated additional HL7 pipeline components, Audit Trail Pipeline Components, a MLLP monitoring web user control, and an Exception monitoring service. Developed in C#.
HL7	BizTalk HL7 DASM Property Fixer	The fixer is just a pipeline component. Use it in your own custom pipeline with the HL7 DASM.
Swift	Swift Accelerator	SWIFT Assembler (for Message Repair and New Submission or FIN Response Reconciliation (FRR)) SWIFT Disassembler (for Message Repair and New Submission or FRR) SWIFT Frr Correlation Set Resolver (for FRR) SWIFT Frr MQSeries Decoder (for FRR) SWIFT Frr MQSeries Send Component (for FRR)
BRE	BizTalk Business Rules Engine Pipeline Framework	Reduce the amount of time required to introduce new logic into a BizTalk pipeline. Instead concentrate on capturing logic in reusable class libraries. Reduce the complexities surrounding the deployment of pipeline components. Since logic is held in business rules and class libraries which the pipeline component doesn't have any direct references to, the pipeline component will not need to be redeployed unless there are changes to the pipeline component itself (plumbing rather than logic). Promote the reuse of logic used within BizTalk pipelines rather than writing new pipeline components every time a slight variation of logic is required. Provide a simple design time experience (BRE) which encourages developers to use pipelines appropriately and makes it easier for analysts to understand the purpose of a pipeline. Provide an extensible framework that allows for developers to implement their relevant requirements if not catered for out of the box in the desired manner.
File	Create Destination Folder	.
	Flat-file clone
Routing	Creating Multiple Messages in a BizTalk Server disassemble pipeline component.	.
ExcelEncoder	Convert Xml to Excel	This Component converts XML format message to Excel