SSIS Dataflow Engine

SSIS Dataflow Engine

Overview

The Dataflow engine is the software component in SSIS that powers the Dataflow Task. It moves data from one place to another in memory-resident data structures called buffers (sometimes called pipeline buffers). A buffer is effectively a subset of all the data that is being processed by the Dataflow engine.

The use of buffers allows the Dataflow engine to process more data than can fit into the memory space of the computer at any one time.  If the amount of memory available to the Dataflow engine at a point-in-time exceeds the amount required to process all the data then buffers will be spooled to disk.


Synonyms

You may see the Dataflow engine referred to as "the pipeline engine" or more simply "the pipeline". The Dataflow engine is the underlying engine that powers the Dataflow Task and the two can be considered synonymous with one another.

Leave a Comment
  • Please add 7 and 7 and type the answer here:
  • Post
Wiki - Revision Comment List(Revision Comment)
Sort by: Published Date | Most Recent | Most Useful
Comments
  • Carsten Siemens edited Revision 7. Comment: Added tag: en-US

  • Zoltán Horváth edited Revision 5. Comment: corrected minor typo

  • Ed Price MSFT edited Revision 4. Comment: Title caps issue.

Page 1 of 1 (3 items)
Wikis - Comment List
Sort by: Published Date | Most Recent | Most Useful
Posting comments is temporarily disabled until 10:00am PST on Saturday, December 14th. Thank you for your patience.
Comments
  • Ed Price MSFT edited Revision 4. Comment: Title caps issue.

  • Zoltán Horváth edited Revision 5. Comment: corrected minor typo

  • Carsten Siemens edited Revision 7. Comment: Added tag: en-US

Page 1 of 1 (3 items)