Friday, August 7, 2015

Balanced Data Distributor – BDD - Is this a Multithreading Concept...

Balanced Data Distributor – BDD

It’s a new SSIS transform. It transform takes a single input and distributes the incoming rows to one or more outputs uniformly via multithreading. The transform takes one pipeline buffer worth of rows at a time and moves it to the next output in a round robin fashion. It’s balanced and synchronous so if one of the downstream transforms or destinations is slower than the others, the rest of the pipeline will stall so this transform works best if all of the outputs have identical transforms and destinations. The intention of BDD is to improve performance via multi-threading.

Several characteristics of the scenarios BDD applies to:
1) Destinations would be uniform, or at least be of the same type. 
2) Input is faster than the output, for example, reading from flat file to OleDB.

Download the Balanced Data Distributor for SSIS 2008 R2 from Microsoft site given below 
http://www.microsoft.com/en-in/download/details.aspx?id=4123


















Install the MSI downloaded from the site


Open Business Intelligence Development Studio & Drag & Drop Data Flow task in Control Flow






Add the Balance Data Distributor from transform Section as shown below


Select Balanced Data Distribution Data Link Library

BDD got added in Data flow transformation section


Configure the BDD by connecting with Source and Destination, All the Destination table are same table

BDD is configured successfully. Now it time to execute it.

Balanced Data Distributor splitted data and ran exactly as expected

Hope this blog would be useful 

Happy Coding :-)


Regards,
Daniel J.S BE CSE, MBA Entrepreneur,
Data Warehouse and Data Mining Architect,
+91 8939574948...

No comments: