SSIS Select Distinct From Excel Data Source

I had to modify an existing SSIS package and found that the author had an Excel data source with duplicate rows in it. The destination needed unique records. The author’s solution was to save the data to a staging table and then do a select distinct from there to the ultimate destination.  This is an unnecessary step.  The  Sort Transformation provides a setting that will eliminate duplicate rows.  See the Remove Duplicate Rows checkbox in lower left hand corner in the picture below.

 

image

 

As can be seen below, the Sort Transformation has removed duplicate rows fro the source Excel spreadsheet.

 

image

Advertisements
This entry was posted in SQL Server Integration Services and tagged , , , , . Bookmark the permalink.

One Response to SSIS Select Distinct From Excel Data Source

  1. Raman says:

    Really Help to get distinct records 🙂

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s