Welcome to Agile BI Community Sign in | Join | Help

Browse by Tags

All Tags » SSIS » Examples   (RSS)

Continuing a Loop After an Error

A common question on the SSIS forums is how to continue a loop after an error occurs. For example, you might have a For Each Loop container that iterates through a set of files in a folder. If one file is invalid, you want to continue processing the remaining Read More...
Posted Sunday, June 29, 2008 1:32 AM by jwelch | 0 Comments
Filed under: ,

Calculating a Running Total Part 2

To finish up the topic that I started in my previous post , I wanted to post a more complex example of running total calculations. This is based off a request on the MSDN forums, for a running total calculation that would “slide” along as additional rows Read More...
Posted Thursday, June 12, 2008 1:18 AM by jwelch | 0 Comments
Filed under: , ,

Calculating a Running Total In SSIS

Running totals are a common calculation for reporting, and are occasionally needed in ETL processes to populate aggregate tables. One way to accomplish this in SSIS, if you are retrieving data from a relational database, is to do the running total in Read More...
Posted Monday, June 09, 2008 4:33 AM by jwelch | 1 Comments
Filed under: , ,

Adding Headers and Footers to Flat Files

A common question with SSIS is how to handle adding headers and footers to a flat file when the format is different that the data rows. This gets more difficult when the header or footer needs to contain data based on the actual data rows, such as a total Read More...
Posted Friday, February 08, 2008 5:40 AM by jwelch | 0 Comments
Filed under: , ,

Handling Multiple Errors in SSIS Revisited

Previously, I posted about how multiple errors in SSIS can be combined into a single unit for emailing or logging. Recently, a thread on the MSDN forums pointed out that the example wasn't quite complete. While it does show how to collect all the error Read More...
Posted Tuesday, January 15, 2008 4:59 AM by jwelch | 6 Comments
Attachment(s): CaptureErrorsRevisited.zip

Changing Destination Tables With the OLE DB Destination

The OLE DB Destination supports using a variable to get the name of the target table. This allows you to switch the destination table dynamically, but there is a caveat. The columns in each table that you will use must match, or the OLE DB Destination Read More...
Posted Sunday, November 18, 2007 9:10 PM by jwelch | 0 Comments
Filed under: ,

Dealing with Unicode and ASCII Text Files

A recent post on the MSDN forums brought up an interesting problem. The poster was attempting to process a folder of files, all of which had the same format, but some were encoded as ASCII (ANSI, DT_STR, or varchar, if you like the SQL Server data types) Read More...
Posted Thursday, November 08, 2007 10:06 PM by jwelch | 1 Comments
Filed under: , ,

Scanning a Package For Specific Tasks

I recently had a need to scan through an SSIS package to find all instances of data flow tasks within the package. This is to support a future enhancement in BIDSHelper . However, I ended up making the code a little more general, so it can be used to Read More...
Posted Sunday, October 28, 2007 11:42 PM by jwelch | 1 Comments
Filed under: , ,

Address Columns Generically In a Script Component

When writing script components in SSIS, it's often useful to be able to process the columns without knowing exactly what they are. For example, you may want to loop through all the columns to check for a conditional, like NULL values in the columns. Or Read More...
Posted Sunday, October 21, 2007 4:59 AM by jwelch | 0 Comments
Filed under: , ,

Preparing A List of IDs for an IN Condition

There's been a few questions on the MSDN Forums recently about using a list of keys in an IN condition in a WHERE clause. There are a few scenarios were this can be a bit tricky in SSIS, particularly if you need to dynamically create the list of keys. Read More...
Posted Sunday, September 30, 2007 10:13 PM by jwelch | 0 Comments
Filed under: ,

Dynamically Pivoting Rows to Columns

Previously, I posted about dynamically un-pivoting columns to rows . In this post, we'll look at the reverse scenario. Suppose that you have a list of sales orders, in this format: Sales Order Number Product SO-001 Hammer SO-001 Table Saw SO-001 Cordless Read More...
Posted Friday, September 14, 2007 4:41 AM by jwelch | 3 Comments
Filed under: , ,

Using the WMI Data Reader in SSIS

A recent post on the MSDN forums was asking about using the WMI Data Reader Task to retrieve information and send it to a SQL Server destination. I wasn't very familiar with the task, so I decided to try it out. I wasn't expecting much, given some of Read More...
Posted Wednesday, September 05, 2007 3:42 AM by jwelch | 0 Comments
Filed under: , , ,

Processing a Flat File with Header and Detail Rows

It's been tough finding time to write any content recently, but this was a scenario that came up recently both at work and on the forums, so I decided to write it up. It's another variation on processing flat files (they seem to be endless). This scenario Read More...
Posted Thursday, July 12, 2007 3:17 AM by jwelch | 0 Comments
Filed under: , ,

Attachment(s): ParseFlatFileHeaderDetail.zip

XML Transformations Part 2

Previously, I posted about using a script destination component to output an XML file . A post on the MSDN forums got me thinking about a slight tweak to the previous post that would result in a little more flexibility. The poster wanted to create an Read More...
Posted Sunday, June 03, 2007 7:16 PM by jwelch | 1 Comments
Filed under: , ,

Multi-File Outputs Part 2

In my previous post, I discussed how to use a script destination to output multiple flat files from a single source. In it, I mentioned that I would post an alternate approach, that didn't require any scripting. So, here it is. This is using the same Read More...
Posted Sunday, June 03, 2007 5:14 AM by jwelch | 0 Comments
Filed under: , ,

Attachment(s): Multiple Files From Single File.zip
More Posts Next page »