Welcome to Agile BI Community Sign in | Join | Help

Browse by Tags

All Tags » Flat Files   (RSS)

Adding Headers and Footers to Flat Files

A common question with SSIS is how to handle adding headers and footers to a flat file when the format is different that the data rows. This gets more difficult when the header or footer needs to contain data based on the actual data rows, such as a total Read More...
Posted Friday, February 08, 2008 5:40 AM by jwelch | 0 Comments
Filed under: , ,

Dealing with Unicode and ASCII Text Files

A recent post on the MSDN forums brought up an interesting problem. The poster was attempting to process a folder of files, all of which had the same format, but some were encoded as ASCII (ANSI, DT_STR, or varchar, if you like the SQL Server data types) Read More...
Posted Thursday, November 08, 2007 10:06 PM by jwelch | 1 Comments
Filed under: , ,

Processing a Flat File with Header and Detail Rows

It's been tough finding time to write any content recently, but this was a scenario that came up recently both at work and on the forums, so I decided to write it up. It's another variation on processing flat files (they seem to be endless). This scenario Read More...
Posted Thursday, July 12, 2007 3:17 AM by jwelch | 0 Comments
Filed under: , ,

Attachment(s): ParseFlatFileHeaderDetail.zip

Multi-File Outputs Part 2

In my previous post, I discussed how to use a script destination to output multiple flat files from a single source. In it, I mentioned that I would post an alternate approach, that didn't require any scripting. So, here it is. This is using the same Read More...
Posted Sunday, June 03, 2007 5:14 AM by jwelch | 0 Comments
Filed under: , ,

Attachment(s): Multiple Files From Single File.zip

Multi-File Output Destination Script Component

Yesterday I posted about using a destination script component to write XML files from a data flow. Today, I'm continuing in the same vein with a post about writing multiple destination files from a destination script component. The inspiration for this Read More...
Posted Sunday, June 03, 2007 3:12 AM by jwelch | 1 Comments
Filed under: , ,

Attachment(s): Multifile Script Destination.zip

XML Destination Script Component

I often hear comments along the lines of "Why doesn't SSIS have an XML destination?". Unfortunately, I don't know the answer to that, but I can show you how to implement your own XML destination fairly easily. Thanks to the magic of the script component, Read More...
Posted Saturday, June 02, 2007 1:53 AM by jwelch | 13 Comments
Filed under: , , ,

Attachment(s): XMLScriptDestination.zip

Dynamically Unpivoting Columns to Rows

There's been a few questions on the forums recently about taking column values and pivoting them to rows. For example, I might have an input file with 5 columns: a key column and 4 category columns. Key; C1; C2; C3; C4 1;1;2;3;4 2;1;2;3;4 3;1;2;3;4 4;1;2;3;4 Read More...
Posted Friday, May 18, 2007 2:45 AM by jwelch | 1 Comments
Filed under: , , ,

Attachment(s): ColumnsToRows.zip

Handling Varying Columns, Part 2

In Handling Flat Files with Varying Numbers of Columns , I showed an example of parsing a flat file with an inconsistent number of columns. I used a script component, but Jamie commented that the same thing could be accomplished through a Conditional Read More...
Posted Wednesday, May 16, 2007 3:03 AM by jwelch | 3 Comments
Filed under: , ,

Attachment(s): ParseSingleColumnFlatFilePart2.zip

Handling Flat Files with Varying Numbers of Columns

5/15 Update - I added Part 2 to show how to do the same thing with a Conditional Split and a Derived Column transform, per Jamie's feedback (see the comments on this post). A common question on the forums has been how to handle flat files that have a Read More...
Posted Tuesday, May 08, 2007 3:00 AM by jwelch | 20 Comments
Filed under: , ,

Attachment(s): ParseSingleColumnFlatFile.zip