Am facing the following issue while running a job in data servies.
My source is a SAP R/3. The error is as shown in the attachment, am facing this issue only for few tables.
guess a column delimiter is appearing at the end of the 102 column, just see that record in particular, i have had similar peobs when i did it with flat files, after i manually editied it the prob got solved.
but these are not flat files, the SAP table data dump file(.dat xtension), which is very large in size(approx… 500MB). I checked the data in SAP, the data is good. Also checked by exporting the data to a csv file, that too failed.
I didn’t pay close attention, as the others pointed out it happens at row number 1 million. So it cannot be a general setting, it has to be related to the row’s data.
What you could try for a second is to go to the object library, fiel formats, edit the transport file format and change the column delimiter to something else. If that makes a difference, then we know for sure this character we use as a column delimiter is contained in the data inside the SAP table you are reading.
I tried all other delimiter but the data is not getting splitted into columns.Column delimiter should be “”, we can not keep anyother. I tried row delimiter as windows new line and unix new line also , its failing tooo.
The problem was with a column SGTXT which was having an invalid charater. I did not select that column in my query, But i should increase the column size of some columns to make the job run with out any errors(with out SGTXT column). I am not getting why i should increase the column size to run the job with out errors.
Once again thanks for your support to solve this issue.