Just a heads up that DevX just published an article of mine today. The article is entitled Sync Your Database to SharePoint Using SSIS. The article covers how to import and export SharePoint list items using Collaborative Application Markup Language (CAML), SharePoint's web services API, and SQL Server Integration Services.
The latter half of the article is a fairly detailed how-to, but the former half covers what SharePoint lists are, what SSIS is, and why you would want to use them all together. I hope you find the article useful, and feel free to comment here if you have thoughts on the article.
I need to do something similar, but I don't want to delete everything in the list beforehand as some of it is content managed. I need to only add the new records in the DB to the list.
I'm sorry I really only work in VB when necessary, but the concepts should still apply. If you convert my library code to VB please post of a comment of where to find it, I'm sure the community would find it very useful.
These are fairly standard Data Warehouse syncing issues and there are a number of standard techniques to resolve. I'd suggest picking up a DW book for the general concepts.
As far as the details of retrieving from SharePoint, the article and sample code should be sufficient for retrieving data and comparing for example last modified dates. If not please provide a more specific question as I have done this type of thing and can probably provide guidance.
you can email me at email@example.com
Thank You very much for the post. I have downloaded your code, and tried to run the code with some changes, i am getting the error
Error: 0x1 at Script Task, System.IO.Stream GetRequestStream(): The remote name could not be resolved: 'nic-user-dev'
I am able to compile the code successfully but after compilation in the output i am getting the result as zero rows have been written. There are 31 rows in my database. Any suggestions of why its not writing rows to the list.
No code to write or anything so it was nice
Your solution is very helpful. I need your advice.We need to synchronize more than million records. Now we are looking how to improve performance.
Will be grateful for help.
this export from SSIS tech is working as expected. But only the document data ( in binary format) available in SQL Server is not exported to sharepoint column as proper datatype is missing.
Can you suggest what must be the Datatype of the Column in Sahrepoint to get the binary data export from sql server via SSIS.?