I have to migrate data from CRM 4.0 to MS CRM Online & customer has around 35GB data now my question is which would be the best way to migrate the data?
A: Using CRM 4.0 Data Migration Manager to export the data & then using import the data using ConfigurationMigration? Is that be viable solution?
B: Export the data from CRM 4.0 using Data Migration Manager & then upload it using SSIS or custom code?
Any idea how much time usual it should take to upload that much data (35GB this includes Account, Appointments, Lead & few custom entities)
We had a similar need and extended an existing open source project to migrate (almost) all the CRM entities.
We published it here: https://github.com/marcopierobon/CrmChainsaw
We had a smaller DB to migrate (5GB) and it took around 48 hours. The main problem is the CRM endpoint that is pretty slow, so it's really difficult to make it faster.
You should look into Scribe (www.scribesoft.com) and Kingswaysoft (http://www.kingswaysoft.com/products/ssis-integration-toolkit-for-microsoft-dynamics-crm)
These companies both provide tools for migrating data into Dynamics CRM.
I sign up for Dynamic CRM online trial (30 days) and create an unmanaged custom solution (new fields, some custom entities, etc). Now, I want to export the unmanaged solution and import it to my Dynamic CRM On-Premise 2011 in my server (already get the latest rollup).
However, the solution is failed to be imported. The error message said that:
Import of solution * failed. The following components are missing
in your system and are not included in the solution...
There are two missing components shown. Both are web resource type, with name/Id: msdyn_/ActivityFeeds.Form.Js and msdyn_/RecordWall.htm and both are ActivityFeedsCore (1.0.5.3403) managed solution.
From what I've researched, (please correct me if I'm wrong), the problem is on the Dynamic CRM online Activity Feeds managed solution are already installed and in the Dynamic CRM on-premise, it isn't.
What should I do to be able to import the unmanaged solution without importing the Activity Feeds managed solution?
You need to use solutiondownlevelutility.exe included in the latest CRM 2011 SDK.
You can find a guide on MSDN:
http://msdn.microsoft.com/en-us/library/jj945276.aspx
Another option would be to:
- Import the Activity Feeds.
- Import your unmanaged solution.
- Delete the Activity Feeds.
You can find the activity feeds solution here : http://pinpoint.microsoft.com/en-gb/applications/microsoft-dynamics-crm-activity-feeds-12884926310
Thanks,
Mario
I have an issue with a new sharepoint install that we've recently deployed to replace an ageing content management system that I implemented a few years ago.
What I'd really like is to save my colleagues as much effort as possible by transferring the content from my CMS into sharepoint.
I'm not very good with sharepoint yet, and my development platform of choice is PHP MySQL, so basically I'm wondering if sharepoint has any facility to import sites, I can easily built filters to reformat the content in my CMS into whatever (please let it be XML) format sharepoint will accept but I have no idea if sharepoint will even let me do this.
I have limited access to the sharepoint server, although in this case I can probably negotiate more if that's the only way.
Mostly I just need some pointers - does sharepoint have any facility to do this, and where do I start doing it?
Thanks
SharePoint has the ability to import data from an Excel spreadsheet (Site Actions > Create > Import Spreadsheet).
The only problem you may run into with this method is that you don't necessarily have full control over what column types the importer uses for your data--if that's important, then it will take some trial and error.
If you're familiar with .NET and you can get access to run a program on the server, you can write a program to import data into existing lists using the SharePoint object model.
the fastest way to bulk import data into SharePoint is through the batchdata method
http://msdn.microsoft.com/en-us/library/microsoft.sharepoint.spweb.processbatchdata.aspx
it is aimed ad importing list data, but it seems there are some workarounds to make it work with publishing pages
http://social.msdn.microsoft.com/Forums/sharepoint/en-US/f8fe190d-c1ed-4e15-bda2-7792211973cc/bulk-publishing-page-creation-using-processbatchdata?forum=sharepointdevelopmentlegacy
We're considering switching over to use TFS and the TFS Portal which is based on SharePoint. We've got existing information in various systems and it would be very advantageous if we could consolidate this information into the TFS Portal.
I'm wondering are there any tools/methods for importing data into TFS. Things I'm interested in importing are:
Newsgroups - that could be put into TFS discussions.
Fogbugz - that could be put into TFS work-items. (sorry Joel)
A TWiki
Given that it is very difficult to import the history from one TFS repository into another, I suspect the import of other types of data will be just as hard.
On the otherhand, there is a decent API, so it shouldn't be hard to write something yourself.
Check out Rob Caron's blog and the TFS API Examples site.
Just a small clarification. There are no TFS discussion groups. TFS uses SharePoint WSS as a collaboration tool. So, you might find better results if you search for any tools that import things to WSS Discussions. You can also find third party discussion web parts which you can install on the WSS site.
Edited:
What is the easiest way to scrape extract SharePoint list data to a separate SQL Server table? One condition: you're in a work environment where you don't control the SQL Server behind the SharePoint Server, so you can't just pull from the UserData table.
Is there there any utilities that you can use to schedule a nightly extract?
Is Microsoft planning any improvement here for "SharePoint 4"?
Update Jan 06, 2009:
http://connectionstrings.com/sharepoint
For servers where office is not installed you will need:
this download
There is a SSIS SharePoint task you can use to grab the data info a regular dataflow:
http://www.codeplex.com/SQLSrvIntegrationSrv
Scraping? As in screen scraping? Are you serious? ;)
2 Options
SharePoint Object Model - http://msdn.microsoft.com/en-us/library/ms441339.aspx
SharePoint Web Services - http://msdn.microsoft.com/en-us/library/ms479390.aspx
specifically the Lists web service
The web services is how Excel/Access communicate with SharePoint to integrate with its lists.
In fact a bit of Google foo gives these two results :-
Connecting SQL Reporting Services to a SharePoint List
Accessing SharePoint List Items with SQL Server 2005 Reporting Services
The 2 minute answer is to use Data Synchronisation Studio from Simego ( http://www.simego.com ) just point it at your List and database and it will sync all the changes.
There is an ADO.NET adapter for MOSS 2007/2010 and WSS 3.0/4.0 available which goes under the name Camelot .NET Connector for Microsoft SharePoint. It enables you to query lists in SharePoint through standard SQL language, using SharePoint as a data layer.
Besides from the connector, there will be a large number of open source tools and utilities available, such as webparts for exporting data to various formats (XML, MySQL, ..), Joomla plugins, synchronization services, etc.
See http://www.bendsoft.com for more details and to watch webcasts. BendSoft is currently looking for beta-testers and encourage all feedback from the community.
Example:
SELECT * FROM My Custom SharePoint List
INSERT INTO Calendar (EventDate,EndDate,Title,Location) VALUES ('2010-11-04 08:00:00','2010-11-04 10:00:00','Morning meeting with Leia','Starbucks')
DELETE FROM Corp Images WHERE Image Name = 'marketing.jpg'
I had written a full article about this with step by step screenshot procedures. It does not use any third party components only SQL BI Tools and Sharepoint. Have a look here
http://macaalay.com/2013/11/01/how-to-archive-sharepoint-list-items-to-sql-server/
As Ryan said I would also suggest using object model / web services to store data to separate SQL database. I think that the best approach is to write an event handler that will trigger on your least and copy the data user inserted/updated.
Regarding your query about "SharePoint 4", Bill Gates made some remarks at SharePoint Conference 2008. He suggests enriching SQL tables with SharePoint data, and goes on to mention several other potentially cool things. What exactly he means and whether it will help solve your problem in the future is hard to say until we start seeing betas of WSS4 / MOSS 14.
I would go with the simego software, but i dont have the money, maybe a 15 days trial is enough!
If you have MOSS installed, the Business Data Catalog can be setup from the Sharepoint Central Administration to automagically synchronize data for you. This is a very powerful product and is included with MOSS. I love it when a client has it enabled so I can take advantage of it.
But some don't and for myself, I've found that if they don't have BDC running and available, inevitably they don't give developers many rights to SQL Server so SSIS is generally out of the question (but maybe that's just me). No problem; for those I'll pull together a lightweight EXE that runs on a scheduled task that queries Lists.asmx and pushes changes to a SQL Server table. Fairly trivial stuff for a simple list where nothing is deleted. Get yourself Visual Studio 2008, CAML Builder, and prepare for a good time. The Lists.asmx results is a little funny in that a list's row's fields are each a single node with a lot of attributes, with no child nodes ... something like this off the top of my head ... just remember that when coding ...
<z:row ows_Id="1" ows_Field1="A1" ows_Field2="B1"/>
<z:row ows_Id="1" ows_Field1="A2" ows_Field2="B2"/>
Complications in code occur with copying lists where items are deleted, or where there is a parent/child relationship between SP lists. You'd think I'd have some code to send you, but I haven't bothered putting together something I could reuse.
I'm sure there's other ways of handling it, but the scheduled task EXE so far has been reliable for me for multiple apps for multiple years.
i wrote some code to achieve it, you can find it over here
extract data from moss 2007
Depending on the exact nature of the data you need to insert, it may be possible to just use the auto generated RSS feed to get the information you want, a process will need to read the rss and formulate a query.
Otherwise a consoleapp/service could use the object model to do the same thing, but with more control over field information.
I wish something like this was much easier to do. Something that didn't need SSIS and was boiled down to a console tool that reads a xml config file for source/target/map info.
http://blogs.officezealot.com/mtblog/archive/2008/06/03/importing-list-data-into-sql.aspx