Skip to main content

Getting Your Data Into Dynamics 365 - Data Migration

When doing an implementation of Dynamics 365, it is rare that a new system is being setup with no data needing to be brought into it.  When looking into how to get that data into the new system, it can be really confusing trying to decide which tool to choose.  In my experience, people tend to choose the tool to use based on price and this should really be the last thing to consider.  That is one of the reasons I will not talk about price in this post.  Instead I will stick to the Pro's and Con's for each tool and provide an overview of the tool and any experience(s) with each.

Here are the tools we will be looking at in this post:
D365 Data Import Wizard
D365 Data Loader

KingswaySoft is an integration toolkit built on SQL Server Integration Services (SSIS).  It is an on-premise solution (but can be cloud if installed on virtual machine in Microsoft Azure or Amazon AWS).  It can be used for integration, migration and replication.  In full disclosure I have not used KingswaySoft for a data migration yet, because of the reasons I list in the con's.  But, I have had clients that use it.  They offer a free download and developer license, so you can give it a try.

  • SSIS has been around for a long time and SQL developers are familiar with it.
  • Has starter packs that can be used to speed up development of mappings.
  • Easy integration with source control since development is done in Visual Studio.
  • Since its built on SSIS you need to know the disadvantages of SSIS as well.
  • Can be intimidating is the user is not a developer, since you have to develop within Visual Studio or SQL Server Management Studio (SSMS).
  • Limited connections
SCRIBE Online:
SCRIBE Online is a product offered by SCRIBE for data integration, migration and replication.  This is the tool I use the most when it comes to migrating data into Microsoft Dynamics 365 and integrating with other systems.  It runs in the cloud and has an on-premise agent you install to access your on-premise data / systems.  There is also a cloud agent, if all your applications are already in the cloud.  They offer a free trial that you can use to see if it will fit your needs.

  • User interface is easy to understand and clean.
  • Runs in the cloud and uses a small tool (agent) to access on-premise data.  If all systems are in the cloud already then a cloud agent can be used so there is no need for an on-premise system.
  • Multiple connectors.  Makes it easy to connect to other systems and migrate the data into CRM.
  • API - They provide an API so you can access your instance programmatically.
  • Fast Connector Framework (FCF) \ Connector Development Kit (CDK) - If a connector doesn't exist you can use the FCF or CDK to create one.
  • Provide starter kits to speed up you data mapping. 
  • They offer a Dynamics 365 app, so you can monitor status from within CRM.
  •  Sometimes there are caching issues and you have to clear browser cache to fix them.
  • To get mappings into source control it is a manual process, since you have to export them and copy them into a local folder.
D365 Data Import Wizard:
The Data Import Wizard is built within Microsoft Dynamics.   It allows for easy import of .csv, .xls, .xlsx and .zip files.  My vary first data migration was done with importing .xls files into CRM using the Data Import Wizard (it was not easy).  If you are doing a large or complex migration, I recommend staying away from this approach and using a different tool.  Only use this for small occasional imports.

  • Built within Dynamics 365.
  • Mappings saved in CRM for later use.
  • Great for small non-complex mappings.
  • Can be used with the CRM SDK / Developer Guide.
  •  There is a limit to the file size you can use for importing data.  This means you will need to split up your data into multiple files, which can increase the possibility of data duplication.
  • If there is relationships to other entities in your mapping, it can be difficult to set all these and have them work consistently.
  • Tool is vary inconsistent when importing data.
D365 Data Loader:
This is a new tool that Microsoft has put out with Dynamics 365.  It was designed to help business go from CRM On-Premise to CRM Online.  This one I can not give a Pro's and Con's list to because it is a preview feature, which mean it still has issues and is not fully released yet.  I will say that it is a viable option of going from CRM On-Premise to CRM Online and both systems are identical.

It can be really hard to choose a tool and say that it will work 100% of the time for all needs.  This is because everyone's needs are different and everyone's skill sets are different.  If I did have to choose one to use I typically choose SCRIBE Online because it is the most user friendly and the one that is easy for people to pick up on and maintain.


  1. Thanks for sharing valuable information about cloud migration. It is very helpful to understand on cloud migration.


Post a Comment

Popular posts from this blog

Dynamics Set IFrame URL - D365 v8 vs. D365 v9

While doing client work, I came across a problem with setting an IFrame URL dynamically.  The underlying issue was that the sandbox instance is on v8 of Dynamics 365 and production is on v9 of Dynamics 365.  The reason for this was because this client was setup around the time that Microsoft rolled out v9.  Anyways, JavaScript that I wrote to dynamically set the URL of the IFrame wasn't working in the v9 instance.  This was because of changes that Microsoft made to how IFrames are loaded on the form and also changes to JavaScript.

Here is my v8 setup:
JavaScript runs OnLoad of contact form.  This works because of how IFrames are loaded in v8.  You can also run it on either a tab change (hide / show) or OnReadyStateComplete event of the IFrame.  Depending on your setup you will need to choose which is best for you.  For me in this case it was the OnLoad event.Here is the JavaScript: function OnLoad() { //Get memberid var value =…

HttpWebRequest For Scribe Online Api

Scribe has made it extremely easy to work with their API.  Currently, in my limited free time, I am working on a reusable C# library to send and receive data from Scribe's API.  Once it is completed for Version 1, I will list it to GitHub, so anyone can consume it and provide feedback on improvements.  There will be a fully built out wiki with how to consume the library with references to the Scribe API documentation.  Also there will be both TDD (Test Driven Development) and BDD (Behavior Driven Development) projects.  This way you can see examples of how to consume the library as well as what I tested before release.  If you are not familiar with BDD, I recommend you check out my blog post in my Dynamics 365 blog, that gives a high level overview of it.

Anyways, back to what this post is about.  While working on the library, I came across one small issue around TLS 1.2 and making sure that the web request uses it.  Luckily, this is really easy to set in C#, when using .NET 4.5. …

XrmToolBox Bulk Attachment Manager - Version 2018.2.2.7 Released!

Today I have published version 2018.2.2.7 of my XrmToolBox plugin.  The purpose of this plugin is to make it easy to download and backup attachments in CRM.  This release is a major release as it is the first built version with all pieces working.  The first version only had note downloads working.

Overview of Plugin:
Current Version: 2018.2.2.7Purpose: Download Attachments and E-Mail attachmentsGitHub Link.GitHub Wiki Link.Nuget Package Link.How To Use The Tool: Launch XRMToolBox.Connect to organization.Step 1, choose what you want to download. (Once a choice is made, Step 2 becomes usable)Notes - Download attachments from note entity.E-Mail - Download attachments from emails.Both - Downloads attachments from notes and emails entities.Step 2, choose if you want to download all attachments in the system or specific attachments.  All Attachments - This will search the chosen entity to find all records that have an attachment and download them.Click on "Browse" and choose where t…