Skip to main content

Notifications

Custom Reporting in Dynamics Marketing

Dynamics Customer Insights Journeys provides organizations with the ability to plan and execute customer experiences through which they can engage with their customers. Dynamics Customer Insights Journeys includes visualizations and dashboards to allow organizations to perform the analysis of this insights data. In addition to the out-of-the-box reporting, customers require the ability to create their own custom reports.

Overview of Dynamics Customer Insights Journeys

Within the Dynamics Customer Insights Journeys product there are two main modules which group the available functionality: outbound Marketing (OBM) and Real-Time Journeys (RTJ). Each carry their own features but, from a reporting perspective, they provide similar capabilities with in-app insights which cover the more common uses and analysis. In RTM this is provided through PBI Embedded reports as well as operational analytics for a selected channel asset (Access and interpret analytics - Dynamics 365 Customer Insights | Microsoft Learn) while OBM provides Insights controls in the Email, Journey and Contact forms (Analyze results to gain insights from your marketing activities - Dynamics 365 Customer Insights | Microsoft Learn).


Both keep track of the way marketed contacts react to marketing messages and provide detailed analytical views to help organisations understand the impact and analyse the ROI of executed campaigns. Each key table provides statistics, analytics, and key performance indicators (KPIs) based on the interaction results. These insight categories cover a wide range of activities like email interactions, web interactions, form interactions etc. The difference occurs is in how the interaction data is stored.
 

When outbound marketing was designed, it created an architecture which utilized Azure storage to hold the interaction data for the journeys. This provided faster response times than what was possible in Dataverse at that time. Dataverse has evolved and a managed data lake is now available within it, providing the faster storage that Dynamics Customer Insights Journeys needs. Real-Time Marketing makes use of this storage to take the place of the previously created Azure storage. The resulting architecture looks like this

Dynamics Customer Insights Journeys Custom Reporting

When customers using OBM wanted to create custom reports, the approach followed was to replicate the data to additional storage and then build the custom reports on this replica data store. This approach presented challenges to properly secure the exchange of data between the Dynamics data store (aka Dataverse) and a customer repository. In addition, it requires the development and maintenance of the code to move the data.


With the March release of Customer Insights Journeys, a new feature was introduced in Public Preview which allowed the surfacing of the interaction data to Microsoft Fabric. Extraction of data will therefore no longer be required for custom reports based on Dynamics Customer Insights Journeys data, thus ensuring that custom reporting can occur with the data remaining in the secure Dataverse boundaries.


Microsoft Fabric provides an end-to-end analytics and data platform that can ingest, transform and report on data. It provides the ability to join up multiple data services from multiple vendors into a single platform. For more information, refer to the documentation (What is Microsoft Fabric - Microsoft Fabric | Microsoft Learn)
In order to surface the data into Fabric, a customer would need to:

  1. Provision a capacity. This could be Premium Capacity, Fabric Capacity or Trial Capacity
  2. Link the Dataverse environment to the provisioned capacity
  3. Create a Fabric Workspace for Customer Insights Journey interactions
  4. Create shortcuts in the workspace for the required tables
Detailed steps on how to achieve each step are provided in the documentation (Preview: Customer Insights - Journeys integration with Microsoft Fabric - Dynamics 365 Customer Insights | Microsoft Learn).Once the data is available in Fabric, customers will be able to use the functionality available in Fabric to create reports, create integration pipelines and in general work with this data to fit business needs.
 
No changes in reporting with “outbound marketing only” interactions

For customers that require custom reports that include “outbound marketing only” interactions they may continue using the export to Azure Blob Storage feature. This feature continues to be supported and can be safely used as needed. To be able to use this feature customers will need to provision an Azure Blob Storage and create a “Shared Access Signature” and use this URL to create a new analytics configuration record. After this is completed, Dynamics 365 Customer Insights Journeys will begin to export interaction data as individual files to your blob storage container, and you can start using this data for your custom reporting requirements.


Step by step instructions to use this feature can be found here.

 

Comments

  • EmanuelCaraza Profile Picture EmanuelCaraza
    Posted at
    Custom Reporting in Dynamics Marketing
    Hello TR-30051143-0!
     
     
    The situation described in the old blog has evolved. As the access to the Marketing Interaction data is now through Fabric rather than the direct access to the data lake described initially (an approach which has since been removed), this opened new possibilities. Now, all interactions, even those that have no equivalent in Real Time Marketing are surfaced in Fabric. The data model for all surfaced tables can be seen here overview of CustomerInsightsJourneys - Common Data Model - Common Data Model | Microsoft Learn and this is backward compatible to support customers that have Outbound Marketing. 
     
    Recommendation to customers is to move away the blob storage approach to use Fabric instead, which becomes critical as they transition to Real Time Marketing. 
     
  • TR-30051143-0 Profile Picture TR-30051143-0
    Posted at
    Custom Reporting in Dynamics Marketing

    "The remaining types of outbound marketing interactions are not flowing to the Managed Data Lake yet but it is planned to have some of those types of interactions added in the near future. 
    Initially, these types of interactions will also be available in the Managed Data Lake:

    • ActivityContactBlockedSuppression
    • ActivityContactBlockedConsent

    This list is tentative and additional outbound marketing interactions could be added. However, it is not expected that all entities will be available. 
    For the purposes of this blog, we will refer to the group of interactions that are not available in Managed Data Lake as "outbound marketing only” Interactions"

    Is there a list available somewhere of "outbound marketing only" interactions that will not be available in the Managed Data Lake? Will those still need to be accessed in the old way via the blob?

  • Gus Profile Picture Gus 101
    Posted at
    Custom Reporting in Dynamics Marketing
    @emanuelCaraza. Hi. Is there any update to this or how to handle with Customer Insights-Data new integration, etc.  Would be helpful to have RTM data access clarity as to what to do right now today and future.  Ty
  • Community member Profile Picture Community member
    Posted at
    Custom Reporting in Dynamics Marketing
    The same question - how to get that data from RTM on Power Bi? 
  • Yulya Toporochan Profile Picture Yulya Toporochan 84
    Posted at
    Custom Reporting in Dynamics Marketing
    I'm going to ask the same question. Is there a date, month, year when Power BI Reports are available for Real-time marketing or how the data for Real-time marketing can be exported?
    We have asked so many resources and there is just nothing available. It's blocking our pursuits of leveraging the RTM platform to the fullest. Please provide something!!!!
  • Cdubs-Husq Profile Picture Cdubs-Husq 31
    Posted at
    Custom Reporting in Dynamics Marketing
    Is there a specified date, month or year when reports can be made with Power BI directly instead of using the Azure blog storage? My department is currently setting up the blog storage feature.
     
    "In the future, what Dynamics Marketing will allow is the possibility to create custom reports using Power BI directly, without requiring data to be exported to additional storage."
  • PurelyScottPCRM Profile Picture PurelyScottPCRM
    Posted at
    Custom Reporting in Dynamics Marketing
    I see this page was updated in Oct 2022, and now makes reference to a process of using code to export RTM interactions from the managed data lake to a customer's own blob container, but that the details are not provided.  I actually remember referencing this page and that process in the summer of 2022 for a previous consulting engagement, and the process was listed in more detail at that time, including a link to the github repo and so on.  Is there somewhere I can find that previous version again?  Thank you!

    EDIT: I just discovered I still had the github link in my browsing history: https://github.com/gsrivastava/CustomReporting.  Unfortunately, the info in the repo overview references the previous version of this page for getting certain values that you need to update in the code to make it work for your environment, but that link is now broken and tells you to visit this current page version instead, and all those details are no longer present.