Changelog | DataGrail Documentation

This page documents all customer-facing changes to the DataGrail application made in November 2024. Additional entries will be added every week on Friday.

Week of November 25

🚀 Features Added

• Added the following integrations with access capabilities in Request Manager: ADP Workforce Now, HiBob, HR Cloud, TriNet, UKG Pro, Workday

🛠 Changes Made

• Updated the AWS Integration to utilize role-based authentication.
• Optimization of batch deletion functionality for the Amplitude integration.

Week of November 18

🚀 Features Added

• Added a "Systems" filter on the Business Processes page.

🐛 Bugs Squashed

• Resolved an issue deleting "Note" objects in SalesLoft when the connecting user is not a Team Admin.
• Resolved a timeout issue causing some Braze integrations to disconnect sporadically.

Week of November 11

🚀 Features Added

• Added a Persona Integration with access and deletion capabilities in Request Manager.

🛠 Changes Made

• Added the "what inaccuracies need updating" field to Direct Contact forms.

🐛 Bugs Squashed

• Resolved an issue blocking Drift deletion on some requests.
• Resolved an issue preventing all default Risk Monitor Templates from showing for some new customers.

Week of November 4

🚀 Features Added

• Added the ability to start, cancel, pause, and resume Responsible Data Discovery scans.
• Added a Common Room Integration with access and deletion capabilities in Request Manager.
• Added System Detection capabilities to the Zip integration.

🛠 Changes Made

• Moved the "Reporting Contacts" menu from the System Inventory Page to the "Settings" page.

🐛 Bugs Squashed

• Resolved an issue blocking some Segment deletions.
• Resolved an issue which rendered an empty button on the Request Details page for some Privacy Requests.

This page documents all customer-facing changes to the DataGrail application made in October 2024. Additional entries will be added every week on Friday.

Week of October 28

🚀 Features Added

• Released the TIA and LIA Assessment Templates for Risk Monitor.

🛠 Changes Made

• Performance improvements to reduce Consent publishing time.
• Improved error handling and retry logic for the Heap integration.
• Refactored how connectors in the Request Manager Agent select the applicable queries based on the provided identifiers and made the function more extensible.

🐛 Bugs Squashed

• Resolved an issue causing inconsistent behavior with integration selection on requests in "Pending Action".
• Resolved an issue causing Privacy Dashboard values to display in seconds instead of days.
• Resolved an issue causing the Skilljar integration to fail in "Extracting Personal Data".
• Resolved an issue with the BigQuery connector for the Request Manager Agent where queries were not formatted with identifiers.
• Resolved an issue with the Request Manager Agent where Google Default Credentials provided as an environment variable were unavailable in the rq process.

Week of October 21

🚀 Features Added

• Added a Zip integration with Access and Deletion capabilities in Request Manager.
• Added support for custom 'From Names' with the Mailgun Transactional Mailer integration.

🛠 Changes Made

• Updated the 'What inaccuracies need updating?' field to be required on Update Inaccuracies requests.
• Updated the Facebook Marketing integration to use the latest v.21.0 API.

🐛 Bugs Squashed

• Resolved an issue where Stripe would show as disconnected for customers with a high volume of invoices.
• Resolved an issue preventing the "Add Condition" button from appearing in some cases in the Assessment Templates Editor.

Week of October 14

🚀 Features Added

• Added an OracleCrowdTwist integration with Access and Deletion capabilities in Request Manager.
• Added a PowerReviews integration with Access and Deletion capabilities in Request Manager.
• Added a new menu to view active Responsible Data Discovery scans.

🛠 Changes Made

• Improved handling of rate limiting with the Okta integration.

🐛 Bugs Squashed

• Resolved an issue preventing the deletion of integrations present on a high volume of Privacy Requests.

Week of October 7

🚀 Features Added

• Added a Descope integration with Access and Deletion capabilities in Request Manager.

🐛 Bugs Squashed

• Resolved an issue where some data subjects encountered an error when submitting new Opt Out requests.
• Resolved an issue where some integrations could not be deselected in the "Pending Action" state on Privacy Requests.
• Resolved an issue where Privacy Requests created from within the app or via email were immediately moved to "Pending Verification".
• Resolved an issue where some users could not see the "Add Service" button in the Tracking Services page.
• Resolved an issue where some Privacy Requests encountered an error when transitioned from "Pending Action" to "Pending Delete".

This page documents all customer-facing changes to the DataGrail application made in September 2024. Additional entries will be added every week on Friday.

Week of September 30

🚀 Features Added

• Added support for Advanced Consent Mode in Google Tag Manager, allowing data subjects to be tracked using Google Services in an anonymized way.
• Added a "Custom System" option in Live Data Map, allowing customers to create new systems from within the app.

🛠 Changes Made

• Updated BambooHR extraction logic to dynamically fetch all custom employee and customer fields on Privacy Requests.
• Optimized API calls to Braze for high-volume Privacy Request customers.

🐛 Bugs Squashed

• Resolved an issue preventing Docebo deletion from completing on some requests.

Week of September 23

🚀 Features Added

• Added a Consent integration for Webflow sites to respect a data subject's consent to tracking with the Webflow Analyze and Optimize products.

🛠 Changes Made

• Updated the HubSpot integration to include new auth settings for public apps. This update will add new options for choosing the scopes used by DataGrail.
• Optimized the Zendesk integration by implementing batch deletion requests to alleviate rate-limiting in high-request volume environments.

🐛 Bugs Squashed

• Resolved an issue where AppsFlyer was dropping requests because the deletion batch size was too large.
• Resolved an issue in the Docebo integration where validation of deletion was not properly done.

Week of September 16

🚀 Features Added

• Added a Commerce Tools Integration with access and deletion capabilities in Request Manager.

🛠 Changes Made

• Optimized SendGrid API Requests for high Privacy Request volume customers.
• Improved handling of invalid email addresses with the Iterable integration.

🐛 Bugs Squashed

• Resolved an issue preventing direct contact processors from uploading greater than 300 data files.
• Resolved an issue causing Demandbase to fail extracting data on some requests.
• Resolved an issue displaying system sources when the integration that detected it was deleted.

Week of September 9

🚀 Features Added

• Updated the "Risk" column on the System Inventory to highlight systems utilizing Automated Decision Making, AI Subprocessors, and/or GenAI tools.
• Added a SendGrid configuration option, allowing users to remove unsubscribe information from transactional email footers.
• Added a pre-flight publish option for Consent, allowing customers to test Consent configurations in a new, unpublished GTM container version.

🛠 Changes Made

• Added a "Sources" column on the System Inventory export, allowing customers to view how a system was detected in the downloaded CSV.

🐛 Bugs Squashed

• Resolved an issue preventing NETSUITE from completing in the access phase of some Privacy Requests.
• Resolved an issue where the Business Process for an Inventory System Report displayed differently on the System Inventory column than on the report itself.

Week of September 2

🚀 Features Added

• Added a "Risk" filter to the System Inventory page.

🛠 Changes Made

• Updated the "Third Party Disclosures" email template to include all available dynamic placeholders.

🐛 Bugs Squashed

• Resolved an issue causing some deletions to fail with the Outreach integration.
• Resolved an issue preventing the data subject location from being extracted on the Intake Form.
• Resolved an issue causing the privacy right tiles on the Intake Form to be misaligned on some resolutions.
• Resolved an issue causing Business Processes to display incorrectly on the System Inventory page.

This page documents all customer-facing changes to the DataGrail application made in August 2024. Additional entries will be added every week on Friday.

Week of August 26

🚀 Features Added

• Released DataGrail's V2 API.
• Released batched deletion logic for high-volume DSR processors, which reduces rate limiting and resource usage.
• Added a "Personal Data Categories" column and filter to the System Inventory page.

🛠 Changes Made

• Updated integration status messages in Request Manager for direct contact and whole-record deletion integrations.
• Updated the "data found" workflow condition to consider "data not deleted" responses from direct contact integrations as true.
• Refactored all DataGrail integration connection guides.

🐛 Bugs Squashed

• Resolved an issue preventing data subject location from being collected on customer intake forms.
• Resolved an issue causing the Outreach integration to fail in deletion.

Week of August 19

🚀 Features Added

• Added Do Not Sell/Share capabilities to the Segment Public integration.
• Added a Notion integration with access and deletion capabilities in Request Manager.
• Added a "Clear All" button for filters on the System Inventory page.

🛠 Changes Made

• Optimized the OneLogin integration for system detection, reducing the number of API calls needed and execution time.

🐛 Bugs Squashed

• Resolved an issue causing intake forms to double load when reloaded from certain paths.
• Resolved an issue preventing italics from rendering on intake form customizations.

Week of August 12

🛠 Changes Made

• Optimized the SendGrid integration to reduce rate limiting on Privacy Requests.
• Adjusted the text on the Smart Verification security page to better reflect multiple Privacy Request types.

🐛 Bugs Squashed

• Resolved an issue packaging data files for Privacy Requests with large volumes of PII. Integrations data over 10MB in size is now consolidated in to a singular TSV file for data subjects.
• Resolved an issue preventing new lines from showing on customized intake forms.

Week of August 5

🛠 Changes Made

• Optimized the automated deletion status checks for Amplitude.

🐛 Bugs Squashed

• Resolved an issue causing existing systems from being included on the "New Detected Systems Summary" email.
• Resolved an issue causing intake forms to load twice when accessed directly from the root.

This page documents all customer-facing changes to the DataGrail application made in July 2024. Additional entries will be added every week on Friday.

Week of July 29

🚀 Features Added

• Added Responsible Data Discovery support for Stripe.
• Added an AI Risk Assessment template in Risk Monitor.
• Added support for Custom Services in Consent Management.

🛠 Changes Made

• Simplified the configuration settings for the Adyen integration.
• Improved handling of 500 errors with the Office365 integration.
• Redesigned the Connection Guides for DataGrail's top 30 integrations.
• Updating the color palette and styling of the platform to match DataGrail's new styling!
• Deployed a faster model for Responsible Data Discovery with improved accuracy and support for 29 categories.

🐛 Bugs Squashed

• Resolved an issue causing inconsistent cursor behavior with the Third Party Disclosures text area.

Week of July 22

🚀 Features Added

• Added a new Twilio SendGrid integration with the ability to erase recipient email data in Request Manager.

🛠 Changes Made

• Added a "No, we do not hold personal data about the data subject" option on the direct contact form for Internal Processors.
• Optimized the Azure/Entra ID integration to reduce rate limiting.
• Added additional logging and status messages in the Request Manager UI for the following asynchronous integrations: Centercode, Chargebee, Heap, Qualtrics, and Simon Data.
• Added batching functionality to the Amplitude integration in Request Manager to increase efficiency in processing concurrent requests.

🐛 Bugs Squashed

• Resolved an issue with the sorting of Risk Monitor Assessments.
• Resolved an issue allowing manual data file upload for identifiers-only integrations.
• Resolved an issue preventing email templates from saving in certain cases.

Week of July 15

🚀 Features Added

• Added additional integration logs for asynchronous integrations with long processing times.

🛠 Changes Made

• Super Admins can now be references as a contact on an Inventory System Report.
• Improved the automatic connections check for ServiceNow.
• Optimized the fetching of Salesloft call activity to reduce rate limiting.

🐛 Bugs Squashed

• Resolved an issue causing some completed integrations to show as "Pending" in the UI.

Week of July 8

🚀 Features Added

• Added an Optimizely integration for use on Privacy Requests.
• Added an 'empty' state for Risk Monitor questions that have no value.

🛠 Changes Made

• Upgraded Facebook Marketing integration to the latest API version (v. 20.0).
• Improved auto promotion of LDM systems based on high confidence matches.

🐛 Bugs Squashed

• Resolved an issue causing Whole Record deletion integrations to be ignored.

Week of July 1

🚀 Features Added

• Added "Data Subject Relationship" to the Data Subject Requests download.
• Added the ability to duplicate and delete Risk Monitor templates.

🐛 Bugs Squashed

• Resolved an issue causing the UI to show an incorrect closed state for completed Privacy Requests.
• Resolved an issue preventing the "Access Categories" checkboxes from being editable.

This page documents all customer-facing changes to the DataGrail application made in June 2024. Additional entries will be added every week on Friday.

Week of June 24

🚀 Features Added

• Added a Gladly integration with access and deletion capabilities in Request Manager.
• Added the ability to duplicate Risk Monitor templates.

🐛 Bugs Squashed

• Resolved an issue where identifiers-only integrations were blocking the "Extracting Personal Data" state on Privacy Requests.

Week of June 17

🚀 Features Added

• Added the ability to reorder questions and sections in the Risk Monitor Template Builder.
• Added support to deny privacy rights to data subjects in unsupported locations.
• Added additional information for pending asynchronous integrations within the Request Manager Details page.
• Added support for Chargebee Product Catalog v2 for access and deletion requests.

🛠 Changes Made

• Improved the invite system for Risk Monitor contributors.
• Improved integration status messages for whole-record deletion integrations in the Request Manager UI.
• Removed unverified Do Not Sell/Share requests from the "incomplete" count on the Dashboard.

🐛 Bugs Squashed

• Resolved an issue causing the incorrect integration status to be shown in the UI for direct contact processors that respond with, "No, we could not delete data for the data subject".
• Resolved an issue causing the bulk deny action to fail on the Data Subject Requests page.
• Resolved an issue causing AWS SES messages to recipients with non-7-bit-ASCII addresses to fail.
• Resolved an issue where some Inventory System Report contacts could not see an assigned report.

Week of June 10

🚀 Features Added

• Added a "Third Party Disclosures" page to Settings, supporting Oregon's new legislation requiring controllers to send data subjects a list of associated third parties.
• Released an Adyen integration, supporting API access and deletion capabilities in Request Manager.
• Added a Koala integration, supporting API deletion in Request Manager.

🛠 Changes Made

• Direct Contact Integrations on deletion requests in the "Extracting Personal Data" state will now show "Complete - Access Skipped" instead of "Pending".

🐛 Bugs Squashed

• Resolved an issue with Automated Workflows causing some integrations to stall in the deletion phase, if they did not return data in access.

Week of June 3

🚀 Features Added

• Added an Entrata integration with access and deletion capabilities in Request Manager.
• Added a configuration option to the Zendesk Integration that allows ticket audit history to be included in access results.
• Added a Koala integration with access and deletion capabilities in Request Manager.

🛠 Changes Made

• Improved error handling on the Office 365 integration.

🐛 Bugs Squashed

• Resolved an issue causing the daily automatic retry to fail for some integrations.

This page documents all customer-facing changes to the DataGrail application made in May 2024. Additional entries will be added every week on Friday.

Week of May 27

🛠 Changes Made

• Improved System Detection matching rules to reduce false positives.

🐛 Bugs Squashed

• Resolved an issue where some users were taken to a 404 page when opening a Privacy Request.
• Resolved an issue causing Privacy Request assignment emails to be sent erroneously when triggered from a workflow.

Week of May 20

🐛 Bugs Squashed

• Resolved an issue where a 404 page was shown after pressing the "Deselect All" button on requests in "Pending Action".
• Resolved an issue preventing some question types from being included on Assessment PDF exports.

Week of May 17

🚀 Features Added

• Added multi-region support for the mParticle integration.

🛠 Changes Made

• Emojis on the Privacy Request Center are no longer rendered on Windows devices, to minimize compatibility issues.

🐛 Bugs Squashed

• Resolved an issue causing the "Deselect All" button to show an error message for some requests.
• Resolved multiple UI inconsistencies with the direct contact file upload.
• Resolved an issue opening phone requests from anonymous numbers.
• Resolved an issue causing blank "Pending Direct Contact Summary" to be sent for some integrations.

Week of May 6

🚀 Features Added

• Added multiple pre-populated categories to the Risk Monitor Template Builder.
• Added persistent filtering to the System Inventory page.
• Added the ability to unassign a Privacy Request.
• Added functionality to create a new contact directly from an Inventory System Report.

🐛 Bugs Squashed

• Resolved an issue causing the "Last Updated" user for some integrations to be listed as "Unknown".
• Resolved an issue causing the Request Manager activity logs to show the wrong request type.
• Resolved an issue causing Privacy Requests from "Unknown" phone numbers to fail loading.

This page documents all customer-facing changes to the DataGrail application made in April 2024. Additional entries will be added every week on Friday.

Week of April 29

🛠 Changes Made

• Added support for granular Zoom scopes.
• Improved blocking of data subjects for requests marked as spam.

🐛 Bugs Squashed

• Resolved an issue causing some unverified requests to remain open after 7 days.
• Resolved an issue preventing some Inventory System Report contacts from being removed.

Week of April 22

🛠 Changes Made

• Improved the load time on the System Inventory page.

🐛 Bugs Squashed

• Resolved an issue in which the "Deselect All" button behaved inconsistently on Privacy Requests in the "Pending Action" state.
• Removed a set of known false-positive Systems from customer inventories surfaced via System Detection.
• Resolved an issue causing some Privacy Requests in the "Pending Action" state to show a 404.
• Resolved an issue causing some customers to receive blank "Direct Contact Summary" notifications.

Week of April 15

🚀 Features Added

• Added deletion capabilities to the Braintree integration.
• Added a "Deletion Behavior" configuration option for Shopify, MixPanel, and AppsFlyer. This allows integrations to be marked as complete, once asynchronous requests are successfully submitted.

🐛 Bugs Squashed

• Resolved an issue preventing categories from being selected on "Access Categories" requests in "Pending Action".
• Resolved an issue causing some Privacy Requests verification links to redirect incorrectly.
• Resolved an issue preventing the ISR Contacts list from loading for some customers.

Week of April 8

🚀 Features Added

• Added a Volumental API integration for use in Request Manager.

🐛 Bugs Squashed

• Resolved an issue preventing images from being uploaded to Email Templates.
• Resolved an issue causing Direct Contact Integrations to expire prematurely.
• Resolved an issue causing Direct Contact reminder emails to send for completed integrations.

Week of April 1

🚀 Features Added

• Added support for Emarsys as a Transactional Mailer.

🛠 Changes Made

• Renamed "Access Type" and "Deletion Type" under Enabled Integration Capabilities to "Access Request" and "Deletion Request" to improve consistency.

🐛 Bugs Squashed

• Resolved an issue preventing certain Inventory System Reports from saving.
• Resolved an issue preventing Request Admins from viewing all integrations on Privacy Requests.

This page documents all customer-facing changes to the DataGrail application made in March 2024. Additional entries will be added every week on Friday.

Week of March 25

🛠 Changes Made

• Updated the Twilio Integration to use the Lookup v2 API.

🐛 Bugs Squashed

• Resolved an issue preventing the Shopify Integration from closing on deletion requests when data was anonymized, rather than deleted.
• Resolved an issue causing Direct Contact Integration statuses to display incorrectly on Privacy Requests.

Week of March 18

🛠 Changes Made

• Improved the efficiency of the AppsFlyer integration.

🐛 Bugs Squashed

• Resolved an issue preventing uploaded data files for Direct Contact Integrations from showing in the UI.
• Resolved inconsistencies in the Activity Log for Direct Contact integrations.

Week of March 11

🚀 Features Added

• Added new Integration Statuses with additional granularity about integration progress on Privacy Requests.
• Added tooltip popups that describe the "Added Date" and "Last Detected Date" columns in Live Data Map.
• Added tabbed navigation capabilities to Live Data Map pages.

🛠 Changes Made

• Added a Force.com API integration that supports whole-record deletion (delete_all).
• Improved integration reporting by removing unnecessary/duplicate data.

🐛 Bugs Squashed

• Addressed an issue causing delays during asynchronous retry attempts for AppsFlyer.

Week of March 4

🚀 Features Added

• Added a "Last Detected Date" to the System Inventory table to indicate when a system was last detected by DataGrail.
• Added support for custom static placeholders in Salesforce Anonymization to handle Salesforce instances with custom field validation.
• Added a configuration option to remove DataGrail branding on the Privacy Request Center.

🛠 Changes Made

• Added a warning when removing a Business Process from an Inventory System Report.

🐛 Bugs Squashed

• Resolved an issue causing some Privacy Requests to reopen in the UI after being denied.
• Resolved an issue causing empty data files to be retrieved by WooCommerce.

This page documents all customer-facing changes to the DataGrail application made in February 2024. Additional entries will be added every week on Friday.

Week of February 26

🛠 Changes Made

• Moved to Cursor-based pagination for the Gorgias integration, due to the deprecation of Gorgias' offset-based pagination.

🐛 Bugs Squashed

• Updated the Shopify Integration's deletion flow to utilize the Customer Data Erasure API when deleting customers with active subscriptions or recent purchases. This update resolves an issue preventing Shopify deletion from completing for some data subjects.

Week of February 19

🚀 Features Added

• Added a Calendly Integration with access and deletion capabilities for automatic fulfillment of Privacy Requests.

🛠 Changes Made

• Added Integration Disconnection Notifications for Live Data Map only customers.
• Moved Product Feedback button to the main sidebar.
• Improved handling of rate limiting with the Appsflyer Integration.
• Improved handling of rate limiting with the BazaarVoice Integration.
• Updated Privacy Request verification emails to only send one reminder 24 hours after submission.

🐛 Bugs Squashed

• Resolved an issue preventing requests in "Extracting Identifiers" from being denied.
• Resolved an issue preventing conditional questions from showing in Risk Monitor exports.
• Resolved an issue preventing Eloqua from showing a "connected" status when properly configured.

Week of February 12

🐛 Bugs Squashed

• Resolved an issue preventing some files uploaded to "Uncategorized Data" from being rendering within the app.

Week of February 5

🚀 Features Added

• Updated the Segment Public integration to support access/deletion for collected users via the userId parameter.

🛠 Changes Made

• Improved styling on active Inventory System Reports, so Business Processes are more identifiable.
• Added additional support for custom objects in Salesforce Service Cloud.

🐛 Bugs Squashed

• Resolved an issue causing the "New Detected Systems" email notification to be blank or duplicative.
• Resolved an issue causing the Property ID parameter to be optional for Appsflyer connections.
• Resolved an issue causing some integrations to fail to initialize when Privacy Requests entered the "Pending Delete" state.