Distill Release Notes

New Features

• Improved Macro Recorder: Completely redesigned macro recorder with improved reliability and performance for automating web interactions. Contextual help, drag-and-drop reordering, better element selector, and more.
• Conditions Summary in Email: Email alerts now include a clear summary of matched conditions, making it easier to understand why an alert was triggered.
• Change Preview: New smart preview in the Watchlist displays a preview of changes directly in the list, allowing for quick assessments without opening each monitor. Email previews in Inbox show change previews too.
• Multiple Global Conditions: Support for multiple global conditions in a Workspace, enabling more control over alerting criteria. Global conditions can be applied to a subset of monitors matching a filter.
• Batch Tag Editing: Ability to add or remove tags from multiple monitors at once, streamlining organization and management.

Other Improvements

• UI Modernization: Enhanced dark mode support for diff views
• Import/Export: Import monitors as cURL commands for easier integration
• Streamlined Error Codes: Standardized error codes for better clarity
• Clear Error Flag in Batch: Option to clear error flags when batch editing monitors
• Diff rendering: Visual mode to render HTML diffs tries to show content hidden by default in the source page

Bug Fixes

• Android:
  • Fixed crash in JSON diff processing
  • Resolved "show deleted" option not being saved

New Features

• Dark Mode: Complete dark mode support across the entire application, including browser extension and desktop app. Toggle between light and dark themes using the switcher in the top navbar.
• Shadow DOM Support: Monitor modern web components that use Shadow DOM technology. The new XCSS selector type enables tracking changes in previously inaccessible page elements.
• Better & Faster Diff: The HTML diff library has been redesigned to be significantly better. It is significantly faster for larger files and has better accuracy at highlighting changes.

Improvements

Feeds

• Labels (Added/Updated) on feed items in email alerts for clearer change tracking

Import/Export

• Export monitors from trash
• Show progress when importing monitors

Error Action Webhook

• Error action webhook payloads now include human-readable label names instead of label IDs

Miscellneous

• Faster web app loading and improved response times
• JSON monitors no longer trigger false alerts from key reordering
• iOS: Support for structured data in conditions
• Desktop App: Enhanced Visual Selector functionality

New Features

• Dedicated Cloud Devices: These are new type of devices that can be used to run persistent browser sessions hosted on Distill's infrastrcture. It replaces Profiles as a more powerful and feature rich alternative.
• Persistence: Each device keeps its own browser profile to save cookies, local storage, proxies, etc. As a result, it offers a better support for saving preferences and using authenticated sessions.
• Multi-site support: Works with any number of websites, another benefit over profiles.
• In-App Help Search: Added comprehensive search functionality across documentation, blog, and community forums.
• Advanced Search Improvements:
• Added device: filter to find monitors for specific devices and no: filter to find monitors without any labels.
• Added support for negated search terms using - operator.
• CronTab Enhancement: Extended cron scheduling functionality is now available to all paid users (previously enterprise-only)
• Local monitors can now use Crontab for scheduling checks.

Mobile Apps

• iOS: Added support for structured data and summary in conditions
• Android: Numerous UI and functionality improvements:
• Improved text/HTML diff rendering and fixed multiple re-rendering issues
• Displaying AI summary
• Dark mode in diff views
• Added "Show/hide deleted" toggle functionality for diff lines
• Support for editing webhook action

Miscellaneous Improvements

• Improved proxy handling
• Fixed issue with re-computation of previously calculated diffs for better performance
• Improved time display in logs

Structured data and Conditions

• Distill provides tools to extract and monitor structured data in following forms:
  • i. Scrapers - Extract structured data from web pages using customizable, handcrafted rules.
  • ii. AI Summary Fields - Utilize LLMs to intelligently extract specific data fields from web content.
  • iii. JSON monitors - Track and detect changes in data served by APIs in JSON format.
• Specific fields from structured data can now be used in conditions, enabling greater precision and control over notification triggers.

Browser Extensions

• XML monitors now log an error if the received content type isn't valid XML
• The open step in a macro now waits for the page to be loaded before completing.

General Changes

• Implemented Automatic Proxy Rotation in visual selector for more reliable setup and monitoring. Page validators are used to detect errors and switch the proxy if needed.
• Added more countries to the list of premium proxies available to support different regions across the world.
• Added ability to create monitors directly from sitemap crawler's change history.
• Removed redundant API calls in Watchlist to help load pages faster.
• Ability to test conditions with data in monitor's change history and custom input.
• Users can now retry failed renewals and add credits on demand.
• Added support for 'OR' and '-' negation operators. For example, "-has:label" can be used to list all monitors that do not have any label.

AI Summary

• Enhanced AI Change Summary with improved accuracy and readability. Use custom prompt to customize the summary's content and format.
• Added important field to the AI summary. Use this to filter out noisy changes and focus on important ones.
• Custom fields in AI summary can be used to extract custom data from pages. Custom fields are available in the UI and via API.

Managed Scrapers

• Managed scrapers are configurations created and managed by Distill for popular sites. Support to run managed scrapers have been added for local and cloud monitors.

Mobile Apps

• iOS app received UI improvements and bug fixes.
• iOS app can now be used to record and replay macro in all paid plans.

Desktop App

• Improved Electron app with incognito runs and notification fixes.
• Updated custom browser UI with "open in external" button and miscellaneous refinements.
• Action to clear the custom browser's browsing data.

iOS App

• Added support for Team Watchlist. This enables users to switch between multiple Watchlists they are part of and receive push notifications on the phone.

Features

• Ads and Cookie Banner Blockers for Cloud Monitors to minimize false alerts caused by changes in ads and cookie popups. This is available to users in all plans.
• Implemented a double-check process for cloud monitors when changes are detected to ensure notifications are only sent for genuine changes.
• Shows count of unread monitors in the browser's title bar.

Bug Fixes

• Config is now saved correcly after making changes to the config JSON.

General Changes

• Cloud monitors: Automatic validation of page's content to detect errors has been enabled for common errors in cloud monitors. This ensures that a change is captured only if the page is loaded correctly. Ir reduces false positives significantly for full page monitors.
• SMS: SMS content is now moderated to be in compliance with the SMS guidelines. The moderation is done using LLMs.
• Feed: RSS feeds with content fields are monitored correctly.
• Macro: more utility functions have been added to the macro editor.
• The unread state of a monitor is preserved even after a new change doesn't match the monitor's condition. This is to ensure that any older unread changes are not missed.
• Highlighted changes of a list of links could show unchaned links as changes in some cases. This has been fixed.

iOS App

• Faster diffing and rendering of changes for webpages and XML content.
• Better highlighting of changes in JSON monitors.
• Better diff rendering in dark mode.

Desktop App

Features

• Support for clearing cookies and local storage data.
• Working builds for Ubuntu 20.04.

Bug Fixes

• Visual selector in some pages with iframes was not able to save selections.
• Static checks used to cause memory leaks.

Chrome Extension

• Issues found and fixed after migration to mv3:
• Popup no longer gets stuck in Loading... state once a user logs out.
• Updated sqlite-wasm to resolve potential database inconsistency issues.
• Mark as Read now correctly marks the monitor as read.

Desktop App

• Users can now clear cookies and local storage data in the app using Clear Browser Data in Settings -> Advanced.
• Ensured the user agent is always updated to the latest available version.
• App no longer gets stuck in a blank screen in Ubuntu 20.04.6
• App window is now slightly faster to launch.

Microsoft Teams Webhooks Integration

• Users can now utilize MS Teams webhooks to receive change notifications directly in their Teams channels.

Email Updates

• Updated JSON diff view in emails to use nested lists instead of tables for better readability and consistency.

Chrome Extension

• Migrated to Chrome Extension Manifest V3 to adhere to Chrome's deadline.
• Note: JavaScript selectors no longer work due to MV3 limitations. Use desktop app or cloud when using js selectors.
• Addressed issues that originated in the Manifest V3 migration:
• Fixed notifications failing to open the URL in the browser when clicked.
• Notification sounds now play correctly.
• Open unread in tab button now opens multiple unread monitors as expected.
• Marking monitors as read now correctly updates the popup badge.

Desktop App

• Added a loading indicator for tabs in the custom browser.
• Custom browser's background now switches automatically with the system theme (dark mode/light mode).
• Action Macro now runs in the foreground tab.
• Macro steps updated to be user-readable.
• Fixed issue where the custom browser rendered plain text response on top of previous content.
• App icon now displays the correct unread monitor count on launch.
• Users can now export macros from the Desktop App.
• JavaScript selectors now return correct values when using sendResponse.
• Fixed issue preventing users from disabling monitoring when time slot checks were enabled.
• Macros with select step now return the correct value instead of the default one.
• Fixed issue where users were stuck in the Loading... state when not logged in.

iOS App

• Improved the diff page UI for different content types

Miscellaneous Improvements and Bug Fixes

• Local XML monitors now check for changes on all items instead of only the first item returned by the selector.
• Fixed issue where local monitors with macros errored out when run immediately after login.
• Note: Monitors were being saved but the page was stuck on options page.
• Logging out using the user dropdown (in Extension and Desktop App) now correctly logs out the user.
• Added a Styled checkbox to the watchlist change history, allowing users to switch between styled and unstyled views.
• Added the option to customize email alert subjects.
• Fixed issue where users were unable to change the selector type when the current selector did not match any elements.
• Improved Visual Selector to show the number of matched elements, helping users identify outdated selectors that no longer find any elements.
• Improved the "change summary" UI. Moved the feedback buttons to the top right corner of the layout. Added "Learn more" popover.

Loops in Macros

You can now use Loops in Macros. This is useful when you want to perform the same set of actions on multiple elements on a page, Or repeat the same set of actions multiple times.

Desktop App Now Available for Linux

The desktop application is now accessible for Linux users. You can download it from https://distill.io/apps/web-monitor/.

New fill Marco Step Introduced

A new marco step, fill, has been introduced to facilitate filling out form fields with specific values.

Enhanced Text Diff Display for Large JSON Values

Diff for large JSON values has been improved to show highlighted individual values.

CSV Export Functionality for Sitemaps

Users can now export sitemap differences and crawler data in CSV format.