Delivery Statistics Report

To access the Delivery Statistics report, select Reports from the menu and select the Delivery Statistics node or one of its child nodes from the reports tree on the left.

The left pane displays the reports tree, with the system reports and user defined reports, where the Delivery Statistics node or its child node is currently selected.

The pane on the right shows this Delivery Statistics report.

You can download the whole report in PDF, spreadsheet or CSV format via the main menu, the right-click menu of the tree node or one of the three on-page download buttons.

Report Pane

If the Delivery Totals tab is selected, then the top of the report pane shows a row of total sums in large color patches, built across the accumulated details of all job deliveries that are included in the report. (This first row does not appear if the Bounce Rates tab is selected.)

Below this is a second row of color patches with a number of overall average values with, optionally, a time distribution chart below it.

The data in these average patches and in the chart depends on your choice for the result aggregation setting:

Per Delivery Aggregation: The chart shows the time of each job delivery in the report on the X-axis, with the job's value for this delivery and the given metric plotted on the Y-axis. The overall averages over all these values in the chart are in turn shown in the color patches above the chart.
Per Job Folder Aggregation: This aggregation type does not show a time distribution chart. The overall averages in the color patches are calculated in a two-step process: First, for each folder the average over deliveries of all jobs in that folder is determined. These individual folder averages are then averaged again and the results are shown in the color patches.
Per List Aggregation: This aggregation type does not show a time distribution chart. The overall averages in the color patches are calculated in a two-step process: First, for each list the average over all deliveries of all jobs sent to that list is determined. These individual list averages are then averaged again and the results are shown in the color patches.
Per Day Aggregation: The chart shows each day in the report on the X-axis, with the average over all job deliveries sent on this day plotted on the Y-axis. The overall averages over all these daily averages in the chart are in turn shown in the color patches above the chart.
Per Week Aggregation: The chart shows each week in the report on the X-axis, with the average over all job deliveries sent during this week plotted on the Y-axis. The overall averages over all these weekly averages in the chart are in turn shown in the color patches above the chart.
Per Month Aggregation: The chart shows each month in the report on the X-axis, with the average over all job deliveries sent during this month plotted on the Y-axis. The overall averages over all these monthly averages in the chart are in turn shown in the color patches above the chart.
Per Year Aggregation: The chart shows each year in the report on the X-axis, with the average over all job deliveries sent during this year plotted on the Y-axis. The overall averages over all these yearly averages in the chart are in turn shown in the color patches above the chart.
Per Hour of Day Aggregation: The chart shows each hour of the day on the X-axis (i.e. there are 24 slots), with the average over all job deliveries sent during this hour of the day plotted on the Y-axis. This combines job deliveries that were sent on different days but during the same hour of the day into the same slot. The overall averages over all these hourly slot averages in the chart are in turn shown in the color patches above the chart.
Per Day of Week Aggregation: The chart shows each day of the week on the X-axis (i.e. there are 7 slots), with the average over all job deliveries sent during this day of the week plotted on the Y-axis. This combines job deliveries that were sent during different weeks but on the same day of the week into the same slot. The overall averages over all these daily slot averages in the chart are in turn shown in the color patches above the chart.
Per Hour of Week Aggregation: The chart shows each hour of the day of each day of the week on the X-axis (i.e. there are 24 * 7 = 168 slots), with the average over all job deliveries sent during this "hour of the day / day of the week" combination plotted on the Y-axis. This combines job deliveries that were sent during different weeks but during the same hour of the day on the same day of the week into the same slot. The overall averages over all these hourly slot averages in the chart are in turn shown in the color patches above the chart.

Report Settings

You can control which job deliveries are included in the report and how this data is shown by using the links at the top right of the pane. The following options are available:

Sent to Subscriber List or Group: This option is only available if your account has access to at least one Subscriber List or List Group. By default, this link has the text "Any Recipients", which means that job deliveries are included regardless of whether they have been sent to a given subscriber list or not. Click this link to open a dialog that allows you to decide if the deliveries of jobs shown in the report shall be restricted to those that were sent to the subscriber list or list group that you selected. Once selected, the link text changes to reflect the choice you made and the report now only includes the deliveries of jobs that were sent to the list (or group) you selected.
Located in Selected Folder: By default, this link has the text "Any Folder", meaning that a job's folder location is ignored when querying for the jobs. Click this link to open a folder selection dialog. Once you select a folder (followed by OK), the link text changes to reflect the choice you made and report now only include the deliveries of jobs that are located in the folder you selected (optionally also recursively with all subfolders).
Delivery Period: Click this link to open a drop-down menu of pre-configured dynamic delivery periods. Click the desired period. The link text changes to reflect your decision and the report now includes only the deliveries of jobs that were processed at a time that falls into the period you selected.

Completed past periods: The following periods have in common that the associated time interval consists of complete calendar units (i.e. days, weeks, months, years), each preceding either "today" or the currently running (and thus incomplete) week, month or year:
- Last Week: The full calendar week preceding the current one.
- Last 3 Weeks: The most recent full three calendar weeks preceding the currently running week.
- Last 30 Days: The most recent full 30 calendar days, up to and including the day before today.
- Last Month: The full calendar month preceding the currently running month.
- Last 3 Months: The most recent full three calendar months preceding the currently running month.
- Last Year: The most recent full calendar year preceding the currently running year.
- Last 3 Years: The most recent full three calendar years preceding the currently running year.
Periods up to and including "now": Contrary to the periods above, all following periods run until "now" (i.e. the moment when the report was last executed).
- Today: The current day, starting at midnight and running until "now".
- This Week: The current week, starting at monday or sunday (depending on your preferences) and running until "now".
- This Week -2: The current week and the two full preceding weeks, starting at monday or sunday (depending on your preferences) and running until "now".
- This Month: The current month, starting at the first day of the month and running until "now".
- Today -29: The current day and the full 29 days before, resulting in a total display period of 30 days.
- This Month -2: The current month and the two full preceding months, starting at the first day of the earliest of these months and running until "now".
- This Year: The current year, starting on January ^1st. of the year and running until "now".
- This Year -2: The current year and the two full preceding years, starting on January ^1st. of the earliest year and running until "now".
- Full History: This special period includes all jobs that have ever been delivered, regardless of the delivery time. Note: Use this period with special care if LISTSERV Maestro has registered a large number of jobs spanning long periods of time. Executing the report with this special period selected may take some time.
Custom Period: If the periods from the Preset tab do not suit your needs, you have the option to click the Custom tab and to supply the desired start and end dates/times in the input fields or by picking from the given calendar panels.
Result Aggregation: The criteria you define through the menus above decide which job deliveries are included in the report or not (or, in other words: these criteria define a result filter). Contrary to this, this option configures if and how the data of the job deliveries that meet the filtering criteria is aggregated to yield higher-level analytic metrics.
- Per Delivery: No aggregation is performed. Each delivery and its associated metric is listed separately, both in the line chart and the details list that follows it.
- Per Job Folder: This option yields a list details view only and no line chart. Creates one aggregated entry per job folder for all the folders that contain at least one delivery of a job that is included in the report.
- Per List: This option yields a list details view only and no line chart. Creates one aggregated entry per Subscriber List or List Group that was used in the recipients definition of at least one of the job deliveries that is included in the report. Deliveries of jobs in the report that were not sent to a Subscriber List or Group are shown combined into one special aggregated entry named "[No Subscriber List]"
- Per Day: Each calendar day of the configured period is shown with associated metrics.
- Per Week: Each calendar week of the configured period is shown with associated metrics.
- Per Month: Each calendar month of the configured period is shown with associated metrics.
- Per Year: Each calendar year of the configured period is shown with associated metrics.
- Per Hour of Day: Each of the 24 daily hours creates one fixed aggregate and any job from the configured time period is put into the aggregate matching the job's delivery hour (i.e. "which hour did the wall clock show?"), regardless of the specific date/time/year when delivery occurred.
- Per Day of Week: Each of the 7 weekly days creates one fixed aggregate and each job from the configured time period is put into the aggregate matching the job's delivery weekday, regardless of the date/time/year when delivery occurred.
- Per Hour of Week: Creates a fixed list of time slot aggregates similar to above, but one for each hour in a hypothetical calendar week (i.e. 168 slots are created). Each job from the configured time period is put into the aggregate matching the job's delivery weekday and delivery wall clock hour, regardless of the date/time/year when delivery occurred.

Saving the Report

If you regularly make changes to the report settings to view different versions of the report, and especially if you often go back and forth between a few often used settings, it can be advisable to save such often used settings for later quick retrieval.

To do so, once you are satisfied with the report settings, click the Save Report button. This stores the current settings for future use.

The saved report appears as a new child node beneath the main Delivery Statistics node. By selecting this child node, you now execute the Delivery Statistics report with the report settings that were stored in this node. Any changes to the settings of the main Delivery Statistics node will not affect this saved report. By creating saved reports for your most frequently used settings, you can quickly switch between them without having to fiddle with the settings controls.

Saved Reports With Temporary Settings - "This report uses temporary settings"

When viewing one of your saved reports, you can still change its settings, just like you can save the settings of the main Delivery Statistics node. However, in contrast to the main Delivery Statistics node, which remembers all settings changes, any changes that you make to the settings of one of your saved reports are only temporary. If such temporary settings are in effect, the message "This report uses temporary settings" is shown with the report (or if only the order of the report list has been changed, the message "This report uses temporary order settings" is shown instead). The temporary settings are not actually stored in the report and will remain in effect only until you select a different Delivery Statistics report in the reports tree on the left (or until you log out).

By using the provided links you can manually reset the report to the original settings (Reset). Or, you can save the temporary settings into the report and make them permanent (Save). Or, if more than only the ordering of the report list has been changed, you can create a new report based on the current temporary settings (Save As).

Report Email

For a saved report, you can subscribe to a report email via the checkbox in the top right corner.

When you subscribe to a report email, a copy of the report will be emailed to you according to the schedule that you specify. You can define a one-time mailing, or a repeated mailing that either runs open-ended or that automatically ends at a given cut-off date or after a given number of repeats.

While the subscription is active, the date and time of the next report email, as well as the repeat schedule (if any), is displayed next to the subscription checkbox. If this date and time is in the past and no more repeat schedule is displayed, then this means that the cut-off threshold has been reached and no more report emails will go out until you change the schedule.

The report emails are sent to your notification address that is defined at the moment of the report delivery.

You can unsubscribe at any time by, clicking the checkbox and then selecting [Delete Schedule] on the scheduling page.

Example: To subscribe to a monthly mailing that is sent out on the first of each month and that contains a report with the daily delivery statistics of the previous month:
Select the "Delivery Statistics" report node and set the "Report Settings" to the desired subscriber list and job folder filter and select the "Last Month" preset as the period filter plus the "Per Day" aggregation. Then click [Save Report] to save this report. With the freshly created report node selected, click the "Report Email" checkbox. Then on the scheduling page, define a schedule that starts on the 1st of the next month (at the desired time) and with "Repeat at selected day of month, at the given time". Then select the "1st" as the repeat day (again enter the desired time). Also select "Repeat every 1 months" and "Run until stopped manually". Click [Save Schedule] to save and activate this subscription.

Working with the Details List / Drill-Down

This report is aimed at giving you an at-a-glance overview of the delivery statistics for the jobs in the report. The lowermost section of the screen shows a details list with varying contents depending on your choices for the report. To view details specific to an entry in the list, click the title of the entry in the list. Depending on the settings of the report, this click (if available) has different results:

Per Day / Week / Month / Year: Clicking on such an entry shows a report with a calendar aggregation of one level lower, i.e. clicking on a year shows a report on all months of this specific year, clicking on a months shows a weekly report, clicking on a week shows a daily report (this activity is often called "drilling down"). To return to the previous report, click the icon. Clicking on a day in a daily report drills down to the lowermost level, a detailed list of jobs (i.e. without data aggregation).
Per Delivery: Clicking on a job delivery (which is the lowermost level of drilling) opens the Job Statistics Report for this delivery of the job, allowing you to get a better view of the statistics that Maestro has collected for this delivery.
Per List: Clicking on a Subscriber List or Group shows a detailed list of jobs (those that have been sent to the given list/group) without data aggregation. For the administrator, this option is not available.
Per Hour of Day / Day of Week / Hour of Week: No details click available.

You can sort the list by clicking on any of the header fields. This way, you can for example bring the jobs with the highest bounce rate to the top of the list and focus further analysis on these problematic campaigns. Alternatively, a job may stand out visually already when you look at the time distribution shown under "Jobs Overview": First hover with your mouse over the dot in the chart, then click to open a panel with additional information.

Similarly, you can use ordering by certain metrics also when working with aggregated data. This allows you to quickly accomplish tasks like the following:

Find the best delivery time: Start with the Tracking Statistics Report. Then set the result aggregation to "Per Hour of Day". Order the results descending by open rate to bring the hour of day to the top that yielded the best open rate.
Schedule a large campaign: Start with the Delivery Statistics Report. Then set the result aggregation to "Per Hour of Week". Order the results ascending by the amount of delivered recipients. This will show you the times during a typical week with the least amount of delivery load and you may want to consider scheduling your large campaign for such a time in order to not interfere with other, frequently run medium-sized mail jobs.

Introducing: Finer-Grained Reporting on Job Deliveries In this report, Maestro 11.1 and earlier reported later additional deliveries of the same job for the same point in time when the job was delivered first. Taking the example of a long-running campaign with multiple deliveries spanning time periods of months or even years, this means that the statistics of a delivery happening today may be listed for a time slot at a long time ago. This is now different: Later deliveries of the same job are now associated with the correct moment in time when the delivery happened and not with the first delivery of the job. You will therefore see multiple entries listed for repeated deliveries of the same job, each with the correct delivery time.