modcomms/specs/Barclays_ModComms_Req_v5.md
2025-12-18 16:51:27 +00:00

40 KiB
Executable file
Raw Permalink Blame History

OLIVER BARCLAYS

App Requirements Document: Mod Comms Proofing Tool

Date Created: 01/10/2025

Date Updated: 20/11/2025 v5

Author: OLIVER UK / Steve O'Donoghue

Status: Draft


OLIVER BARCLAYS

Application Requirements

1. Must Have

These are the non-negotiable, critical features required for the app to function and launch.


OLIVER BARCLAYS

User Management & Authentication (P1)

Sign in to continue to Mod Comms

Email: steveodonoghue@oliver.agency Password: ••••••••••••

Sign in

Forgot my password | Contact Support

©2025 OLIVER Agency Mod Comms. All rights reserved.

  • User/access management: The app must integrate with the same O365/Azure/SSO platform already in place for the existing 'CopyGenAI' application to support seamless sign-on as part of users existing accounts.

  • Login Screen: A sign-in screen must be presented to unauthenticated users, featuring:

    • o An email address field.
    • o A password field.
    • o A "Sign in" button.
  • Password Reset: The system must provide a "Forgot my password" link that allows users to have password reminder/reset notifications sent to them this will be in-line with the Azure workflow, with the front end of the app enabling the basic Azure process through the CTA.

  • Support Request: The login screen must include a "Contact Support" link. This link must allow a user to enter a message which is then submitted via email to the support team.

  • User Roles & Permissions: The app must support at least two user roles, "Admin" and "Basic User," with different permissions as follows:

    • o Admin: Can see all navigation options and all campaigns from all agencies.
    • o Basic User: Sees a subset of navigation options (critically, "Campaigns") and can only see campaigns associated with their own agency.

Support ticket screen: (P2)


OLIVER BARCLAYS

Contact Support Dialog:

Contact Support ×

Please describe your issue or query below. A member of our team will be in touch shortly.

Type your message here...

[Cancel] [Submit Query]

Core App Structure (P2)

Application Interface - Mod Comms Navigation:

Mod Comms

  • Home
  • Campaigns
  • WIP Reviewer
  • CopyGenAI
  • Analytics
  • Auditing
  • Settings

Mod Comms: Intelligent Proof Review

Proof Analysis

Streamline your creative approval process. Use the 'Campaigns' section to upload proofs for an instant, AI-powered analysis against brand, legal, and compliance guidelines.

How It Works

Lead Agent
Mediates with specialist agents, consolidates feedback, and provides a unified final report.
Legal Agent
Scans for advertising standards, claim accuracy, and required disclaimers.
Brand Agent
Verifies adherence to brand guidelines like logo usage, colors, and overall branding.
Tone Agent
Analyzes copy for clarity, brand personality, and grammar to ensure your message is effective.
Channel Agent
Assesses technical suitability for digital channels, reviewing image quality and format.

Application Requirements:

  • Homepage: After logging in, the user must land on a "Home" page that explains how the tool works and details the available AI agents (e.g., Lead Agent, Legal Agent, Brand Agent, etc.).

  • Main Navigation: A persistent vertical navigation bar must be present on the left side of the screen. Visibility is based on the user type and is as follows:

    • Basic user

Steve O'Donoghue OLIVER Agency

© 2025 OLIVER Agency Mod Comms. All rights reserved.


OLIVER BARCLAYS

  • Home
  • Campaigns
  • Analytics
  • Auditing
  • Settings
  • Profile (to log out)

o Admin user

  • Home
  • Campaigns
  • Profile (to log out)

Profile screen:

Your Profile View your account details and manage settings

Account Information

ACCOUNT TYPE FIRST NAME
Administrator Steve
LAST NAME EMAIL
O'Donoghue steveodonoghue@oliver.agency
ENTITY
OLIVER Agency

Logout Got a question?

Steve O'Donoghue OLIVER Agency © 2025 OLIVER Agency Mod Comms. All rights reserved.

Campaigns (Top Level)


OLIVER BARCLAYS

Campaigns
Manage your campaigns and proof collections.
CAMPAIGN NAME PROOFS STATUS CREATED BY OWNING AGENCY LAST MODIFIED
Barclays Q4 campaign 2 In Progress Steve O'Donoghue OLIVER Agency 2025-10-28
Barclays Q3 Roundup 1 Completed Steve O'Donoghue OLIVER Agency 2024-06-30

Navigation Menu:

  • Mod Comms
  • Home
  • Campaigns
  • Preview
  • WIP Review
  • CopyGen AI
  • Analytics
  • Auditing
  • Settings

Controls:

  • Show Completed toggle
    • Create New Campaign button

[ ] Campaigns View: The "Campaigns" navigation item must lead to a top-level page that displays a user's accessible campaigns in a table.

[ ] Campaign Table Columns: The campaign table must display the following columns: "CAMPAIGN NAME," "PROOFS" (a count of assets), "STATUS," "CREATED BY," "OWNING AGENCY," and "LAST MODIFIED".

[ ] Manual Campaign Status: Users must be able to manually change a campaign's status between "In Progress" and "Completed".

[ ] Show Completed toggle: Users must be able to hide/show campaigns which they have marked as completed using a toggle mechanic.

[ ] Create New Campaign: o The page must feature a "+ Create New Campaign" button. o Clicking this button must open a pop-up modal. o This modal must require the user to enter a "Campaign Name," "Brand Guidelines" with a drop down showing two options "Barclays" and "Barclaycard", "Campaign ID" (or a link to Workfront), and a "Client Lead". o The "Agency" and "Agency Lead" fields must be pre-filled and tied to the user's account. o Note: The selected "Guidelines" present a key decision to the user and for the app as the selected value will determine the guidelines which the agents reference as part of the scoring/response.

Create new campaign screen:

Steve O'Donoghue OLIVER Agency © 2025 OLIVER Agency Mod Comms. All rights reserved


Proofs (Asset Level)

Campaigns Interface

The campaigns management interface displays a list of campaigns with the following navigation menu on the left:

  • Mod Comms
  • Home
  • Campaigns
  • WIP Reviewer
  • CopyGenAI
  • Analytics
  • Auditing
  • Settings

Campaigns List

CAMPAIGN NAME PROOFS STATUS CREATED BY OWNING AGENCY LAST MODIFIED
Barclays Q4 campaign 2 In Progress Steve O'Donoghue OLIVER Agency 2025-10-28
Barclays Q3 Roundup 1 Completed Steve O'Donoghue OLIVER Agency 2024-06-30

Create New Campaign Modal

Field Value
Campaign Name [Empty field]
Workfront Campaign ID #WF_12345
Client Lead [Empty field]
Agency OLIVER Agency
Agency Lead Steve O'Donoghue

Barclays Q4 Campaign - Proof Overview

The proof overview screen shows compliance status for the Barclays Q4 campaign with navigation options including "Download All Proofs" and "Upload New Proof" buttons.

Proofs Table

PROOF NAME WORKFRONT # CHANNEL SUB-CHANNEL PROOF TYPE OVERALL STATUS
Cricket Post V1 #WF_49366-V1 Social Instagram Feed Post Passed
IG Hero Post 1 V2 #WF_12823-V2 Social Instagram Feed Post Passed

Requirements

  • Proofs View: Clicking on a campaign from the main list must navigate the user to the "Proofs" screen, which displays a table of all assets (proofs) uploaded to that campaign.

  • Proofs Table Columns: The proofs table must display: "PROOF NAME" (with version number, e.g., "V1," "V2"), "WORKFRONT #," "CHANNEL," "SUB-CHANNEL," "PROOF TYPE," and "OVERALL STATUS".

  • Proof Row Actions: Each row in the proofs table must have icons allowing the user to:

    1. Upload a new version of that specific asset.

Steve O'Donoghue
OLIVER Agency
© 2025 OLIVER Agency Mod Comms. All rights reserved.


OLIVER BARCLAYS

  1. Download the asset.
  2. Delete the asset.

Upload New Proof:

o The page must feature an "+ Upload New Proof" button. o This button must open a flow requiring the user to provide mandatory fields, including "Proof Name". o The user must select a "Channel" (e.g., Social). o Based on the Channel, the user must select a "Sub-Channel" (e.g., Instagram). o Based on the Sub-Channel, the user must select a "Proof Type" (e.g., Feed Post, Reel). This field's options must be dependent on the Sub-Channel selection. o The user must be able to select a file from their computer for upload. o The final "Upload and Analyse Proof" button must be disabled until all required fields are filled. o A matrix of the supported platforms, channels and asset types is included below:

# Channel Platform Deliverable Format Spec
1 Social Meta Static image Storyboard .PDF In-feed 1x1
2 In-feed 4x5
3 Reels static 9x16
4 Stories Static 9x16
5 Video Storyboard .PDF In-feed 1x1
6 9x16 reels
7 9x16 stories
8 YouTube - (online video) Video Storyboard .PDF 1x1
9 16x9
10 Video Storyboard .PDF 1x1
11 9x16
12 16x9
13 Display Google - Performance Max Static image Storyboard .PDF 1080x1080
14 4x5 (1080x1350)
15 1.91x1 (1200x628)
16 Logo 1x1 (1080x1080)
17 Online - General Banner Storyboard .PDF 300x600
18 160x600
19 970x250
21 300x250
22 Barclays .co.uk Banner Web Banner Design + Static Image Storyboard .PDF 720x540
23 1316x740
24 Copy AD Copy Copy Document PDF or word doc N/A

Analysis Progress: After uploading, the system must show a progress or loading indicator while the asset is being analysed by the various agents.

Upload new proof screen:


OLIVER BARCLAYS

Mod CommsBarclays Q4 campaign Proof overview and compliance status.

Home

Campaigns Upload New Proof

WIP Reviewer Proof Name e.g., Q4 Hero Instagram Post

CopyGenAI Channel Sub-Channel

Analytics Social ▼ Instagram

Auditing Proof Type Feed Post

Settings Proof File

↑ Upload a file or drag and drop

Cancel Upload & Analyze Proof

PROOF NAME WORKFRONT # CHANNEL SUB-CHANNEL PROOF TYPE OVERALL STATUS
Cricket Post V1 #WF_49366-V1 Social Instagram Feed Post Passed
IG Hero Post 1 V2 #WF_12823-V2 Social Instagram Feed Post Passed

Steve O'Donoghue OLIVER Agency © 2025 OLIVER Agency Mod Comms. All rights reserved.

Asset Detail & Analysis View (P1)

Mod Comms Social · Instagram · Feed Post

Home Proof Preview Overall Status: Passed

Campaigns The proof has Passed review. All critical legal and brand issues from the previous version have been successfully addressed. The partnership claim is clear, and the design now fully aligns with brand guidelines. One minor suggestion is to consider a separate vertical version for Story placements, but the proof is approved for deployment.

WIP Reviewer

CopyGenAI Legal Agent Green ●

Analytics IG Hero Post 1 v2 All legal concerns have been addressed. The partnership claim is now clearly stated as 'Proud principal partner' and all necessary documentation for the use of the Lord's branding has been verified.

Auditing (Corrections Applied) No issues found.

Settings Brand Agent Green ● The proof now fully aligns with brand guidelines. The 'Principal partner' lockup uses the correct brand font, and the non-standard blue border has been removed, resulting in a cleaner, on-brand look.

No issues found.

Version History Download New Version

Version 2 2024-07-25
Workfront ID: #WF_12823-V2
Version 1 2024-07-23
Workfront ID: #WF_12823-V1

Tone Agent Green ●

The copy remains clear, professional, and well-aligned with the brand's tone of voice. No issues found.

No issues found.

Channel Agent Amber ●

The image composition has been improved and is suitable for standard feeds. However, for optimal performance on Instagram, creating a separate vertical version for Story placements is recommended.

Actionable Issues: Consider creating a separate vertical version for Story placements. Mark as resolved

Steve O'Donoghue OLIVER Agency

Detail View: Clicking a specific proof from the proofs table must open the asset detail view. Layout: This screen must have a two-column layout:

  • Left Column: Contains the "Proof Preview", asset metadata (Title, Proof Type, Channel, Sub-Channel), and a "Version History" section.
  • Right Column: Contains the full analysis and feedback from all agents.

OLIVER BARCLAYS

  • Version History: The "Version History" section must list all uploaded versions (e.g., "Version 1") and provide a "Download" button for each specific version. This page must also have an "+ New Version" button.

  • Agent Feedback:

    • The right column must display an "Overall Status" (e.g., Passed) at the top.
    • It must also display detailed feedback sections for each individual agent (e.g., Legal Agent, Brand Agent, Tone Agent, Channel Agent).
    • Agents must be able to return a "Pass" (Green), "Amber" (with issues), or "Fail" (Red) status.
    • If an asset is un-assessable, agents must return an "Error" status.
  • Core Analysis Logic: The "Lead Agent" must mediate the feedback from all sub-agents to determine the final "Overall Status". The system must allow an asset to "Pass" overall, even if a sub-agent finds "Amber" issues.

    • The application must allow for agent weighting and logic to be fine-tuned as part of QA/UAT testing phases
    • Mediator agent RAG status definitions for MVP:
      • Green All agents pass the upload, up to 1 Actionable Issue/Amber issue from each agent allowed. Actionable Issue/Amber from the Legal Agent triggers 'Amber' overall from the mediator
      • Amber Any agent returning more than one actionable issue, or any actionable issues returned from the Legal agent
      • Red Failure from any of the sub-agents
  • Issue Resolution: Users must have the ability to manually override an agent's finding.

    • There must be a "Mark as resolved" button for actionable issues.
    • When clicked, the user must be able to submit a resolution note.
    • Upon submission, the issue must be visually struck-through and marked as green.
    • Re-open Resolved Issues: The ability for a user to "reopen" an issue that they previously marked as resolved.
  • Flag Agent Feedback: A "flag" icon next to each agent's analysis that allows a user to report incorrect or problematic feedback (e.g., "This is agreed with legal") to the admin/support team.

Flag incorrect analysis screen:


OLIVER BARCLAYS

Resolve issue screen:

Mod Comms Proof Preview Overall Status: Passed
🏠 Home IG Hero Post 1 v2
(Corrections Applied)
The proof has Passed review. All critical legal and brand issues from the previous version have been successfully addressed. The partnership claim is clear, and the design now fully aligns with brand guidelines. One minor suggestion is to consider a separate vertical version for Story placements, but the proof is approved for deployment.
📊 Campaigns Legal Agent 🟢 Green
👁️ WIP Reviewer All legal concerns have been addressed. The partnership claim is now clearly stated as 'Proud principal partner' and all necessary documentation for the use of the Lord's branding has been verified.
🤖 CopyGenAI No issues found.
📈 Analytics Flag Feedback as Incorrect
You are flagging the feedback from the Tone Agent.
Additional Comments (Optional):
Please provide any details about why this feedback is incorrect.

[Cancel] [Submit Flag]
🔍 Auditing 🟢 Green - 'Principal partner' lockup uses the correct brand font, and the non-standard blue border has been approved and aligns with the brand's tone of voice. No issues found.
⚙️ Settings No issues found.
Version History [Download] [New]
Version 2
Workfront ID: #WF_12823-V2
2024
Version 1
Workfront ID: #WF_12823-V1
2024
Channel Agent 🟡 Amber
The image composition has been improved and is suitable for standard feeds. However, for optimal performance on Instagram, creating a separate vertical version for Story placements is recommended.
Actionable Issues:
Consider creating a separate vertical version for Story placements. [Mark as resolved]

Steve O'Donoghue
OLIVER Agency


Mod Comms Proof Preview Overall Status: Passed
🏠 Home IG Hero Post 1 v2
(Corrections Applied)
The proof has Passed review. All critical legal and brand issues from the previous version have been successfully addressed. The partnership claim is clear, and the design now fully aligns with brand guidelines. One minor suggestion is to consider a separate vertical version for Story placements, but the proof is approved for deployment.
📊 Campaigns Legal Agent 🟢 Green
👁️ WIP Reviewer All legal concerns have been addressed. The partnership claim is now clearly stated as 'Proud principal partner' and all necessary documentation for the use of the Lord's branding has been verified.
🤖 CopyGenAI No issues found.
📈 Analytics Resolve Issue
Please provide a reason for resolving the following issue:
"Consider creating a separate vertical version for Story placements."

Reason for resolution:
e.g., 'Documentation has been sourced and approved by legal.'

[Cancel] [Submit Resolution]
🔍 Auditing 🟢 Green - 'Principal partner' lockup uses the correct brand font, and the non-standard blue border has been approved and aligns with the brand's tone of voice. No issues found.
⚙️ Settings No issues found.
Version History [Download] [New]
Version 2
Workfront ID: #WF_12823-V2
2024
Version 1
Workfront ID: #WF_12823-V1
2024
Channel Agent 🟡 Amber
The image composition has been improved and is suitable for standard feeds. However, for optimal performance on Instagram, creating a separate vertical version for Story placements is recommended.
Actionable Issues:
Consider creating a separate vertical version for Story placements. [Mark as resolved]

Steve O'Donoghue
OLIVER Agency

Error with uploaded asset screens:

© 2025 OLIVER Agency Mod Comms. All rights reserved.


OLIVER BARCLAYS

Mod Comms - Barclays Q4 campaign

Proof overview and compliance status.

Navigation Menu:

  • Home
  • Campaigns
  • WIP Reviewer
  • CopyGenAI
  • Analytics
  • Auditing
  • Settings
PROOF NAME WORKFRONT # CHANNEL SUB-CHANNEL PROOF TYPE OVERALL STATUS
Test V1 #WF_11735-V1 Social X.com Tweet Analysis Error
Cricket Post V1 #WF_49366-V1 Social Instagram Feed Post Passed
IG Hero Post 1 V2 #WF_12823-V2 Social Instagram Feed Post Passed

Buttons: Download All Proofs | + Upload New Proof

Steve O'Donoghue
OLIVER Agency


Mod Comms - Test

Social · X.com · Tweet

Navigation Menu:

  • Home
  • Campaigns
  • WIP Reviewer
  • CopyGenAI
  • Analytics
  • Auditing
  • Settings

Proof Preview

Overall Status: Analysis Error

Overall Status: Analysis Error. The proof could not be reliably processed due to errors encountered during the analysis by multiple specialist agents. This version has been logged for manual human review. Please revise the proof and try again.

Legal Agent - Error
The agent could not analyze this proof with high confidence. This may be because the content is irrelevant, nonsensical, or too far outside of expected marketing materials.

Brand Agent - Error
The agent could not analyze this proof with high confidence. This may be because the content is irrelevant, nonsensical, or too far outside of expected marketing materials.

Tone Agent - Error
The agent could not analyze this proof with high confidence. This may be because the content is irrelevant, nonsensical, or too far outside of expected marketing materials.

Channel Agent - Error
The agent could not analyze this proof with high confidence. This may be because the content is irrelevant, nonsensical, or too far outside of expected marketing materials.

Version History

Version 1 - 2025-10-28
Workfront ID: #WF_11735-V1

Button: Download | New Version

Steve O'Donoghue
OLIVER Agency


'Financial Promotion' Handling

Following a review with the legal team, requirements were shared around the tools handling of advertising assets which reference 'Financial Promotion'. An example of these is included below:


OLIVER BARCLAYS

Get more out of your Barclaycard - CAPITAL SUMMERTIME BALL with barclaycard

10% OFF FOOD & DRINK

50% OFF PROGRAMMES

28.9% APR Representative (variable). Subject to application, financial circumstances and borrowing history. T&Cs apply. *You must show and pay with your Barclaycard or Barclays Premier card. T&Cs apply.

When a user uploads an asset the app must perform a check to determine if 'financial promotion' is present in these cases the user will need to ensure a formal legal review is undertaken. Full analysis and assessment must still complete but the app must clearly highlight the status to the user. Requirements and examples are detailed below:

  • Financial Promotion Handling:
    • If a proof is flagged as "Requires Manual Legal Review", the PDF must prominently display this status and include the specific reason provided.
    • Clear visual distinction/labelling must be present on the asset table (shown below)
    • Clear visual distinction/labelling must be present on the result page for the given asset (shown below)

Barclays Q4 campaign

Proof overview and compliance status.

PROOF NAME WORKFRONT# CHANNEL SUB-CHANNEL PROOF TYPE OVERALL STATUS
Legal Review V1 #WF_44583-V1 Social Instagram Feed Post Requires Manual Legal Review
IG Hero Post 1 V2 #WF_12823-V2 Social Instagram Feed Post Passed

Social · Instagram - Feed Post

Proof Preview

Financial Promotion Detected

This proof has been identified as a financial promotion and requires a separate, manual review from the Barclays legal team. You can still address the other AI-generated feedback points below to prepare the proof.

Reason Identified: "The asset prominently displays '28.9% APR' and refers to 'Barclaycard' and 'Barclays Premier card', which are credit products, along with associated lending disclaimers."

Advertisement Content: Get more out of your Barclaycard CAPITAL SUMMERTIME BALL 10% FOOD & DRINK 50% PROGRAMMES 28.9% APR

The asset is a clear financial promotion, prominently displaying the 28.9% APR and associated disclaimers for a Barclaycard. The conditions for the 10% and 50% discounts are clearly linked to using the Barclaycard or Barclays Premier card. All required disclosures for a credit promotion of this type appear to be present and adequately legible, contributing to a Green RAG status.

✓ No issues found.

Brand Agent - Amber

The proof effectively promotes the Barclaycard offer for the Capital Summertime Ball, utilizing clear messaging and consistent brand colors. The Barclaycard logo and associated branding are used correctly. All necessary disclaimers, including the APR and conditions for discounts, are present. To enhance user experience and ensure compliance, consider improving the legibility of the full terms and conditions.

Actionable Issues: While present, the full terms and conditions at the bottom of the image are very small and may be difficult for some users to read, potentially impacting accessibility and clarity.

Tone Agent - Amber

The advertisement effectively communicates the promotional offers and aligns well with a celebratory event tone. The main offer of discounts on food, drink, and programmes is clear and directly relevant to the event-goer. The prominent display of the APR also demonstrates a commitment to transparency, which is vital for a financial brand like Barclaycard. However, the readability of the critical terms and conditions is a significant area for improvement, as it hinders full transparency and could lead to customer frustration.

Version History Version 1 Workfront ID: #WF_44583-V1 2025-11-12

Agent weighting/decision logic via the moderator agent:

Export functionality: (P1)


OLIVER BARCLAYS

Navigation Barclays Q4 campaign - Proof overview and compliance status Actions
Mod Comms
📧 Home
📊 Campaigns
👤 WIP Reviewer
🤖 CopyGenAI
📊 Analytics
🔍 Auditing
⚙️ Settings
PROOF NAME WORKFRONT # CHANNEL SUB-CHANNEL PROOF TYPE OVERALL STATUS 📤 Export Campaign Report
Upload New Proof
IG Hero Post 1 V2 #WF_12823-V2 Social Instagram Feed Post Passed
👤 Steve O'Donoghue
OLIVER Agency

Single Proof PDF Export: (P1) o The system must provide a mechanism for the user to export a detailed feedback report for a single proof into a downloadable PDF file as an icon included against the asset row within the 'assets table'

Campaign PDF Export: (P2) o The system must provide a mechanism for the user to export a consolidated feedback report for all completed proofs within a campaign into a single downloadable PDF file.

Export Format o Report Cover Page: The exported PDF must include a cover page containing: ▪ Barclays and OLIVER Agency branding. ▪ A clear title (e.g., "AI Compliance & Brand Report"). ▪ The name of the campaign being reported on. ▪ The name of the specific proof (for single proof exports). ▪ The date the report was generated. o Report Content - Proof Details: Each proof section within the PDF must include: ▪ The proof's name and version number. ▪ A visual preview of the proof. ▪ The overall summary and final status from the Lead Agent. (P2) o Report Content - Agent Feedback: Each proof section must display the detailed analysis from all specialist agents, including: ▪ The agent's name. ▪ The RAG (Red, Amber, Green) status. ▪ The agent's full feedback text. ▪ A bulleted list of any specific, actionable issues identified.

Should Haves


OLIVER BARCLAYS

o Visual Feedback on Export: The UI should provide clear visual feedback to the user while a PDF is being generated, such as a loading spinner, and the export buttons should be disabled during this process.

o Professional Layout: The PDF report should have a clean, well-organized, and professional layout suitable for sharing with clients and internal stakeholders.

o Campaign Report Table of Contents: The campaign-level PDF report should begin with a Table of Contents that lists all the proofs included in the document for easier navigation.

o Clipboard Success Indicator: The "Export for Legal" feature should provide temporary visual confirmation that the text has been successfully copied (e.g., by changing the button text to "Copied to Clipboard!").

o Meaningful Filenames: The downloaded PDF files should have logical, descriptive filenames, such as Campaign_Name_Report.pdf.

Analytics Screen (P2)

Performance Analytics Overall usage and performance statistics for the tool.

Proofs Uploaded
57
Pass Rate
76%
Issues Found
34
Time Saved
93 hours

AI Performance Summary

Key Insight (Last 7 Days): Key insight text from feedback, providing guidance driven by proof from the Survey Q4 Email campaign. The Brand Guardian agent also shows a declining performance trend, suggesting a potential need for updated brand guideline training or email layout.

Agent Performance (Last 7 Days)

Agent Name Pass Rate Avg. Issues per Proof Performance Trend
Legal Agent 85% 1.2 Improving
Brand Agent 68% 2.5 Declining
Tone Agent 92% 0.8 Improving
Channel Agent 71% 1.9 Stable

[ ] Analytics Page Access: The "Analytics" section must be accessible from the main sidebar but must only be visible to "Admin" users. It must not be visible to "Basic" users

[ ] Overall Performance KPIs: The Analytics page must display a top-level summary of overall statistics.

[ ] KPI Metrics: This summary must include the following all-time metrics: o "Proofs Uploaded": A total count of all proofs uploaded to the tool. o "Pass Rate": A percentage calculation of assets that have passed versus failed. o "Issues Found": A total count of all issues identified by the AI agents. o "Time Saved": A metric presented in hours. ▪ "Time Saved" Calculation: This metric must be calculated based on the number of new versions created from AI feedback, representing the time saved by not having to involve the legal team for those revisions.

Steve O'Donoghue OLIVER Agency


OLIVER BARCLAYS

Auditing Screen (P2)

[Screenshot shows an auditing interface with a dark sidebar navigation menu on the left containing options like "Mod Comms", "Home", "Campaigns", "WIP Reviewer", "CopyGenAI", "Analytics", "Auditing", and "Settings". The main content area displays an "Auditing" page with the subtitle "Review and investigate all user-flagged feedback." There are three tabs visible: "Flags", "Resolutions", and "Errors". Below is a table with columns for "PROOF NAME", "PROOF VERSION", "SUBMITTER", "SUBMIT AGENCY", "AGENT FLAGGED", "USER COMMENTS", and "DATE". The table shows the message "There are currently no flagged items to audit."]

[ ] Auditing Page Access: The "Auditing" section must be accessible from the main sidebar and must only be available to "Admin" users.

[ ] Tabbed Navigation: The Auditing screen must be organized into three distinct tabs: "Flags," "Resolutions," and "Errors".

[ ] "Flags" Tab: o This tab must capture and display all items that users have "flagged" within the tool. o It must contain a table with the following columns: "PROOF NAME," "PROOF VERSION," "SUBMITTER," "SUBMIT AGENCY," "AGENT FLAGGED," "USER COMMENTS," and "DATE".

[ ] "Resolutions" Tab: o This tab must allow admins to review all issues that users have marked as "resolved". o It must contain a table with the following columns: "PROOF NAME," "PROOF VERSION," "SUBMITTER," "SUBMIT AGENCY," "AGENT," "AGENT ISSUE" (the issue found by the agent), "USER COMMENTS" (the user's resolution note), and "DATE".

[ ] "Errors" Tab: o This tab must log and display all assets that could not be assessed because the AI agents returned an error. o It must contain a table with the following columns: "PROOF NAME," "PROOF VERSION," "SUBMITTER," "SUBMIT AGENCY," "ERROR SUMMARY" (the error message shown to the user), and "DATE".


OLIVER BARCLAYS

Settings Screen (P1)

Settings Interface Screenshot showing:

Left Sidebar Navigation:

  • Mod Comms
  • Home
  • Campaigns
  • WIP Reviewer
  • CopyGenAI
  • Analytics
  • Auditing
  • Settings (highlighted)

Main Settings Panel:

  • Settings - Manage the dropdown options for proof configuration.

Mode

  • Manual ○ Automatic (Workfront)

Campaigns

  • New Campaign... [Add]
  • Barclays Q4 Social

Channels

  • New Channel... [Add]
  • Social

Sub-Channels

  • New Sub-Channel... [Add]
  • X.com
  • Instagram
  • Facebook

Proof Type Manager

  • Assign and manage specific proof types for each sub-channel.
  • Select a Sub-Channel to manage:
  • X.com
  • New Proof Type... [Add]
  • Tweet
  • Video Tweet

Footer: Steve O'Donoghue, OLIVER Agency


[ ] Settings Page Access: The "Settings" section must be accessible from the main sidebar and must only be available to "Admin" users.

[ ] Dropdown Configuration: The Settings page must allow admins to manage the selectable options available to basic users during campaign setup and asset upload.

[ ] Campaign Management: Admins must be able to add new campaign names to the list via a text field and "Add" button.

[ ] Channel Management: Admins must be able to add new channel names (e.g., "Social") to the list via a text field and "Add" button.

[ ] Sub-Channel Management: Admins must be able to add new sub-channel names (e.g., "Instagram," "Facebook") to the list via a text field and "Add" button.

[ ] Delete Functionality: For Campaigns, Channels, and Sub-Channels, admins must be able to delete an existing item from the list by hovering over it to reveal a delete button.

[ ] Proof Type Manager:

  • The page must have a "Proof Type Manager" section to manage proof types, which are dependent on sub-channels.
  • The admin must first select a "Sub-Channel" from a dropdown menu.
  • Upon selection, the system must display the proof types associated with that sub-channel.
  • The admin must be able to add (e.g., "Feed Post," "Tweet") and delete proof types for the selected sub-channel.

[ ] Dropdown Sync: Changes made in the Settings page must be reflected in the dropdowns shown to basic users during their workflows.

Staging and Production Environments (P1)


OLIVER BARCLAYS

2. Should Have

These are important features that add significant value but are not critical for the initial launch.

  • Analytics Screen
    • AI Key Insight Summary: The Analytics page should feature an "AI Performance Summary" section. This should be an AI-generated text summary that assesses weekly performance, notes trends, and provides insights (e.g., "sharp decline in best practice... suggesting a need for updated brand guideline training").
    • Agent Performance Table: The Analytics page should include a table titled "Agent Performance (Last 7 Days)".
    • Agent Table Contents: This table should list all available agents (e.g., "Legal Agent," "Brand Agent") and display the following metrics for each:
      • "Pass Rate": The agent's pass rate as a percentage.
      • "Avg. Issues Per Proof": The average number of issues that agent finds per uploaded proof.
    • Pass Rate Traffic Lights: The "Pass Rate" column in the agent table should use a traffic light color-coding system:
      • Green: for rates above 70%.
      • Yellow: for rates between 40% and 70%.
      • Red: for rates below 40%.

3. Could Have

These are desirable, "nice-to-have" features that can be added if time and resources permit.

  • Global
    • SSO Integration: Integration with Office 365 or Azure for single sign-on (SSO) and user management, as an alternative to the internal backend user store. (P1)
    • Expanded Modules: Future development of the "WIP Reviewer," "CopyGenAI," sections visible in the main navigation.
  • Analytics Screen
    • Agent Performance Trend: The "Agent Performance" table could include a "Performance Trend" column. This column would analyze the agent's pass rate week-on-week and display a status like "Improving," "Declining," or "Stable".

4. Won't Have (This Release)

These are features explicitly mentioned as out-of-scope for this version to manage expectations.


OLIVER BARCLAYS

  • Automatic Status Sync: There will be no automatic synchronization between the app and Workfront to pull project status. The "Completed" or "In Progress" status must be maintained manually within this application.
  • Workfront Link: Allowing the "Campaign ID" field to accept a direct URL link to a Workfront project, not just a text-based ID.
  • Expanded Modules: Future development of the "WIP Reviewer," "CopyGenAI," sections visible in the main navigation.
  • Settings Screen "Configuration Mode" - the Settings page could include a "Mode" toggle at the top, allowing an admin to switch the app's configuration source between "Manual" (using the settings on this page) and "Automatic (Workfront)".