Skip to content

AI Moderation and Security Checks for Links with User Waiting Feedback #81

@Nkwenti-Severian-Ndongtsop

Description

  • Implement a comprehensive system to ensure all public links uploaded are safe, legal, and secure. The system will:
  • Run AI-powered moderation to detect illegal, explicit, or spammy content.
  • Perform security checks to validate URL format, protocol, and domain reputation.
  • Provide user feedback by showing a waiting indicator during the verification process.
  • Allow private links to bypass moderation with manual category assignment.
  • Sanitize metadata to prevent XSS or injection attacks.

✅ Goals

  • Extract metadata (title, description, URL) from submitted links.
  • Enforce URL validation to accept only well-formed HTTPS links.
  • Integrate domain reputation checks using APIs like Google Safe Browsing or VirusTotal.
  • Use AI moderation API (e.g., OpenAI Moderation) to analyze link content safety.
  • Block links flagged as unsafe (illegal, explicit, spam, phishing, etc.).
  • Sanitize metadata to prevent injection and XSS attacks on frontend and backend.
  • Provide clear error messages if a link is rejected.( real time display )
  • Delay acceptance of public links until all moderation and security checks complete.
  • Show a link on check message and continue to dashboard
  • Allow private links to bypass moderation and be manually categorized.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions