fix(market): agent pagination and search errors

[ntindle]

Background

Search and pagination are currently broken for the marketplace due to issues with the responses not being clear on what needs to be paginated. Additionally, a migration was missed, so it is being re-added here, and the fixes are associated so the code passes lint.

Changes 🏗️

• Generalizes the pagination wrapper
  • this moves a lot of things from .agents, .analytics, .agent etc to .items
  • There is the one left for the /agent endpoint because it is unused and non-functional
• separates the search pagination from the top agents' pagination
• sets the default category filter to 1=1 where used always to insert a valid SQL query
• does additional logic around when we search short terms and are unable to rank them
• correctly count total responses in used queries, rather than returning the count of items in a response, which is useless for pagination
• return paginated items where required rather than lists of items
• non-testing (the tests fail and are out of date generated) CI added to prevent linting errors again in the future

Testing 🔍

Note

Only for the new autogpt platform, currently in autogpt_platform/

• Create from scratch and execute an agent with at least 3 blocks
• Import an agent from file upload, and confirm it executes correctly
• Upload agent to marketplace
• Import an agent from marketplace and confirm it executes correctly
• Edit an agent from monitor, and confirm it executes correctly

[qodo-merge-pro]

PR Reviewer Guide 🔍

Here are some key observations to aid the review process:

⏱️ Estimated effort to review: 4 🔵🔵🔵🔵⚪

🧪 No relevant tests

🔒 No security concerns identified

⚡ Recommended focus areas for review Performance Concern The search query in the search_db function might be inefficient for large datasets. Consider optimizing the query or implementing caching mechanisms. Potential Bug The get_top_agents_by_downloads function performs two separate database queries, which could lead to inconsistent results if the data changes between queries. Code Smell The Marketplace component has become quite complex with multiple state variables and useEffect hooks. Consider refactoring this component to improve readability and maintainability.