Skip to content

Commit

Permalink
Added default crawl-delay attribute to robots.txt
Browse files Browse the repository at this point in the history
  • Loading branch information
nicksantamaria committed Jan 10, 2025
1 parent c0195d7 commit e3b1475
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions packages/nuxt-ripple/robots.config.ts
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@ export default [
{ UserAgent: 'SemrushBot', Disallow: '/' },
{
UserAgent: '*',
CrawlDelay: 2,
Disallow: [
'/js',
'/img',
Expand Down

0 comments on commit e3b1475

Please sign in to comment.