laravel 简单限制搜索引擎爬虫频率

第一步安装爬虫校测库

composer require jaybizzle/laravel-crawler-detect

打开 App\Providers\RouteServiceProvider.php 文件

...
 protected function configureRateLimiting()
    {
        RateLimiter::for('api', function (Request $request) {
            return Limit::perMinute(60)->by(optional($request->user())->id ?: $request->ip());
        });

        // 增加内容，检测机器人关键代码
        RateLimiter::for('global', function (Request $request) {
            $key = $request->userAgent();
            if(Crawler::isCrawler()) {
                $key = "crawler";
            }

            // return Limit::perMinute(60)->by($key ?: $request->ip());

            return Crawler::isCrawler()
                ? Limit::perMinute(10)->by($key)
                : Limit::perMinute(100)->by($request->ip());
        });
    }
...

添加全局中间件 App\Http\Kernel.php

protected $middlewareGroups = [
        'web' => [
            \App\Http\Middleware\EncryptCookies::class,
            \Illuminate\Cookie\Middleware\AddQueuedCookiesToResponse::class,
            \Illuminate\Session\Middleware\StartSession::class,
            // \Illuminate\Session\Middleware\AuthenticateSession::class,
            \Illuminate\View\Middleware\ShareErrorsFromSession::class,
            \App\Http\Middleware\VerifyCsrfToken::class,
            \Illuminate\Routing\Middleware\SubstituteBindings::class,
            //            CollapseWhitespace::class,
            'throttle:global', // 这是我们上面的中间件，加到 web 路由全局中间件里
        ],

        'api' => [
            'throttle:api',
            \Illuminate\Routing\Middleware\SubstituteBindings::class,
        ],
    ];

本作品采用《CC 协议》，转载必须注明作者和本文链接