JobData/jobs_spider/qcwy/logs/log_2025-12-15.log

22 lines
3.4 KiB
Plaintext

2025-12-15 00:55:26.469 | INFO | __main__:crawl_recommend_jobs_main:911 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2025-12-15 00:55:26.502 | INFO | __main__:_init_client:323 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2025-12-15 00:55:26.601 | INFO | __main__:crawl_recommend_jobs_main:943 - 随机选择工作类型: 货运司机 (1831)
2025-12-15 00:55:26.601 | INFO | __main__:crawl_recommend_jobs_main:945 - 开始爬取推荐职位,最多 3 页
2025-12-15 00:55:26.601 | INFO | __main__:crawl_multiple_pages:803 - 正在爬取第 1 页...
2025-12-15 00:55:26.601 | INFO | __main__:_init_client:323 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2025-12-15 00:55:26.607 | INFO | __main__:get_recommend_jobs:512 - 获取推荐职位: 页码=1, 页大小=10, 地区=190300, 工作类型=1831
2025-12-15 00:55:26.694 | WARNING | __main__:_make_request:477 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2025-12-15 00:55:27.728 | WARNING | __main__:_make_request:477 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2025-12-15 00:55:29.766 | WARNING | __main__:_make_request:477 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2025-12-15 00:55:29.767 | ERROR | __main__:_make_request:503 - 所有重试失败,请求终止
2025-12-15 00:55:30.063 | INFO | __main__:_make_request:474 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1765731326 status=200 resp_size=52176
2025-12-15 00:55:30.064 | INFO | __main__:get_recommend_jobs:585 - 成功获取 10 个职位
2025-12-15 00:55:30.131 | INFO | __main__:_make_request:474 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169639008?api_key=51job&timestamp=1765731330 status=200 resp_size=5614
2025-12-15 00:55:30.202 | INFO | __main__:_make_request:474 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1765731330&companyId=10080947&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4186
2025-12-15 00:55:31.599 | INFO | __main__:_make_request:474 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169747067?api_key=51job&timestamp=1765731331 status=200 resp_size=5105
2025-12-15 00:55:31.660 | INFO | __main__:_make_request:474 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1765731331&companyId=9427865&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2743
2025-12-15 00:55:34.376 | INFO | __main__:_make_request:474 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162834418?api_key=51job&timestamp=1765731334 status=200 resp_size=5231
2025-12-15 00:55:34.451 | INFO | __main__:_make_request:474 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1765731334&companyId=9371694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2524
2025-12-15 00:55:35.084 | INFO | __main__:crawl_recommend_jobs_main:964 - 用户中断推荐职位爬取
2025-12-15 00:55:35.085 | INFO | __main__:close:878 - httpx客户端已关闭