JobData/jobs_spider/qcwy/logs/log_2026-01-15.log
2026-01-24 17:07:34 +08:00

8841 lines
1.8 MiB
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

2026-01-15 00:00:00.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768406400 status=200 resp_size=5017
2026-01-15 00:00:01.003 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406400&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:00:16.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job&timestamp=1768406406 status=200 resp_size=6688
2026-01-15 00:00:16.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406416&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
2026-01-15 00:00:23.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768406420 status=200 resp_size=5498
2026-01-15 00:00:25.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406423&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-15 00:00:31.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768406430 status=200 resp_size=6519
2026-01-15 00:00:31.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406431&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:00:35.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768406434 status=200 resp_size=6479
2026-01-15 00:00:35.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406435&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-15 00:00:42.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768406441 status=200 resp_size=5925
2026-01-15 00:00:42.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406442&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
2026-01-15 00:00:45.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768406445 status=200 resp_size=7762
2026-01-15 00:00:45.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406445&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 00:00:49.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job&timestamp=1768406449 status=200 resp_size=5700
2026-01-15 00:00:50.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406449&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:00:52.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768406451 status=200 resp_size=7971
2026-01-15 00:00:52.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406452&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 00:00:55.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768406455 status=200 resp_size=8331
2026-01-15 00:00:55.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406455&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-15 00:01:00.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job&timestamp=1768406460 status=200 resp_size=5424
2026-01-15 00:01:00.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406460&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
2026-01-15 00:01:04.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768406464 status=200 resp_size=8465
2026-01-15 00:01:04.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406464&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:01:14.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768406472 status=200 resp_size=8995
2026-01-15 00:01:14.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406474&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
2026-01-15 00:01:22.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768406482 status=200 resp_size=6706
2026-01-15 00:01:23.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406482&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-15 00:01:23.084 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 19
2026-01-15 00:01:29.251 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 00:01:29.251 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-15 00:01:37.440 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.17 秒后继续...
2026-01-15 00:01:37.440 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-15 00:01:37.441 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:01:37.471 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:01:43.948 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:01:45.127 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:01:47.372 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:01:47.372 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:02:03.978 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768406497 status=200 resp_size=135913
2026-01-15 00:02:03.978 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 2 个重复职位(已跳过)
2026-01-15 00:02:03.978 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 18 | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:02:06.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768406523 status=200 resp_size=6080
2026-01-15 00:02:06.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406526&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 00:02:32.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768406533 status=200 resp_size=4916
2026-01-15 00:02:45.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406552&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 00:02:52.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job&timestamp=1768406571 status=200 resp_size=5442
2026-01-15 00:02:52.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406572&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:02:57.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768406577 status=200 resp_size=6083
2026-01-15 00:02:57.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406577&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 00:03:05.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768406583 status=200 resp_size=6512
2026-01-15 00:03:06.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406585&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
2026-01-15 00:03:07.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768406587 status=200 resp_size=6243
2026-01-15 00:03:08.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406587&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-15 00:03:10.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768406589 status=200 resp_size=6174
2026-01-15 00:03:12.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406590&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:03:21.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768406600 status=200 resp_size=5691
2026-01-15 00:03:21.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406601&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5013
2026-01-15 00:03:25.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job&timestamp=1768406605 status=200 resp_size=5602
2026-01-15 00:03:26.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406605&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 00:03:34.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768406613 status=200 resp_size=5761
2026-01-15 00:03:34.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406614&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-15 00:03:41.106 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768406620 status=200 resp_size=5810
2026-01-15 00:03:41.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406621&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:03:50.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768406630 status=200 resp_size=6552
2026-01-15 00:03:51.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406630&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 00:03:58.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768406638 status=200 resp_size=8622
2026-01-15 00:03:58.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406638&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
2026-01-15 00:04:03.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768406643 status=200 resp_size=8723
2026-01-15 00:04:03.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406643&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-15 00:04:11.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768406651 status=200 resp_size=6017
2026-01-15 00:04:11.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406651&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-15 00:04:13.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job&timestamp=1768406653 status=200 resp_size=7941
2026-01-15 00:04:13.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406653&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
2026-01-15 00:04:23.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job&timestamp=1768406662 status=200 resp_size=7589
2026-01-15 00:04:23.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406663&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
2026-01-15 00:04:28.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768406668 status=200 resp_size=5284
2026-01-15 00:04:29.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406668&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 00:04:29.066 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 18
2026-01-15 00:04:34.731 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-15 00:04:34.731 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-15 00:04:36.557 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.82 秒后继续...
2026-01-15 00:04:36.557 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-15 00:04:36.557 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:04:36.586 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:04:37.234 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:04:38.390 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:04:40.570 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:04:40.570 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:04:41.042 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768406676 status=200 resp_size=134458
2026-01-15 00:04:41.042 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
2026-01-15 00:04:41.042 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:04:41.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job&timestamp=1768406681 status=200 resp_size=6680
2026-01-15 00:04:41.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406681&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 00:04:49.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768406689 status=200 resp_size=5408
2026-01-15 00:04:49.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406689&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-15 00:04:58.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job&timestamp=1768406696 status=200 resp_size=6647
2026-01-15 00:04:58.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406698&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
2026-01-15 00:05:01.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768406701 status=200 resp_size=5289
2026-01-15 00:05:02.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406701&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-15 00:05:10.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768406709 status=200 resp_size=6302
2026-01-15 00:05:10.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406710&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 00:05:19.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768406718 status=200 resp_size=5924
2026-01-15 00:05:19.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406719&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-15 00:05:29.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768406728 status=200 resp_size=6021
2026-01-15 00:05:29.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406729&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-15 00:05:35.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768406734 status=200 resp_size=5728
2026-01-15 00:05:35.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406735&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-15 00:05:44.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768406743 status=200 resp_size=5396
2026-01-15 00:05:44.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406744&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-15 00:05:48.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768406748 status=200 resp_size=5082
2026-01-15 00:05:48.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406748&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:05:57.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job&timestamp=1768406756 status=200 resp_size=13285
2026-01-15 00:05:57.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406757&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 00:06:04.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768406763 status=200 resp_size=6876
2026-01-15 00:06:04.384 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406764&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 00:06:10.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job&timestamp=1768406769 status=200 resp_size=6059
2026-01-15 00:06:10.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406770&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
2026-01-15 00:06:14.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768406774 status=200 resp_size=5280
2026-01-15 00:06:14.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406774&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 00:06:22.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768406782 status=200 resp_size=9513
2026-01-15 00:06:23.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406782&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 00:06:28.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768406787 status=200 resp_size=6588
2026-01-15 00:06:28.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406788&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 00:06:35.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job&timestamp=1768406793 status=200 resp_size=8070
2026-01-15 00:06:35.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406795&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 00:06:40.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job&timestamp=1768406799 status=200 resp_size=6342
2026-01-15 00:06:41.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406800&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
2026-01-15 00:06:45.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768406805 status=200 resp_size=6091
2026-01-15 00:06:45.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406805&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 00:06:45.802 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
2026-01-15 00:06:51.626 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 00:06:51.626 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-15 00:06:58.506 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.87 秒后继续...
2026-01-15 00:06:58.506 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-15 00:06:58.506 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:06:58.531 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:06:59.300 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:07:00.461 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:07:02.643 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:07:02.643 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:07:03.303 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768406818 status=200 resp_size=129273
2026-01-15 00:07:03.303 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:07:03.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768406823 status=200 resp_size=5357
2026-01-15 00:07:03.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406823&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 00:07:15.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job&timestamp=1768406831 status=200 resp_size=4656
2026-01-15 00:07:15.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406835&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
2026-01-15 00:07:23.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768406842 status=200 resp_size=5014
2026-01-15 00:07:23.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406843&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-15 00:07:30.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768406849 status=200 resp_size=7224
2026-01-15 00:07:30.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406850&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-15 00:07:36.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768406855 status=200 resp_size=5584
2026-01-15 00:07:36.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406856&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:07:40.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768406860 status=200 resp_size=5070
2026-01-15 00:07:40.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406860&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-15 00:07:42.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768406861 status=200 resp_size=4986
2026-01-15 00:07:42.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406862&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:07:47.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768406866 status=200 resp_size=6774
2026-01-15 00:07:47.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406867&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 00:07:55.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768406874 status=200 resp_size=5883
2026-01-15 00:07:55.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406875&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-15 00:08:04.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job&timestamp=1768406884 status=200 resp_size=5165
2026-01-15 00:08:05.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406884&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
2026-01-15 00:08:07.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768406887 status=200 resp_size=5732
2026-01-15 00:08:07.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406887&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 00:08:18.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768406897 status=200 resp_size=7569
2026-01-15 00:08:18.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406898&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-15 00:08:25.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768406904 status=200 resp_size=8202
2026-01-15 00:08:25.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406905&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-15 00:08:31.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768406910 status=200 resp_size=6980
2026-01-15 00:08:31.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406911&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 00:08:41.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768406920 status=200 resp_size=5313
2026-01-15 00:08:41.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406921&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:08:45.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768406925 status=200 resp_size=5498
2026-01-15 00:08:46.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406925&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-15 00:08:55.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job&timestamp=1768406934 status=200 resp_size=4643
2026-01-15 00:08:55.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406935&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
2026-01-15 00:09:05.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job&timestamp=1768406944 status=200 resp_size=5590
2026-01-15 00:09:05.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406945&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
2026-01-15 00:09:07.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768406947 status=200 resp_size=5700
2026-01-15 00:09:07.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406947&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
2026-01-15 00:09:14.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768406953 status=200 resp_size=6288
2026-01-15 00:09:14.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406954&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 00:09:14.600 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
2026-01-15 00:09:14.945 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:09:14.945 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-15 00:09:21.825 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.87 秒后继续...
2026-01-15 00:09:21.825 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-15 00:09:21.825 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:09:21.847 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:09:22.400 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:09:23.534 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:09:25.656 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:09:25.656 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:09:26.111 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768406961 status=200 resp_size=163072
2026-01-15 00:09:26.111 | WARNING | __main__:get_recommend_jobs:745 - 第 13 页发现 1 个重复职位(已跳过)
2026-01-15 00:09:26.111 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:09:26.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job&timestamp=1768406966 status=200 resp_size=6627
2026-01-15 00:09:26.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406966&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
2026-01-15 00:09:36.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job&timestamp=1768406976 status=200 resp_size=7987
2026-01-15 00:09:37.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406976&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
2026-01-15 00:09:46.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job&timestamp=1768406985 status=200 resp_size=6002
2026-01-15 00:09:46.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406986&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 00:09:51.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768406990 status=200 resp_size=7243
2026-01-15 00:09:51.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768406991&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 00:10:01.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job&timestamp=1768407000 status=200 resp_size=5600
2026-01-15 00:10:01.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407001&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 00:10:06.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768407006 status=200 resp_size=6935
2026-01-15 00:10:06.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407006&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-15 00:10:09.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job&timestamp=1768407009 status=200 resp_size=5942
2026-01-15 00:10:09.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407009&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
2026-01-15 00:10:17.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768407016 status=200 resp_size=6602
2026-01-15 00:10:17.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407017&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-15 00:10:21.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job&timestamp=1768407021 status=200 resp_size=6027
2026-01-15 00:10:21.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407021&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
2026-01-15 00:10:23.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job&timestamp=1768407023 status=200 resp_size=6079
2026-01-15 00:10:23.606 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407023&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 00:10:26.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768407026 status=200 resp_size=6264
2026-01-15 00:10:27.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407026&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-15 00:10:30.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job&timestamp=1768407029 status=200 resp_size=5277
2026-01-15 00:10:30.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407030&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
2026-01-15 00:10:39.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768407038 status=200 resp_size=6138
2026-01-15 00:10:39.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407039&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
2026-01-15 00:10:48.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768407047 status=200 resp_size=6522
2026-01-15 00:10:48.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407048&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 00:10:51.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768407050 status=200 resp_size=7299
2026-01-15 00:10:51.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407051&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-15 00:10:55.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768407055 status=200 resp_size=8800
2026-01-15 00:10:55.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407055&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 00:11:06.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768407065 status=200 resp_size=6727
2026-01-15 00:11:06.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407066&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
2026-01-15 00:11:10.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768407070 status=200 resp_size=8688
2026-01-15 00:11:10.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407070&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-15 00:11:17.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job&timestamp=1768407077 status=200 resp_size=6462
2026-01-15 00:11:18.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407077&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
2026-01-15 00:11:18.136 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 19
2026-01-15 00:11:24.128 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 00:11:24.128 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-15 00:11:28.451 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.32 秒后继续...
2026-01-15 00:11:28.451 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-15 00:11:28.451 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:11:28.464 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:11:29.083 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:11:30.253 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:11:32.394 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:11:32.394 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:11:32.835 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407088 status=200 resp_size=132780
2026-01-15 00:11:32.835 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:11:33.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768407092 status=200 resp_size=7907
2026-01-15 00:11:33.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407093&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-15 00:11:39.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768407098 status=200 resp_size=5872
2026-01-15 00:11:39.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407099&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 00:11:43.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768407103 status=200 resp_size=5922
2026-01-15 00:11:43.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407103&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 00:11:54.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job&timestamp=1768407113 status=200 resp_size=6455
2026-01-15 00:11:55.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407114&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 00:11:57.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768407117 status=200 resp_size=6659
2026-01-15 00:11:58.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407117&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 00:12:00.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768407119 status=200 resp_size=5182
2026-01-15 00:12:00.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407120&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-15 00:12:04.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768407124 status=200 resp_size=7340
2026-01-15 00:12:05.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407124&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-15 00:12:12.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job&timestamp=1768407131 status=200 resp_size=7014
2026-01-15 00:12:12.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407132&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
2026-01-15 00:12:21.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job&timestamp=1768407141 status=200 resp_size=6569
2026-01-15 00:12:22.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407141&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
2026-01-15 00:12:24.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job&timestamp=1768407143 status=200 resp_size=5499
2026-01-15 00:12:24.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407144&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
2026-01-15 00:12:34.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768407154 status=200 resp_size=6166
2026-01-15 00:12:35.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407154&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-15 00:12:45.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768407164 status=200 resp_size=5673
2026-01-15 00:12:45.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407165&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-15 00:12:49.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768407168 status=200 resp_size=7116
2026-01-15 00:12:49.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407169&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 00:12:50.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768407170 status=200 resp_size=7664
2026-01-15 00:12:50.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407170&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 00:13:00.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768407177 status=200 resp_size=6652
2026-01-15 00:13:01.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407180&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-15 00:13:11.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768407191 status=200 resp_size=4737
2026-01-15 00:13:11.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407191&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:13:17.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768407196 status=200 resp_size=4926
2026-01-15 00:13:17.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407197&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 00:13:21.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768407201 status=200 resp_size=4902
2026-01-15 00:13:21.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407201&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 00:13:24.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job&timestamp=1768407203 status=200 resp_size=7399
2026-01-15 00:13:24.385 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407204&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 00:13:29.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768407209 status=200 resp_size=4825
2026-01-15 00:13:29.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407209&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:13:29.604 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
2026-01-15 00:13:35.434 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:13:35.434 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-15 00:13:44.982 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.54 秒后继续...
2026-01-15 00:13:44.982 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-15 00:13:44.983 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:13:44.988 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:13:45.726 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:13:46.888 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:13:49.305 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:13:49.305 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:13:50.389 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407224 status=200 resp_size=134824
2026-01-15 00:13:50.389 | WARNING | __main__:get_recommend_jobs:745 - 第 15 页发现 1 个重复职位(已跳过)
2026-01-15 00:13:50.389 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:13:51.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768407230 status=200 resp_size=5006
2026-01-15 00:13:52.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407231&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 00:13:58.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768407237 status=200 resp_size=5363
2026-01-15 00:13:58.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407238&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-15 00:13:59.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768407239 status=200 resp_size=5259
2026-01-15 00:13:59.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407239&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-15 00:14:04.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768407244 status=200 resp_size=5312
2026-01-15 00:14:04.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407244&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 00:14:08.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768407248 status=200 resp_size=5262
2026-01-15 00:14:08.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407248&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-15 00:14:10.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job&timestamp=1768407249 status=200 resp_size=6972
2026-01-15 00:14:10.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407250&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
2026-01-15 00:14:13.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768407253 status=200 resp_size=4974
2026-01-15 00:14:13.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407253&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:14:15.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768407255 status=200 resp_size=7412
2026-01-15 00:14:16.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407255&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 00:14:18.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768407258 status=200 resp_size=7364
2026-01-15 00:14:18.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407258&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 00:14:27.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job&timestamp=1768407266 status=200 resp_size=5105
2026-01-15 00:14:27.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407267&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
2026-01-15 00:14:36.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768407275 status=200 resp_size=4537
2026-01-15 00:14:36.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407276&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-15 00:14:38.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768407278 status=200 resp_size=4865
2026-01-15 00:14:38.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407278&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-15 00:14:40.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768407280 status=200 resp_size=5409
2026-01-15 00:14:40.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407280&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-15 00:14:51.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768407290 status=200 resp_size=6333
2026-01-15 00:14:51.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407291&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 00:15:02.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768407301 status=200 resp_size=5668
2026-01-15 00:15:02.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407302&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 00:15:11.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768407311 status=200 resp_size=6169
2026-01-15 00:15:12.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407311&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-15 00:15:13.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768407313 status=200 resp_size=5470
2026-01-15 00:15:13.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407313&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 00:15:21.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768407321 status=200 resp_size=5725
2026-01-15 00:15:22.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407321&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-15 00:15:32.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job&timestamp=1768407331 status=200 resp_size=4737
2026-01-15 00:15:32.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407332&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 00:15:32.609 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 19
2026-01-15 00:15:38.258 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 00:15:38.258 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-15 00:15:44.088 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.82 秒后继续...
2026-01-15 00:15:44.088 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 16/26 页...
2026-01-15 00:15:44.088 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:15:44.111 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:15:44.755 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:15:45.901 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:15:48.038 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:15:48.038 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:15:48.512 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407344 status=200 resp_size=129714
2026-01-15 00:15:48.512 | WARNING | __main__:get_recommend_jobs:745 - 第 16 页发现 2 个重复职位(已跳过)
2026-01-15 00:15:48.512 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 18 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:15:48.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job&timestamp=1768407348 status=200 resp_size=4332
2026-01-15 00:15:48.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407348&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
2026-01-15 00:15:58.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768407357 status=200 resp_size=5139
2026-01-15 00:15:58.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407358&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:16:00.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768407360 status=200 resp_size=5740
2026-01-15 00:16:00.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407360&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 00:16:03.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768407362 status=200 resp_size=6326
2026-01-15 00:16:03.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407363&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 00:16:05.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768407365 status=200 resp_size=7248
2026-01-15 00:16:05.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407365&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 00:16:12.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768407371 status=200 resp_size=5483
2026-01-15 00:16:12.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407372&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 00:16:14.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job&timestamp=1768407374 status=200 resp_size=5063
2026-01-15 00:16:14.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407374&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 00:16:17.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job&timestamp=1768407377 status=200 resp_size=5631
2026-01-15 00:16:17.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407377&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 00:16:20.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768407380 status=200 resp_size=5991
2026-01-15 00:16:20.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407380&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-15 00:16:30.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768407389 status=200 resp_size=5928
2026-01-15 00:16:30.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407390&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 00:16:39.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768407398 status=200 resp_size=6317
2026-01-15 00:16:39.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407399&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-15 00:16:46.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job&timestamp=1768407405 status=200 resp_size=5524
2026-01-15 00:16:46.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407406&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 00:16:48.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768407408 status=200 resp_size=5204
2026-01-15 00:16:48.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407408&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-15 00:16:50.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768407410 status=200 resp_size=4654
2026-01-15 00:16:50.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407410&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-15 00:16:54.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job&timestamp=1768407414 status=200 resp_size=7075
2026-01-15 00:16:54.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407414&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
2026-01-15 00:17:00.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768407420 status=200 resp_size=6576
2026-01-15 00:17:00.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407420&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-15 00:17:07.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768407426 status=200 resp_size=4772
2026-01-15 00:17:07.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407427&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 00:17:13.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768407433 status=200 resp_size=5389
2026-01-15 00:17:14.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407433&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:17:14.151 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 18
2026-01-15 00:17:14.512 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-15 00:17:14.512 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-15 00:17:21.637 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.12 秒后继续...
2026-01-15 00:17:21.637 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 17/26 页...
2026-01-15 00:17:21.637 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:17:21.652 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:17:22.248 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:17:23.379 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:17:25.527 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:17:25.527 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:17:26.000 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407441 status=200 resp_size=130025
2026-01-15 00:17:26.000 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:17:26.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job&timestamp=1768407446 status=200 resp_size=6325
2026-01-15 00:17:26.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407446&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 00:17:32.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768407451 status=200 resp_size=6103
2026-01-15 00:17:32.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407452&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-15 00:17:40.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768407459 status=200 resp_size=5106
2026-01-15 00:17:40.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407460&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
2026-01-15 00:17:47.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768407466 status=200 resp_size=5328
2026-01-15 00:17:47.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407467&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-15 00:17:57.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768407477 status=200 resp_size=5141
2026-01-15 00:17:57.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407477&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 00:18:05.585 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job&timestamp=1768407484 status=200 resp_size=5935
2026-01-15 00:18:05.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407485&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 00:18:13.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job&timestamp=1768407492 status=200 resp_size=6001
2026-01-15 00:18:13.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407493&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
2026-01-15 00:18:14.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768407494 status=200 resp_size=5304
2026-01-15 00:18:14.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407494&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 00:18:23.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768407502 status=200 resp_size=4719
2026-01-15 00:18:23.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407503&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-15 00:18:29.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job&timestamp=1768407509 status=200 resp_size=7754
2026-01-15 00:18:29.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407509&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 00:18:32.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768407512 status=200 resp_size=6686
2026-01-15 00:18:32.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407512&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 00:18:34.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job&timestamp=1768407514 status=200 resp_size=5693
2026-01-15 00:18:35.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407514&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:18:43.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job&timestamp=1768407523 status=200 resp_size=5316
2026-01-15 00:18:44.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407523&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:18:50.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job&timestamp=1768407530 status=200 resp_size=5989
2026-01-15 00:18:51.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407530&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
2026-01-15 00:18:54.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768407534 status=200 resp_size=5335
2026-01-15 00:18:54.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407534&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:18:59.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768407539 status=200 resp_size=5236
2026-01-15 00:18:59.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407539&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:19:03.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768407543 status=200 resp_size=4798
2026-01-15 00:19:03.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407543&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-15 00:19:12.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768407550 status=200 resp_size=5591
2026-01-15 00:19:12.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407552&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:19:21.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768407561 status=200 resp_size=5870
2026-01-15 00:19:21.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407561&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 00:19:23.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768407563 status=200 resp_size=5360
2026-01-15 00:19:23.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407563&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-15 00:19:23.552 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
2026-01-15 00:19:23.912 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:19:23.912 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-15 00:19:27.360 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.45 秒后继续...
2026-01-15 00:19:27.360 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 18/26 页...
2026-01-15 00:19:27.360 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:19:27.381 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:19:28.008 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:19:29.140 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:19:31.288 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:19:31.288 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:19:31.774 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407567 status=200 resp_size=130142
2026-01-15 00:19:31.774 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:19:31.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768407571 status=200 resp_size=5677
2026-01-15 00:19:32.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407571&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 00:19:38.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job&timestamp=1768407577 status=200 resp_size=5317
2026-01-15 00:19:38.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407578&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:19:41.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job&timestamp=1768407580 status=200 resp_size=5668
2026-01-15 00:19:41.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407581&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 00:19:43.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768407582 status=200 resp_size=4333
2026-01-15 00:19:43.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407583&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-15 00:19:45.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768407585 status=200 resp_size=6284
2026-01-15 00:19:45.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407585&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-15 00:19:48.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768407588 status=200 resp_size=5510
2026-01-15 00:19:48.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407588&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:19:52.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768407592 status=200 resp_size=5151
2026-01-15 00:19:52.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407592&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:19:55.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768407595 status=200 resp_size=5511
2026-01-15 00:19:56.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407595&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-15 00:20:00.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768407599 status=200 resp_size=6484
2026-01-15 00:20:00.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407600&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 00:20:10.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768407609 status=200 resp_size=8675
2026-01-15 00:20:10.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407610&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-15 00:20:18.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job&timestamp=1768407617 status=200 resp_size=5968
2026-01-15 00:20:18.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407618&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-15 00:20:27.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768407627 status=200 resp_size=8440
2026-01-15 00:20:27.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407627&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
2026-01-15 00:20:37.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768407637 status=200 resp_size=6514
2026-01-15 00:20:37.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407637&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 00:20:46.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job&timestamp=1768407645 status=200 resp_size=5227
2026-01-15 00:20:46.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407646&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 00:20:54.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job&timestamp=1768407653 status=200 resp_size=6408
2026-01-15 00:20:54.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407654&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
2026-01-15 00:21:05.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768407661 status=200 resp_size=6062
2026-01-15 00:21:07.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407665&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-15 00:21:16.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768407674 status=200 resp_size=5708
2026-01-15 00:21:16.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407676&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 00:21:24.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job&timestamp=1768407682 status=200 resp_size=5449
2026-01-15 00:21:24.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407684&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 00:21:31.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768407690 status=200 resp_size=6979
2026-01-15 00:21:31.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407691&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 00:21:34.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768407693 status=200 resp_size=5846
2026-01-15 00:21:34.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407694&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 00:21:34.285 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
2026-01-15 00:21:34.630 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:21:34.630 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-15 00:21:39.476 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.84 秒后继续...
2026-01-15 00:21:39.476 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 19/26 页...
2026-01-15 00:21:39.476 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:21:39.497 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:21:40.094 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:21:41.240 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:21:43.375 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:21:43.375 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:21:43.751 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407699 status=200 resp_size=107988
2026-01-15 00:21:43.751 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:21:43.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768407703 status=200 resp_size=5494
2026-01-15 00:21:44.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407703&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 00:21:54.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768407713 status=200 resp_size=5845
2026-01-15 00:21:54.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407714&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 00:21:56.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768407716 status=200 resp_size=6139
2026-01-15 00:21:56.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407716&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 00:21:58.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768407718 status=200 resp_size=5603
2026-01-15 00:21:58.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407718&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 00:22:05.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768407725 status=200 resp_size=5632
2026-01-15 00:22:06.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407725&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-15 00:22:12.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768407731 status=200 resp_size=6222
2026-01-15 00:22:12.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407732&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 00:22:18.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job&timestamp=1768407738 status=200 resp_size=7752
2026-01-15 00:22:19.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407738&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 00:22:23.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768407742 status=200 resp_size=5400
2026-01-15 00:22:23.655 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407743&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 00:22:31.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768407749 status=200 resp_size=5846
2026-01-15 00:22:31.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407751&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 00:22:34.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768407754 status=200 resp_size=4627
2026-01-15 00:22:34.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407754&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 00:22:50.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768407763 status=200 resp_size=6085
2026-01-15 00:22:50.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407770&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:22:51.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768407771 status=200 resp_size=6328
2026-01-15 00:22:52.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407771&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-15 00:23:01.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768407780 status=200 resp_size=6899
2026-01-15 00:23:01.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407781&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 00:23:05.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768407785 status=200 resp_size=5290
2026-01-15 00:23:05.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407785&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 00:23:09.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768407789 status=200 resp_size=5974
2026-01-15 00:23:09.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407789&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:23:14.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768407794 status=200 resp_size=6423
2026-01-15 00:23:15.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407794&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 00:23:19.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768407799 status=200 resp_size=6508
2026-01-15 00:23:19.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407799&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-15 00:23:29.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768407809 status=200 resp_size=6214
2026-01-15 00:23:29.823 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407809&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-15 00:23:37.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768407817 status=200 resp_size=6073
2026-01-15 00:23:37.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407817&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:23:41.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768407821 status=200 resp_size=5526
2026-01-15 00:23:41.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407821&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-15 00:23:41.484 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
2026-01-15 00:23:41.751 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:23:41.751 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-15 00:23:50.770 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.01 秒后继续...
2026-01-15 00:23:50.770 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 20/26 页...
2026-01-15 00:23:50.770 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:23:50.790 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:23:51.356 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:23:52.520 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:23:54.651 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:23:54.651 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:23:55.075 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407830 status=200 resp_size=106143
2026-01-15 00:23:55.075 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:23:55.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768407835 status=200 resp_size=6821
2026-01-15 00:23:55.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407835&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-15 00:24:02.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768407841 status=200 resp_size=5827
2026-01-15 00:24:02.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407842&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 00:24:08.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768407847 status=200 resp_size=4780
2026-01-15 00:24:08.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407848&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:24:10.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768407850 status=200 resp_size=7006
2026-01-15 00:24:11.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407850&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-15 00:24:13.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768407853 status=200 resp_size=5431
2026-01-15 00:24:13.718 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407853&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 00:24:21.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768407861 status=200 resp_size=6066
2026-01-15 00:24:22.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407861&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 00:24:26.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768407866 status=200 resp_size=5541
2026-01-15 00:24:26.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407866&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 00:24:29.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768407869 status=200 resp_size=6075
2026-01-15 00:24:29.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407869&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-15 00:24:31.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job&timestamp=1768407871 status=200 resp_size=5879
2026-01-15 00:24:31.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407871&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 00:24:33.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job&timestamp=1768407873 status=200 resp_size=4867
2026-01-15 00:24:33.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407873&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:24:42.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768407881 status=200 resp_size=5379
2026-01-15 00:24:42.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407882&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 00:24:46.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768407886 status=200 resp_size=5635
2026-01-15 00:24:46.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407886&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 00:24:49.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job&timestamp=1768407889 status=200 resp_size=5496
2026-01-15 00:24:50.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407889&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 00:24:53.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768407892 status=200 resp_size=6286
2026-01-15 00:24:53.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407893&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 00:25:01.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job&timestamp=1768407900 status=200 resp_size=6128
2026-01-15 00:25:01.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407901&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-15 00:25:07.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768407906 status=200 resp_size=6326
2026-01-15 00:25:07.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407907&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-15 00:25:10.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768407910 status=200 resp_size=5398
2026-01-15 00:25:10.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407910&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 00:25:14.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768407914 status=200 resp_size=5324
2026-01-15 00:25:15.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407914&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:25:19.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768407919 status=200 resp_size=5978
2026-01-15 00:25:19.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407919&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-15 00:25:22.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768407922 status=200 resp_size=5662
2026-01-15 00:25:22.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407922&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
2026-01-15 00:25:22.613 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
2026-01-15 00:25:27.959 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:25:27.960 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-15 00:25:35.409 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.45 秒后继续...
2026-01-15 00:25:35.409 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 21/26 页...
2026-01-15 00:25:35.409 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:25:35.436 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:25:36.007 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:25:37.149 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:25:39.296 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:25:39.296 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:25:39.767 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768407935 status=200 resp_size=126687
2026-01-15 00:25:39.767 | WARNING | __main__:get_recommend_jobs:745 - 第 21 页发现 1 个重复职位(已跳过)
2026-01-15 00:25:39.767 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:25:39.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job&timestamp=1768407939 status=200 resp_size=5833
2026-01-15 00:25:40.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407939&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
2026-01-15 00:25:47.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768407947 status=200 resp_size=6131
2026-01-15 00:25:47.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407947&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-15 00:25:50.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768407950 status=200 resp_size=6106
2026-01-15 00:25:50.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407950&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:25:53.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job&timestamp=1768407953 status=200 resp_size=5981
2026-01-15 00:25:54.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407953&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 00:26:03.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768407962 status=200 resp_size=6219
2026-01-15 00:26:03.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407963&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-15 00:26:05.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768407965 status=200 resp_size=6036
2026-01-15 00:26:06.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407965&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 00:26:07.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768407967 status=200 resp_size=5675
2026-01-15 00:26:07.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407967&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:26:11.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768407971 status=200 resp_size=5849
2026-01-15 00:26:12.116 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407971&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 00:26:16.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768407975 status=200 resp_size=6356
2026-01-15 00:26:16.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407976&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:26:26.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768407985 status=200 resp_size=6351
2026-01-15 00:26:26.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407986&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-15 00:26:31.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768407990 status=200 resp_size=5829
2026-01-15 00:26:31.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768407991&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 00:26:41.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768408000 status=200 resp_size=6497
2026-01-15 00:26:41.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408001&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:26:49.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768408008 status=200 resp_size=6113
2026-01-15 00:26:49.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408009&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 00:26:59.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768408018 status=200 resp_size=5095
2026-01-15 00:26:59.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408019&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-15 00:27:09.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768408027 status=200 resp_size=5107
2026-01-15 00:27:09.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408029&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-15 00:27:15.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768408034 status=200 resp_size=5473
2026-01-15 00:27:15.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408035&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:27:20.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768408040 status=200 resp_size=6385
2026-01-15 00:27:20.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408040&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 00:27:21.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job&timestamp=1768408041 status=200 resp_size=4774
2026-01-15 00:27:22.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408041&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
2026-01-15 00:27:25.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job&timestamp=1768408045 status=200 resp_size=5463
2026-01-15 00:27:25.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408045&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 00:27:25.933 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 19
2026-01-15 00:27:31.754 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 00:27:31.754 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-15 00:27:41.198 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.43 秒后继续...
2026-01-15 00:27:41.198 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 22/26 页...
2026-01-15 00:27:41.198 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:27:41.220 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:27:41.722 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:27:42.837 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:27:44.936 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:27:44.936 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:27:45.423 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408061 status=200 resp_size=135902
2026-01-15 00:27:45.423 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:27:45.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768408065 status=200 resp_size=6074
2026-01-15 00:27:45.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408065&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:27:46.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768408066 status=200 resp_size=6963
2026-01-15 00:27:47.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408066&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 00:27:50.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768408070 status=200 resp_size=5448
2026-01-15 00:27:50.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408070&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 00:27:52.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768408072 status=200 resp_size=6053
2026-01-15 00:27:52.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408072&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 00:27:57.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job&timestamp=1768408076 status=200 resp_size=5503
2026-01-15 00:27:57.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408077&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:28:00.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768408080 status=200 resp_size=7079
2026-01-15 00:28:00.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408080&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 00:28:06.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job&timestamp=1768408086 status=200 resp_size=5197
2026-01-15 00:28:07.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408086&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:28:14.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768408093 status=200 resp_size=7337
2026-01-15 00:28:14.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408094&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 00:28:18.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768408097 status=200 resp_size=5321
2026-01-15 00:28:18.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408098&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:28:30.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768408106 status=200 resp_size=6216
2026-01-15 00:28:31.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408110&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 00:28:42.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768408121 status=200 resp_size=5703
2026-01-15 00:28:42.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408122&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:28:44.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job&timestamp=1768408124 status=200 resp_size=5924
2026-01-15 00:28:44.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408124&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 00:28:48.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768408128 status=200 resp_size=5188
2026-01-15 00:28:48.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408128&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:28:49.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768408129 status=200 resp_size=6266
2026-01-15 00:28:50.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408129&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-15 00:28:52.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768408131 status=200 resp_size=4841
2026-01-15 00:28:52.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408132&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:28:57.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768408137 status=200 resp_size=6310
2026-01-15 00:28:57.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408137&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 00:29:02.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768408142 status=200 resp_size=5373
2026-01-15 00:29:02.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408142&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:29:04.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768408144 status=200 resp_size=5112
2026-01-15 00:29:05.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408144&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:29:13.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768408151 status=200 resp_size=6150
2026-01-15 00:29:13.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408153&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 00:29:23.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768408162 status=200 resp_size=4861
2026-01-15 00:29:24.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408163&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:29:24.028 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
2026-01-15 00:29:24.358 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:29:24.358 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-15 00:29:31.974 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.61 秒后继续...
2026-01-15 00:29:31.974 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 23/26 页...
2026-01-15 00:29:31.974 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:29:32.002 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:29:32.630 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:29:33.814 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:29:36.037 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:29:36.037 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:29:36.523 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408172 status=200 resp_size=133377
2026-01-15 00:29:36.523 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:29:36.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job&timestamp=1768408176 status=200 resp_size=5166
2026-01-15 00:29:36.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408176&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:29:39.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768408179 status=200 resp_size=4962
2026-01-15 00:29:39.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408179&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:29:42.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job&timestamp=1768408181 status=200 resp_size=5148
2026-01-15 00:29:42.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408182&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:29:50.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768408189 status=200 resp_size=5409
2026-01-15 00:29:50.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408190&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:29:59.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768408198 status=200 resp_size=5055
2026-01-15 00:29:59.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408199&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:30:03.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768408203 status=200 resp_size=5570
2026-01-15 00:30:03.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408203&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:30:13.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768408213 status=200 resp_size=4847
2026-01-15 00:30:14.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408213&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:30:21.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768408220 status=200 resp_size=5461
2026-01-15 00:30:21.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408221&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:30:25.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job&timestamp=1768408225 status=200 resp_size=5600
2026-01-15 00:30:26.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408225&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:30:32.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768408231 status=200 resp_size=5200
2026-01-15 00:30:32.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408232&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:30:42.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768408242 status=200 resp_size=5032
2026-01-15 00:30:42.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408242&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:30:46.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768408246 status=200 resp_size=5207
2026-01-15 00:30:46.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408246&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:30:48.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768408248 status=200 resp_size=5182
2026-01-15 00:30:49.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408248&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:30:55.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768408254 status=200 resp_size=5173
2026-01-15 00:30:55.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408255&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:31:05.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768408264 status=200 resp_size=5552
2026-01-15 00:31:05.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408265&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:31:12.630 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job&timestamp=1768408272 status=200 resp_size=5489
2026-01-15 00:31:12.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408272&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:31:20.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job&timestamp=1768408279 status=200 resp_size=4383
2026-01-15 00:31:20.732 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408280&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
2026-01-15 00:31:26.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job&timestamp=1768408286 status=200 resp_size=6576
2026-01-15 00:31:27.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408286&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 00:31:35.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768408294 status=200 resp_size=10634
2026-01-15 00:31:35.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408295&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 00:31:45.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768408304 status=200 resp_size=5295
2026-01-15 00:31:45.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408305&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:31:45.215 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
2026-01-15 00:31:45.576 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:31:45.576 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-15 00:31:50.830 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.25 秒后继续...
2026-01-15 00:31:50.830 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 24/26 页...
2026-01-15 00:31:50.830 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:31:50.848 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:31:51.445 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:31:52.605 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:31:54.756 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:31:54.756 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:31:55.227 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408310 status=200 resp_size=124665
2026-01-15 00:31:55.227 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:31:55.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job&timestamp=1768408315 status=200 resp_size=5236
2026-01-15 00:31:55.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408315&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 00:32:03.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768408322 status=200 resp_size=4315
2026-01-15 00:32:03.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408323&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-15 00:32:12.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768408332 status=200 resp_size=7628
2026-01-15 00:32:13.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408332&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 00:32:19.829 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768408339 status=200 resp_size=4985
2026-01-15 00:32:20.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408339&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:32:29.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job&timestamp=1768408348 status=200 resp_size=6205
2026-01-15 00:32:29.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408349&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
2026-01-15 00:32:38.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job&timestamp=1768408357 status=200 resp_size=4425
2026-01-15 00:32:38.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408358&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 00:32:43.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768408363 status=200 resp_size=6095
2026-01-15 00:32:43.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408363&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:32:46.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768408365 status=200 resp_size=4972
2026-01-15 00:32:46.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408366&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:32:51.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768408371 status=200 resp_size=5147
2026-01-15 00:32:51.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408371&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-15 00:33:01.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job&timestamp=1768408381 status=200 resp_size=5806
2026-01-15 00:33:02.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408381&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 00:33:09.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768408389 status=200 resp_size=6101
2026-01-15 00:33:09.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408389&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:33:13.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768408393 status=200 resp_size=5158
2026-01-15 00:33:13.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408393&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:33:20.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768408400 status=200 resp_size=6401
2026-01-15 00:33:21.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408400&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 00:33:29.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768408408 status=200 resp_size=4991
2026-01-15 00:33:29.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408409&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-15 00:33:31.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768408411 status=200 resp_size=6117
2026-01-15 00:33:31.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408411&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:33:33.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768408412 status=200 resp_size=4978
2026-01-15 00:33:33.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408413&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:33:40.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768408419 status=200 resp_size=6793
2026-01-15 00:33:40.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408420&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 00:33:45.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job&timestamp=1768408424 status=200 resp_size=5111
2026-01-15 00:33:45.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408425&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:33:56.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768408434 status=200 resp_size=6108
2026-01-15 00:33:56.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408436&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:33:58.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768408438 status=200 resp_size=5026
2026-01-15 00:33:59.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408438&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:33:59.001 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
2026-01-15 00:34:04.964 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:34:04.964 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-15 00:34:07.277 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.30 秒后继续...
2026-01-15 00:34:07.277 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 25/26 页...
2026-01-15 00:34:07.277 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:34:07.286 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:34:07.961 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:34:09.125 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:34:11.276 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:34:11.276 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:34:11.779 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408447 status=200 resp_size=143024
2026-01-15 00:34:11.779 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:34:12.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job&timestamp=1768408451 status=200 resp_size=6546
2026-01-15 00:34:12.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408452&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 00:34:21.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job&timestamp=1768408461 status=200 resp_size=5355
2026-01-15 00:34:22.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408461&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
2026-01-15 00:34:27.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job&timestamp=1768408467 status=200 resp_size=6109
2026-01-15 00:34:27.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408467&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:34:30.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768408470 status=200 resp_size=4859
2026-01-15 00:34:31.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408470&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:34:37.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job&timestamp=1768408476 status=200 resp_size=6285
2026-01-15 00:34:37.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408477&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
2026-01-15 00:34:41.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768408481 status=200 resp_size=7170
2026-01-15 00:34:41.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408481&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 00:34:47.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768408487 status=200 resp_size=6115
2026-01-15 00:34:48.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408487&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:34:51.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job&timestamp=1768408491 status=200 resp_size=5992
2026-01-15 00:34:51.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408491&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 00:34:56.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768408496 status=200 resp_size=6873
2026-01-15 00:34:56.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408496&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 00:34:58.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job&timestamp=1768408497 status=200 resp_size=4833
2026-01-15 00:34:58.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408498&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 00:35:01.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768408500 status=200 resp_size=6044
2026-01-15 00:35:01.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408501&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:35:07.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768408507 status=200 resp_size=7131
2026-01-15 00:35:07.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408507&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-15 00:35:17.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768408516 status=200 resp_size=6770
2026-01-15 00:35:17.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408517&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 00:35:26.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768408525 status=200 resp_size=5688
2026-01-15 00:35:26.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408526&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 00:35:35.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768408534 status=200 resp_size=6107
2026-01-15 00:35:35.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408535&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:35:38.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768408538 status=200 resp_size=5215
2026-01-15 00:35:39.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408538&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-15 00:35:48.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768408548 status=200 resp_size=6794
2026-01-15 00:35:49.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408548&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 00:35:53.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job&timestamp=1768408553 status=200 resp_size=6749
2026-01-15 00:35:53.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408553&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
2026-01-15 00:36:00.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768408559 status=200 resp_size=6113
2026-01-15 00:36:00.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408560&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:36:03.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768408563 status=200 resp_size=4990
2026-01-15 00:36:03.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408563&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-15 00:36:03.857 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
2026-01-15 00:36:09.965 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:36:09.965 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-15 00:36:11.579 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.60 秒后继续...
2026-01-15 00:36:11.579 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 26/26 页...
2026-01-15 00:36:11.579 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:36:11.597 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=商丘, 工作类型=8305
2026-01-15 00:36:12.209 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:36:13.355 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:36:15.505 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:36:15.505 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:36:15.976 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408571 status=200 resp_size=113825
2026-01-15 00:36:15.976 | WARNING | __main__:get_recommend_jobs:745 - 第 26 页发现 1 个重复职位(已跳过)
2026-01-15 00:36:15.976 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 16 | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
2026-01-15 00:36:16.180 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job&timestamp=1768408575 status=200 resp_size=4679
2026-01-15 00:36:16.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408576&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-15 00:36:21.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768408581 status=200 resp_size=6107
2026-01-15 00:36:21.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408581&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:36:31.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768408590 status=200 resp_size=6544
2026-01-15 00:36:31.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408591&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 00:36:33.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768408593 status=200 resp_size=7105
2026-01-15 00:36:34.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408593&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-15 00:36:38.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768408598 status=200 resp_size=6531
2026-01-15 00:36:38.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408598&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-15 00:36:47.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768408606 status=200 resp_size=6109
2026-01-15 00:36:47.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408607&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:36:48.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768408608 status=200 resp_size=4704
2026-01-15 00:36:48.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408608&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-15 00:36:59.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768408618 status=200 resp_size=6427
2026-01-15 00:36:59.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408619&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 00:37:02.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job&timestamp=1768408622 status=200 resp_size=5737
2026-01-15 00:37:02.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408622&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 00:37:06.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768408625 status=200 resp_size=6111
2026-01-15 00:37:06.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408626&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:37:15.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768408635 status=200 resp_size=5499
2026-01-15 00:37:16.116 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408635&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-15 00:37:21.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768408640 status=200 resp_size=5880
2026-01-15 00:37:21.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408641&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 00:37:30.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768408649 status=200 resp_size=6122
2026-01-15 00:37:30.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408650&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 00:37:41.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768408658 status=200 resp_size=5903
2026-01-15 00:37:42.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408661&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-15 00:37:49.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768408668 status=200 resp_size=5129
2026-01-15 00:37:49.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408669&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 00:37:57.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768408677 status=200 resp_size=5241
2026-01-15 00:37:57.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408677&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 00:37:57.877 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 16
2026-01-15 00:38:02.679 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 16, 响应大小: 113 字节
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/505),提前结束爬取
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 503 条
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 14 条
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 505 条
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 商丘(商丘)
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 投资者关系(8305)
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 99.60% (503/505)
2026-01-15 00:38:02.679 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(503) < API返回总数(505),可能存在分页问题或数据过滤
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-15 00:38:02.679 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 503 条记录)
2026-01-15 00:38:02.679 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 503 个职位
2026-01-15 00:38:02.679 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-15 00:38:10.908 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:38:10.918 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:38:11.515 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-15 00:38:11.515 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:38:11.546 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:38:12.763 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:38:13.926 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:38:16.107 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:38:16.107 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:38:16.627 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408691 status=200 resp_size=114782
2026-01-15 00:38:16.627 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:38:16.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job&timestamp=1768408696 status=200 resp_size=4330
2026-01-15 00:38:17.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408696&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
2026-01-15 00:38:23.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768408702 status=200 resp_size=5180
2026-01-15 00:38:23.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408703&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 00:38:32.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768408711 status=200 resp_size=5575
2026-01-15 00:38:32.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408712&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 00:38:45.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768408720 status=200 resp_size=5000
2026-01-15 00:38:45.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408725&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-15 00:38:49.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768408728 status=200 resp_size=5029
2026-01-15 00:38:50.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408729&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 00:38:54.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768408734 status=200 resp_size=5542
2026-01-15 00:38:55.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408734&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 00:39:03.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768408742 status=200 resp_size=5626
2026-01-15 00:39:03.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408743&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 00:39:13.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768408753 status=200 resp_size=6579
2026-01-15 00:39:14.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408753&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-15 00:39:20.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768408759 status=200 resp_size=5714
2026-01-15 00:39:20.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408760&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 00:39:22.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768408762 status=200 resp_size=5709
2026-01-15 00:39:22.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408762&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-15 00:39:32.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768408772 status=200 resp_size=6192
2026-01-15 00:39:32.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408772&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 00:39:35.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job&timestamp=1768408774 status=200 resp_size=6192
2026-01-15 00:39:35.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408775&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
2026-01-15 00:39:39.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768408779 status=200 resp_size=5082
2026-01-15 00:39:39.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408779&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:39:44.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768408784 status=200 resp_size=5890
2026-01-15 00:39:44.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408784&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 00:39:48.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768408788 status=200 resp_size=5726
2026-01-15 00:39:48.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408788&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 00:39:51.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768408791 status=200 resp_size=4892
2026-01-15 00:39:52.116 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408791&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 00:40:00.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768408800 status=200 resp_size=4913
2026-01-15 00:40:01.161 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408800&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 00:40:09.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768408808 status=200 resp_size=5431
2026-01-15 00:40:09.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408809&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-15 00:40:17.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768408816 status=200 resp_size=6023
2026-01-15 00:40:18.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408817&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 00:40:25.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768408825 status=200 resp_size=6048
2026-01-15 00:40:26.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408825&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 00:40:26.193 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
2026-01-15 00:40:26.523 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:40:26.523 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-15 00:40:26.523 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-15 00:40:35.352 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.82 秒后继续...
2026-01-15 00:40:35.352 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-15 00:40:35.352 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:40:35.380 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:40:35.961 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:40:37.090 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:40:39.227 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:40:39.227 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:40:39.651 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408835 status=200 resp_size=111557
2026-01-15 00:40:39.651 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:40:39.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768408839 status=200 resp_size=4954
2026-01-15 00:40:40.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408839&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 00:40:46.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job&timestamp=1768408845 status=200 resp_size=5667
2026-01-15 00:40:46.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408846&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 00:40:48.003 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768408847 status=200 resp_size=5721
2026-01-15 00:40:48.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408848&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-15 00:40:56.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768408853 status=200 resp_size=5573
2026-01-15 00:40:56.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408856&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 00:41:06.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768408865 status=200 resp_size=4992
2026-01-15 00:41:06.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408866&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:41:09.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768408869 status=200 resp_size=6314
2026-01-15 00:41:09.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408869&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
2026-01-15 00:41:16.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job&timestamp=1768408875 status=200 resp_size=6787
2026-01-15 00:41:16.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408876&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
2026-01-15 00:41:23.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768408882 status=200 resp_size=5480
2026-01-15 00:41:23.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408883&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-15 00:41:29.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job&timestamp=1768408889 status=200 resp_size=5976
2026-01-15 00:41:29.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408889&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 00:41:37.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768408897 status=200 resp_size=5184
2026-01-15 00:41:37.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408897&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-15 00:41:39.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768408898 status=200 resp_size=6134
2026-01-15 00:41:39.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408899&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-15 00:41:41.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768408901 status=200 resp_size=5587
2026-01-15 00:41:41.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408901&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-15 00:41:42.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768408902 status=200 resp_size=6399
2026-01-15 00:41:42.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408902&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:41:51.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768408910 status=200 resp_size=5110
2026-01-15 00:41:51.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408911&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-15 00:41:58.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768408917 status=200 resp_size=5940
2026-01-15 00:41:58.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408918&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-15 00:42:09.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768408928 status=200 resp_size=5601
2026-01-15 00:42:09.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408929&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:42:14.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job&timestamp=1768408934 status=200 resp_size=6095
2026-01-15 00:42:14.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408934&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 00:42:20.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768408939 status=200 resp_size=5374
2026-01-15 00:42:20.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408940&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 00:42:22.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768408942 status=200 resp_size=5486
2026-01-15 00:42:23.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408942&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 00:42:24.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768408944 status=200 resp_size=5596
2026-01-15 00:42:24.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408944&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 00:42:24.526 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
2026-01-15 00:42:30.355 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:42:30.355 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-15 00:42:35.335 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.98 秒后继续...
2026-01-15 00:42:35.335 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-15 00:42:35.335 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:42:35.363 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:42:35.850 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:42:36.980 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:42:39.119 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:42:39.119 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:42:39.622 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768408955 status=200 resp_size=109526
2026-01-15 00:42:39.622 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:42:39.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768408959 status=200 resp_size=5974
2026-01-15 00:42:39.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408959&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:42:46.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768408965 status=200 resp_size=5682
2026-01-15 00:42:46.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408966&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:42:48.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768408968 status=200 resp_size=5486
2026-01-15 00:42:48.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408968&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 00:42:51.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job&timestamp=1768408971 status=200 resp_size=6076
2026-01-15 00:42:51.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408971&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 00:42:54.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job&timestamp=1768408973 status=200 resp_size=5524
2026-01-15 00:42:54.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408974&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
2026-01-15 00:42:55.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768408975 status=200 resp_size=5641
2026-01-15 00:42:56.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408975&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-15 00:43:05.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768408982 status=200 resp_size=5513
2026-01-15 00:43:05.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408985&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-15 00:43:07.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768408986 status=200 resp_size=6285
2026-01-15 00:43:07.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408987&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-15 00:43:10.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768408989 status=200 resp_size=7756
2026-01-15 00:43:10.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408990&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 00:43:19.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768408998 status=200 resp_size=5127
2026-01-15 00:43:19.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768408999&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-15 00:43:21.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768409001 status=200 resp_size=5182
2026-01-15 00:43:22.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409001&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-15 00:43:31.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768409010 status=200 resp_size=5968
2026-01-15 00:43:31.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409011&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-15 00:43:38.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job&timestamp=1768409018 status=200 resp_size=5407
2026-01-15 00:43:38.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409018&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
2026-01-15 00:43:42.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768409022 status=200 resp_size=5328
2026-01-15 00:43:43.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409022&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:43:46.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768409026 status=200 resp_size=5718
2026-01-15 00:43:46.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409026&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 00:43:56.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768409035 status=200 resp_size=5729
2026-01-15 00:43:56.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409036&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 00:44:04.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job&timestamp=1768409044 status=200 resp_size=5845
2026-01-15 00:44:05.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409044&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:44:09.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job&timestamp=1768409049 status=200 resp_size=5222
2026-01-15 00:44:10.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409049&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 00:44:17.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768409056 status=200 resp_size=5711
2026-01-15 00:44:17.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409057&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 00:44:27.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768409066 status=200 resp_size=6015
2026-01-15 00:44:27.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409067&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-15 00:44:27.215 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
2026-01-15 00:44:27.577 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:44:27.577 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-15 00:44:32.996 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.41 秒后继续...
2026-01-15 00:44:32.996 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-15 00:44:32.996 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:44:33.012 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:44:33.687 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:44:34.849 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:44:37.001 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:44:37.001 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:44:37.488 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768409073 status=200 resp_size=118111
2026-01-15 00:44:37.488 | WARNING | __main__:get_recommend_jobs:745 - 第 4 页发现 1 个重复职位(已跳过)
2026-01-15 00:44:37.488 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:44:37.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768409077 status=200 resp_size=5245
2026-01-15 00:44:37.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409077&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 00:44:44.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job&timestamp=1768409083 status=200 resp_size=6139
2026-01-15 00:44:44.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409084&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 00:44:54.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768409093 status=200 resp_size=6647
2026-01-15 00:44:54.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409094&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 00:44:59.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job&timestamp=1768409099 status=200 resp_size=5677
2026-01-15 00:44:59.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409099&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
2026-01-15 00:45:03.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768409103 status=200 resp_size=6444
2026-01-15 00:45:03.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409103&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 00:45:08.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768409108 status=200 resp_size=5823
2026-01-15 00:45:08.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409108&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:45:18.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768409118 status=200 resp_size=6462
2026-01-15 00:45:19.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409118&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 00:45:20.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768409120 status=200 resp_size=6318
2026-01-15 00:45:21.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409120&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-15 00:45:24.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768409124 status=200 resp_size=5783
2026-01-15 00:45:25.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409124&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:45:27.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768409127 status=200 resp_size=5799
2026-01-15 00:45:28.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409127&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 00:45:29.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768409129 status=200 resp_size=5955
2026-01-15 00:45:29.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409129&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:45:32.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job&timestamp=1768409132 status=200 resp_size=5613
2026-01-15 00:45:33.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409132&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 00:45:39.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768409139 status=200 resp_size=6388
2026-01-15 00:45:40.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409139&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 00:45:49.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768409148 status=200 resp_size=6039
2026-01-15 00:45:49.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409149&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:45:54.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768409153 status=200 resp_size=6507
2026-01-15 00:45:54.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409154&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 00:46:00.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768409160 status=200 resp_size=6511
2026-01-15 00:46:01.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409160&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:46:03.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768409162 status=200 resp_size=5930
2026-01-15 00:46:03.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409163&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:46:07.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768409167 status=200 resp_size=4058
2026-01-15 00:46:07.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409167&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-15 00:46:18.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768409177 status=200 resp_size=5222
2026-01-15 00:46:18.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409178&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:46:18.232 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 19
2026-01-15 00:46:23.869 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 00:46:23.869 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-15 00:46:27.124 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.24 秒后继续...
2026-01-15 00:46:27.124 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-15 00:46:27.124 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:46:27.152 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:46:27.655 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:46:28.754 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:46:30.858 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:46:30.858 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:46:31.376 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768409187 status=200 resp_size=136257
2026-01-15 00:46:31.376 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:46:31.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job&timestamp=1768409191 status=200 resp_size=7311
2026-01-15 00:46:31.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409191&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
2026-01-15 00:46:35.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768409195 status=200 resp_size=6173
2026-01-15 00:46:35.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409195&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 00:46:46.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768409205 status=200 resp_size=5624
2026-01-15 00:46:46.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409206&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:46:48.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768409208 status=200 resp_size=6121
2026-01-15 00:46:48.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409208&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 00:46:59.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768409218 status=200 resp_size=7499
2026-01-15 00:46:59.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409219&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 00:47:08.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768409226 status=200 resp_size=5878
2026-01-15 00:47:08.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409228&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 00:47:12.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768409231 status=200 resp_size=6051
2026-01-15 00:47:12.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409232&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 00:47:18.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768409238 status=200 resp_size=5451
2026-01-15 00:47:18.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409238&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 00:47:24.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768409244 status=200 resp_size=6422
2026-01-15 00:47:25.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409244&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-15 00:47:28.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job&timestamp=1768409248 status=200 resp_size=7534
2026-01-15 00:47:28.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409248&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
2026-01-15 00:47:33.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768409253 status=200 resp_size=5756
2026-01-15 00:47:33.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409253&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:47:38.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job&timestamp=1768409257 status=200 resp_size=6431
2026-01-15 00:47:38.180 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409258&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
2026-01-15 00:47:47.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768409267 status=200 resp_size=8364
2026-01-15 00:47:48.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409267&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-15 00:47:57.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job&timestamp=1768409276 status=200 resp_size=5876
2026-01-15 00:47:57.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409277&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 00:48:03.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job&timestamp=1768409283 status=200 resp_size=5628
2026-01-15 00:48:04.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409283&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
2026-01-15 00:48:06.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768409286 status=200 resp_size=6058
2026-01-15 00:48:06.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409286&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:48:14.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768409294 status=200 resp_size=6856
2026-01-15 00:48:15.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409294&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
2026-01-15 00:48:25.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768409304 status=200 resp_size=6718
2026-01-15 00:48:25.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409305&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-15 00:48:33.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768409312 status=200 resp_size=6573
2026-01-15 00:48:33.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409313&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 00:48:43.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768409322 status=200 resp_size=6473
2026-01-15 00:48:43.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409323&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:48:43.433 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
2026-01-15 00:48:49.866 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:48:49.869 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-15 00:48:52.922 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.05 秒后继续...
2026-01-15 00:48:52.922 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-15 00:48:52.922 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:48:52.951 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:48:53.595 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:48:54.757 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:48:56.939 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:48:56.939 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:48:57.442 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768409332 status=200 resp_size=150491
2026-01-15 00:48:57.442 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:48:57.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768409337 status=200 resp_size=6715
2026-01-15 00:48:57.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409337&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-15 00:49:07.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job&timestamp=1768409346 status=200 resp_size=5857
2026-01-15 00:49:07.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409347&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
2026-01-15 00:49:17.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768409357 status=200 resp_size=5211
2026-01-15 00:49:17.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409357&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
2026-01-15 00:49:28.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job&timestamp=1768409367 status=200 resp_size=6024
2026-01-15 00:49:28.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409368&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:49:38.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768409377 status=200 resp_size=5942
2026-01-15 00:49:38.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409378&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 00:49:43.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job&timestamp=1768409383 status=200 resp_size=8574
2026-01-15 00:49:43.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409383&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 00:49:52.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768409392 status=200 resp_size=6423
2026-01-15 00:49:53.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409392&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 00:49:59.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768409398 status=200 resp_size=5421
2026-01-15 00:49:59.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409399&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:50:00.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768409400 status=200 resp_size=7551
2026-01-15 00:50:00.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409400&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-15 00:50:03.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768409402 status=200 resp_size=5784
2026-01-15 00:50:03.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409403&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 00:50:07.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768409406 status=200 resp_size=5306
2026-01-15 00:50:07.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409407&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-15 00:50:11.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768409411 status=200 resp_size=5687
2026-01-15 00:50:11.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409411&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:50:17.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768409416 status=200 resp_size=7182
2026-01-15 00:50:17.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409417&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-15 00:50:25.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job&timestamp=1768409424 status=200 resp_size=7262
2026-01-15 00:50:25.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409425&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 00:50:29.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job&timestamp=1768409429 status=200 resp_size=6343
2026-01-15 00:50:30.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409429&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
2026-01-15 00:50:36.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768409436 status=200 resp_size=6958
2026-01-15 00:50:37.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409436&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:50:41.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768409440 status=200 resp_size=5655
2026-01-15 00:50:41.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409441&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 00:50:45.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768409445 status=200 resp_size=8225
2026-01-15 00:50:45.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409445&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-15 00:50:55.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768409455 status=200 resp_size=7119
2026-01-15 00:50:56.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409455&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 00:51:01.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768409460 status=200 resp_size=6552
2026-01-15 00:51:01.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409461&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:51:01.438 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
2026-01-15 00:51:08.221 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:51:08.221 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-15 00:51:17.162 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.93 秒后继续...
2026-01-15 00:51:17.162 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-15 00:51:17.162 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:51:17.188 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:51:17.921 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:51:19.070 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:51:21.285 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:51:21.285 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:51:21.819 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768409477 status=200 resp_size=146853
2026-01-15 00:51:21.819 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:51:22.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768409481 status=200 resp_size=5588
2026-01-15 00:51:22.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409482&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 00:51:33.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job&timestamp=1768409490 status=200 resp_size=7967
2026-01-15 00:51:33.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409493&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
2026-01-15 00:51:41.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768409500 status=200 resp_size=6714
2026-01-15 00:51:41.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409501&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 00:51:46.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768409506 status=200 resp_size=5497
2026-01-15 00:51:47.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409506&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:51:51.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768409511 status=200 resp_size=5775
2026-01-15 00:51:52.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409511&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-15 00:51:53.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768409513 status=200 resp_size=6684
2026-01-15 00:51:53.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409513&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-15 00:52:00.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768409519 status=200 resp_size=13102
2026-01-15 00:52:00.385 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409520&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 00:52:10.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768409529 status=200 resp_size=6689
2026-01-15 00:52:10.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409530&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:52:18.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768409537 status=200 resp_size=5128
2026-01-15 00:52:19.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409538&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 00:52:20.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job&timestamp=1768409540 status=200 resp_size=6362
2026-01-15 00:52:20.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409540&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 00:52:29.142 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768409548 status=200 resp_size=6529
2026-01-15 00:52:29.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409549&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 00:52:32.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job&timestamp=1768409552 status=200 resp_size=6390
2026-01-15 00:52:33.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409552&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:52:36.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job&timestamp=1768409556 status=200 resp_size=7130
2026-01-15 00:52:37.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409556&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 00:52:45.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768409564 status=200 resp_size=7415
2026-01-15 00:52:45.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409565&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
2026-01-15 00:52:49.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job&timestamp=1768409569 status=200 resp_size=5152
2026-01-15 00:52:49.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409569&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
2026-01-15 00:52:55.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768409575 status=200 resp_size=6254
2026-01-15 00:52:55.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409575&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:53:03.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768409582 status=200 resp_size=5877
2026-01-15 00:53:03.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409583&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
2026-01-15 00:53:09.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768409588 status=200 resp_size=6039
2026-01-15 00:53:09.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409589&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-15 00:53:18.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768409597 status=200 resp_size=5098
2026-01-15 00:53:18.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409598&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 00:53:19.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job&timestamp=1768409599 status=200 resp_size=7126
2026-01-15 00:53:19.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409599&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:53:19.857 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
2026-01-15 00:53:26.411 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:53:26.411 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-15 00:53:32.448 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.03 秒后继续...
2026-01-15 00:53:32.448 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-15 00:53:32.448 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:53:32.467 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:53:33.219 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:53:34.382 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:53:36.565 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:53:36.565 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:53:37.144 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768409612 status=200 resp_size=147387
2026-01-15 00:53:37.146 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:53:37.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768409617 status=200 resp_size=5711
2026-01-15 00:53:37.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409617&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 00:53:41.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768409621 status=200 resp_size=6970
2026-01-15 00:53:41.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409621&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 00:53:50.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768409628 status=200 resp_size=5109
2026-01-15 00:53:50.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409630&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 00:53:57.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768409637 status=200 resp_size=6226
2026-01-15 00:53:57.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409637&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:54:00.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job&timestamp=1768409640 status=200 resp_size=7717
2026-01-15 00:54:00.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409640&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
2026-01-15 00:54:10.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job&timestamp=1768409649 status=200 resp_size=8734
2026-01-15 00:54:10.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409650&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
2026-01-15 00:54:17.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768409657 status=200 resp_size=8808
2026-01-15 00:54:18.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409657&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:54:24.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768409663 status=200 resp_size=5686
2026-01-15 00:54:24.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409664&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
2026-01-15 00:54:29.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768409669 status=200 resp_size=6558
2026-01-15 00:54:29.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409669&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-15 00:54:37.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job&timestamp=1768409676 status=200 resp_size=5533
2026-01-15 00:54:37.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409677&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
2026-01-15 00:54:46.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job&timestamp=1768409685 status=200 resp_size=5920
2026-01-15 00:54:46.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409686&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:54:55.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768409694 status=200 resp_size=6522
2026-01-15 00:54:56.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409695&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 00:55:05.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job&timestamp=1768409705 status=200 resp_size=5458
2026-01-15 00:55:05.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409705&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
2026-01-15 00:55:15.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job&timestamp=1768409714 status=200 resp_size=7237
2026-01-15 00:55:15.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409715&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
2026-01-15 00:55:24.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768409723 status=200 resp_size=6445
2026-01-15 00:55:24.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409724&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:55:31.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768409730 status=200 resp_size=5342
2026-01-15 00:55:31.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409731&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-15 00:55:42.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768409741 status=200 resp_size=5431
2026-01-15 00:55:42.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409742&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 00:55:48.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job&timestamp=1768409747 status=200 resp_size=7607
2026-01-15 00:55:48.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409748&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 00:55:57.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768409756 status=200 resp_size=4995
2026-01-15 00:55:57.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409757&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:56:00.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768409759 status=200 resp_size=7194
2026-01-15 00:56:00.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409760&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 00:56:00.295 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
2026-01-15 00:56:06.608 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:56:06.608 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-15 00:56:15.185 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.57 秒后继续...
2026-01-15 00:56:15.185 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-15 00:56:15.185 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:56:15.213 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:56:16.014 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:56:17.209 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:56:19.393 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:56:19.408 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:56:19.942 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768409775 status=200 resp_size=149280
2026-01-15 00:56:19.942 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:56:20.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job&timestamp=1768409779 status=200 resp_size=6416
2026-01-15 00:56:20.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409780&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 00:56:27.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768409787 status=200 resp_size=6501
2026-01-15 00:56:28.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409787&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:56:37.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job&timestamp=1768409796 status=200 resp_size=6646
2026-01-15 00:56:37.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409797&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
2026-01-15 00:56:48.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768409807 status=200 resp_size=5473
2026-01-15 00:56:48.387 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409808&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-15 00:56:52.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job&timestamp=1768409812 status=200 resp_size=5678
2026-01-15 00:56:52.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409812&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:56:54.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768409813 status=200 resp_size=6449
2026-01-15 00:56:54.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409814&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-15 00:57:03.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768409822 status=200 resp_size=5925
2026-01-15 00:57:03.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409823&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
2026-01-15 00:57:05.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768409825 status=200 resp_size=7750
2026-01-15 00:57:05.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409825&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 00:57:12.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768409832 status=200 resp_size=8457
2026-01-15 00:57:12.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409832&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:57:23.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768409842 status=200 resp_size=7971
2026-01-15 00:57:23.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409843&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 00:57:32.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768409851 status=200 resp_size=8313
2026-01-15 00:57:32.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409852&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-15 00:57:40.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job&timestamp=1768409860 status=200 resp_size=5424
2026-01-15 00:57:41.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409860&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
2026-01-15 00:57:44.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768409863 status=200 resp_size=6770
2026-01-15 00:57:44.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409864&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:57:48.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job&timestamp=1768409867 status=200 resp_size=8274
2026-01-15 00:57:48.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409868&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
2026-01-15 00:57:57.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768409876 status=200 resp_size=8701
2026-01-15 00:57:58.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409877&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-15 00:58:07.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job&timestamp=1768409886 status=200 resp_size=5378
2026-01-15 00:58:07.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409887&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
2026-01-15 00:58:14.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job&timestamp=1768409893 status=200 resp_size=5414
2026-01-15 00:58:14.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409894&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:58:18.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768409898 status=200 resp_size=5253
2026-01-15 00:58:18.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409898&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 00:58:24.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768409904 status=200 resp_size=6080
2026-01-15 00:58:25.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409904&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 00:58:31.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768409910 status=200 resp_size=5916
2026-01-15 00:58:31.855 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409911&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-15 00:58:31.855 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
2026-01-15 00:58:38.324 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 00:58:38.324 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-15 00:58:48.272 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.94 秒后继续...
2026-01-15 00:58:48.272 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-15 00:58:48.272 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 00:58:48.296 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 00:58:49.088 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:58:50.276 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:58:52.460 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 00:58:52.460 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 00:58:52.948 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768409928 status=200 resp_size=130881
2026-01-15 00:58:52.948 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 1 个重复职位(已跳过)
2026-01-15 00:58:52.948 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 00:58:53.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768409932 status=200 resp_size=4916
2026-01-15 00:58:53.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409933&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 00:58:59.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768409938 status=200 resp_size=5446
2026-01-15 00:58:59.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409939&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-15 00:59:02.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768409942 status=200 resp_size=6119
2026-01-15 00:59:02.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409942&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:59:06.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768409946 status=200 resp_size=6053
2026-01-15 00:59:06.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409946&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 00:59:16.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768409955 status=200 resp_size=6494
2026-01-15 00:59:16.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409956&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
2026-01-15 00:59:20.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768409960 status=200 resp_size=6226
2026-01-15 00:59:21.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409960&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-15 00:59:31.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768409971 status=200 resp_size=6284
2026-01-15 00:59:32.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409971&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:59:40.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768409979 status=200 resp_size=6176
2026-01-15 00:59:40.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409980&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-15 00:59:42.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768409982 status=200 resp_size=5673
2026-01-15 00:59:42.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409982&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-15 00:59:45.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job&timestamp=1768409985 status=200 resp_size=6731
2026-01-15 00:59:45.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409985&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 00:59:53.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768409992 status=200 resp_size=5862
2026-01-15 00:59:53.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409993&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 00:59:54.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768409994 status=200 resp_size=5378
2026-01-15 00:59:54.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409994&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-15 00:59:57.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job&timestamp=1768409996 status=200 resp_size=5575
2026-01-15 00:59:57.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409997&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 00:59:58.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768409998 status=200 resp_size=6187
2026-01-15 00:59:59.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768409998&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-15 01:00:05.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768410004 status=200 resp_size=5792
2026-01-15 01:00:05.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410005&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:00:13.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768410012 status=200 resp_size=5731
2026-01-15 01:00:14.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410013&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-15 01:00:19.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768410018 status=200 resp_size=7075
2026-01-15 01:00:19.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410019&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 01:00:25.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768410025 status=200 resp_size=6530
2026-01-15 01:00:25.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410025&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:00:35.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768410034 status=200 resp_size=8973
2026-01-15 01:00:36.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410035&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
2026-01-15 01:00:36.338 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 19
2026-01-15 01:00:36.730 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:00:36.730 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-15 01:00:44.199 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.45 秒后继续...
2026-01-15 01:00:44.199 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-15 01:00:44.199 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:00:44.235 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:00:45.004 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:00:46.198 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:00:48.397 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:00:48.397 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:00:48.916 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410044 status=200 resp_size=144107
2026-01-15 01:00:48.916 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
2026-01-15 01:00:48.916 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:00:49.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768410048 status=200 resp_size=8559
2026-01-15 01:00:49.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410049&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
2026-01-15 01:00:55.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768410055 status=200 resp_size=6688
2026-01-15 01:00:56.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410055&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-15 01:01:00.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768410060 status=200 resp_size=5982
2026-01-15 01:01:00.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410060&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-15 01:01:08.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job&timestamp=1768410068 status=200 resp_size=7919
2026-01-15 01:01:08.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410068&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
2026-01-15 01:01:18.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job&timestamp=1768410077 status=200 resp_size=7693
2026-01-15 01:01:18.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410078&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
2026-01-15 01:01:25.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768410084 status=200 resp_size=5259
2026-01-15 01:01:25.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410085&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 01:01:30.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job&timestamp=1768410089 status=200 resp_size=6660
2026-01-15 01:01:30.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410090&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 01:01:39.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768410098 status=200 resp_size=5390
2026-01-15 01:01:40.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410099&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-15 01:01:46.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job&timestamp=1768410105 status=200 resp_size=7952
2026-01-15 01:01:46.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410106&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
2026-01-15 01:01:53.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job&timestamp=1768410112 status=200 resp_size=6635
2026-01-15 01:01:53.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410113&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
2026-01-15 01:02:03.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768410122 status=200 resp_size=5277
2026-01-15 01:02:03.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410123&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-15 01:02:09.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768410129 status=200 resp_size=7175
2026-01-15 01:02:09.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410129&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-15 01:02:20.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768410139 status=200 resp_size=6284
2026-01-15 01:02:21.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410140&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:02:26.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768410145 status=200 resp_size=5924
2026-01-15 01:02:26.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410146&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-15 01:02:36.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768410155 status=200 resp_size=6003
2026-01-15 01:02:37.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410156&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-15 01:02:39.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768410158 status=200 resp_size=5672
2026-01-15 01:02:39.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410159&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-15 01:02:48.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768410167 status=200 resp_size=9402
2026-01-15 01:02:48.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410168&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 01:02:52.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768410172 status=200 resp_size=6867
2026-01-15 01:02:52.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410172&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:02:54.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job&timestamp=1768410174 status=200 resp_size=13285
2026-01-15 01:02:54.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410174&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 01:02:54.930 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
2026-01-15 01:02:55.244 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:02:55.244 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-15 01:02:59.048 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.79 秒后继续...
2026-01-15 01:02:59.048 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-15 01:02:59.048 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:02:59.078 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:02:59.597 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:03:00.727 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:03:02.865 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:03:02.865 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:03:03.351 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410179 status=200 resp_size=127459
2026-01-15 01:03:03.351 | WARNING | __main__:get_recommend_jobs:745 - 第 12 页发现 1 个重复职位(已跳过)
2026-01-15 01:03:03.351 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:03:03.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job&timestamp=1768410183 status=200 resp_size=6041
2026-01-15 01:03:03.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410183&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
2026-01-15 01:03:10.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768410189 status=200 resp_size=5280
2026-01-15 01:03:10.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410190&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 01:03:13.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job&timestamp=1768410193 status=200 resp_size=8069
2026-01-15 01:03:13.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410193&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 01:03:21.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768410200 status=200 resp_size=6588
2026-01-15 01:03:21.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410201&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 01:03:24.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job&timestamp=1768410204 status=200 resp_size=6300
2026-01-15 01:03:24.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410204&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
2026-01-15 01:03:33.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768410212 status=200 resp_size=6075
2026-01-15 01:03:33.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410213&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:03:41.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job&timestamp=1768410220 status=200 resp_size=4572
2026-01-15 01:03:41.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410221&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
2026-01-15 01:03:52.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768410231 status=200 resp_size=4992
2026-01-15 01:03:52.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410232&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-15 01:03:55.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768410235 status=200 resp_size=7194
2026-01-15 01:03:56.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410235&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-15 01:04:05.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768410244 status=200 resp_size=5332
2026-01-15 01:04:05.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410245&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 01:04:14.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768410253 status=200 resp_size=5554
2026-01-15 01:04:14.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410254&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:04:20.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768410259 status=200 resp_size=5040
2026-01-15 01:04:21.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410260&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-15 01:04:29.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768410268 status=200 resp_size=6755
2026-01-15 01:04:29.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410269&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:04:37.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768410277 status=200 resp_size=5883
2026-01-15 01:04:38.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410277&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-15 01:04:40.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768410280 status=200 resp_size=5760
2026-01-15 01:04:40.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410280&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 01:04:47.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768410286 status=200 resp_size=6980
2026-01-15 01:04:47.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410287&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 01:04:50.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768410290 status=200 resp_size=5283
2026-01-15 01:04:50.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410290&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:04:57.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768410296 status=200 resp_size=5508
2026-01-15 01:04:57.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410297&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-15 01:05:03.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job&timestamp=1768410302 status=200 resp_size=4592
2026-01-15 01:05:03.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410303&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
2026-01-15 01:05:03.428 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 19
2026-01-15 01:05:03.729 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:05:03.729 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-15 01:05:05.164 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.43 秒后继续...
2026-01-15 01:05:05.165 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-15 01:05:05.165 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:05:05.181 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:05:05.637 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:05:06.783 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:05:08.889 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:05:08.889 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:05:09.313 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410305 status=200 resp_size=155905
2026-01-15 01:05:09.313 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:05:09.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768410309 status=200 resp_size=6659
2026-01-15 01:05:09.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410309&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 01:05:13.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job&timestamp=1768410312 status=200 resp_size=5165
2026-01-15 01:05:13.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410313&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
2026-01-15 01:05:16.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job&timestamp=1768410315 status=200 resp_size=5570
2026-01-15 01:05:16.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410316&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
2026-01-15 01:05:17.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768410317 status=200 resp_size=9108
2026-01-15 01:05:17.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410317&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-15 01:05:19.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768410319 status=200 resp_size=5688
2026-01-15 01:05:20.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410319&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
2026-01-15 01:05:24.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768410324 status=200 resp_size=6380
2026-01-15 01:05:24.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410324&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 01:05:25.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job&timestamp=1768410325 status=200 resp_size=6612
2026-01-15 01:05:25.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410325&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
2026-01-15 01:05:33.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job&timestamp=1768410332 status=200 resp_size=7975
2026-01-15 01:05:33.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410333&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
2026-01-15 01:05:41.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job&timestamp=1768410340 status=200 resp_size=5984
2026-01-15 01:05:41.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410341&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 01:05:49.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768410348 status=200 resp_size=7243
2026-01-15 01:05:49.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410349&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 01:05:53.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job&timestamp=1768410353 status=200 resp_size=5582
2026-01-15 01:05:53.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410353&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 01:06:01.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768410360 status=200 resp_size=6935
2026-01-15 01:06:01.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410361&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-15 01:06:10.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job&timestamp=1768410370 status=200 resp_size=5924
2026-01-15 01:06:11.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410370&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
2026-01-15 01:06:17.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job&timestamp=1768410376 status=200 resp_size=6027
2026-01-15 01:06:18.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410377&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
2026-01-15 01:06:24.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768410383 status=200 resp_size=6856
2026-01-15 01:06:24.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410384&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 01:06:32.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job&timestamp=1768410391 status=200 resp_size=6028
2026-01-15 01:06:33.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410392&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 01:06:37.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768410397 status=200 resp_size=6111
2026-01-15 01:06:37.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410397&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
2026-01-15 01:06:39.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768410399 status=200 resp_size=8782
2026-01-15 01:06:39.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410399&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 01:06:43.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768410402 status=200 resp_size=6694
2026-01-15 01:06:43.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410403&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
2026-01-15 01:06:50.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768410409 status=200 resp_size=8655
2026-01-15 01:06:50.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410410&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-15 01:06:50.699 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
2026-01-15 01:06:57.041 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:06:57.056 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-15 01:07:03.487 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.43 秒后继续...
2026-01-15 01:07:03.487 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-15 01:07:03.487 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:07:03.510 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:07:04.342 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:07:05.505 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:07:07.640 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:07:07.640 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:07:08.112 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410423 status=200 resp_size=130627
2026-01-15 01:07:08.112 | WARNING | __main__:get_recommend_jobs:745 - 第 14 页发现 1 个重复职位(已跳过)
2026-01-15 01:07:08.112 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 516 (原始值: 516) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:07:08.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768410428 status=200 resp_size=7907
2026-01-15 01:07:08.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410428&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-15 01:07:11.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768410431 status=200 resp_size=5922
2026-01-15 01:07:12.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410431&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 01:07:16.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768410436 status=200 resp_size=5874
2026-01-15 01:07:16.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410436&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 01:07:26.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job&timestamp=1768410446 status=200 resp_size=6449
2026-01-15 01:07:27.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410446&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 01:07:31.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768410451 status=200 resp_size=7313
2026-01-15 01:07:32.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410451&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-15 01:07:40.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job&timestamp=1768410459 status=200 resp_size=6958
2026-01-15 01:07:40.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410460&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
2026-01-15 01:07:50.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job&timestamp=1768410469 status=200 resp_size=5499
2026-01-15 01:07:50.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410470&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
2026-01-15 01:07:56.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768410475 status=200 resp_size=5673
2026-01-15 01:07:56.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410476&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-15 01:08:00.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768410480 status=200 resp_size=7081
2026-01-15 01:08:00.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410480&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 01:08:07.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768410487 status=200 resp_size=7664
2026-01-15 01:08:08.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410487&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 01:08:18.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job&timestamp=1768410497 status=200 resp_size=6150
2026-01-15 01:08:18.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410498&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
2026-01-15 01:08:21.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768410501 status=200 resp_size=6652
2026-01-15 01:08:22.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410501&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-15 01:08:32.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768410511 status=200 resp_size=4729
2026-01-15 01:08:32.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410512&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 01:08:35.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768410515 status=200 resp_size=4926
2026-01-15 01:08:35.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410515&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 01:08:42.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768410521 status=200 resp_size=4902
2026-01-15 01:08:42.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410522&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 01:08:51.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job&timestamp=1768410530 status=200 resp_size=7369
2026-01-15 01:08:51.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410531&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 01:08:59.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768410539 status=200 resp_size=4830
2026-01-15 01:08:59.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410539&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 01:09:06.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768410546 status=200 resp_size=5006
2026-01-15 01:09:07.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410546&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 01:09:16.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768410555 status=200 resp_size=5351
2026-01-15 01:09:16.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410556&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-15 01:09:16.678 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 19
2026-01-15 01:09:22.319 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:09:22.319 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-15 01:09:25.860 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.54 秒后继续...
2026-01-15 01:09:25.860 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-15 01:09:25.860 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:09:25.880 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:09:26.634 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:09:27.812 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:09:29.997 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:09:29.997 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:09:30.624 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410565 status=200 resp_size=138078
2026-01-15 01:09:30.624 | WARNING | __main__:get_recommend_jobs:745 - 第 15 页发现 1 个重复职位(已跳过)
2026-01-15 01:09:30.624 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:09:30.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768410570 status=200 resp_size=5240
2026-01-15 01:09:31.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410570&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-15 01:09:36.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768410576 status=200 resp_size=5282
2026-01-15 01:09:37.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410576&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 01:09:47.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768410586 status=200 resp_size=5232
2026-01-15 01:09:47.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410587&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-15 01:09:57.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job&timestamp=1768410596 status=200 resp_size=6946
2026-01-15 01:09:57.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410597&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
2026-01-15 01:10:06.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768410605 status=200 resp_size=4956
2026-01-15 01:10:06.563 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410606&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:10:16.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768410615 status=200 resp_size=7382
2026-01-15 01:10:16.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410616&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 01:10:24.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768410624 status=200 resp_size=7331
2026-01-15 01:10:24.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410624&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 01:10:34.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job&timestamp=1768410634 status=200 resp_size=5087
2026-01-15 01:10:35.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410634&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
2026-01-15 01:10:38.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job&timestamp=1768410638 status=200 resp_size=6551
2026-01-15 01:10:38.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410638&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
2026-01-15 01:10:47.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768410646 status=200 resp_size=4515
2026-01-15 01:10:47.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410647&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-15 01:10:56.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768410655 status=200 resp_size=4865
2026-01-15 01:10:56.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410656&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-15 01:11:04.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job&timestamp=1768410664 status=200 resp_size=5494
2026-01-15 01:11:05.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410664&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 01:11:11.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768410670 status=200 resp_size=6572
2026-01-15 01:11:12.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410671&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-15 01:11:15.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768410675 status=200 resp_size=5670
2026-01-15 01:11:15.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410675&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 01:11:19.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768410678 status=200 resp_size=6137
2026-01-15 01:11:19.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410679&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-15 01:11:24.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768410684 status=200 resp_size=6303
2026-01-15 01:11:24.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410684&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 01:11:33.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768410692 status=200 resp_size=5465
2026-01-15 01:11:33.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410693&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 01:11:40.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768410700 status=200 resp_size=5725
2026-01-15 01:11:40.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410700&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-15 01:11:46.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job&timestamp=1768410706 status=200 resp_size=4737
2026-01-15 01:11:46.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410706&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 01:11:46.643 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 19
2026-01-15 01:11:52.078 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:11:52.078 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-15 01:12:01.064 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.97 秒后继续...
2026-01-15 01:12:01.064 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 16/26 页...
2026-01-15 01:12:01.064 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:12:01.090 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:12:01.955 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:12:03.165 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:12:05.380 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:12:05.380 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:12:05.945 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410721 status=200 resp_size=134255
2026-01-15 01:12:05.945 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:12:06.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job&timestamp=1768410725 status=200 resp_size=4297
2026-01-15 01:12:06.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410726&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
2026-01-15 01:12:15.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job&timestamp=1768410734 status=200 resp_size=5259
2026-01-15 01:12:15.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410735&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
2026-01-15 01:12:24.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768410743 status=200 resp_size=4786
2026-01-15 01:12:24.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410744&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 01:12:34.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768410754 status=200 resp_size=5742
2026-01-15 01:12:34.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410754&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 01:12:39.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768410759 status=200 resp_size=7248
2026-01-15 01:12:39.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410759&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 01:12:44.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768410764 status=200 resp_size=6326
2026-01-15 01:12:44.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410764&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 01:12:54.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768410773 status=200 resp_size=5466
2026-01-15 01:12:54.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410774&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 01:13:05.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job&timestamp=1768410784 status=200 resp_size=5037
2026-01-15 01:13:05.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410785&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 01:13:13.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job&timestamp=1768410792 status=200 resp_size=5631
2026-01-15 01:13:14.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410793&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 01:13:19.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job&timestamp=1768410798 status=200 resp_size=5979
2026-01-15 01:13:19.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410799&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
2026-01-15 01:13:26.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768410805 status=200 resp_size=6291
2026-01-15 01:13:26.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410806&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-15 01:13:29.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768410809 status=200 resp_size=5973
2026-01-15 01:13:30.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410809&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-15 01:13:31.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768410811 status=200 resp_size=5927
2026-01-15 01:13:32.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410811&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 01:13:39.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768410818 status=200 resp_size=6295
2026-01-15 01:13:39.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410819&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-15 01:13:48.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768410827 status=200 resp_size=5174
2026-01-15 01:13:48.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410828&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-15 01:13:55.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768410834 status=200 resp_size=6666
2026-01-15 01:13:55.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410835&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 01:14:01.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768410841 status=200 resp_size=4654
2026-01-15 01:14:01.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410841&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-15 01:14:05.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job&timestamp=1768410845 status=200 resp_size=6133
2026-01-15 01:14:05.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410845&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
2026-01-15 01:14:07.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job&timestamp=1768410847 status=200 resp_size=7057
2026-01-15 01:14:07.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410847&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
2026-01-15 01:14:13.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768410853 status=200 resp_size=6546
2026-01-15 01:14:13.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410853&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-15 01:14:13.770 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
2026-01-15 01:14:20.039 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:14:20.039 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-15 01:14:22.446 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.41 秒后继续...
2026-01-15 01:14:22.446 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 17/26 页...
2026-01-15 01:14:22.446 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:14:22.458 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:14:23.064 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:14:24.202 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:14:26.347 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:14:26.347 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:14:26.825 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410862 status=200 resp_size=121856
2026-01-15 01:14:26.825 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:14:26.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768410866 status=200 resp_size=4773
2026-01-15 01:14:27.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410866&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 01:14:36.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768410876 status=200 resp_size=5359
2026-01-15 01:14:37.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410876&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:14:40.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job&timestamp=1768410880 status=200 resp_size=6325
2026-01-15 01:14:40.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410880&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 01:14:50.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768410889 status=200 resp_size=6073
2026-01-15 01:14:50.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410890&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-15 01:14:52.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768410892 status=200 resp_size=5106
2026-01-15 01:14:52.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410892&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
2026-01-15 01:15:00.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768410900 status=200 resp_size=5306
2026-01-15 01:15:01.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410900&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-15 01:15:03.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768410903 status=200 resp_size=5111
2026-01-15 01:15:04.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410903&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 01:15:10.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job&timestamp=1768410910 status=200 resp_size=5915
2026-01-15 01:15:11.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410910&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 01:15:18.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768410917 status=200 resp_size=5282
2026-01-15 01:15:18.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410918&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 01:15:26.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job&timestamp=1768410926 status=200 resp_size=7722
2026-01-15 01:15:27.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410926&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 01:15:29.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768410929 status=200 resp_size=4719
2026-01-15 01:15:30.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410929&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-15 01:15:34.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job&timestamp=1768410933 status=200 resp_size=5693
2026-01-15 01:15:34.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410934&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:15:37.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job&timestamp=1768410936 status=200 resp_size=7688
2026-01-15 01:15:37.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410937&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 01:15:39.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job&timestamp=1768410939 status=200 resp_size=5294
2026-01-15 01:15:40.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410939&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:15:42.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job&timestamp=1768410942 status=200 resp_size=5943
2026-01-15 01:15:42.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410942&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
2026-01-15 01:15:44.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768410944 status=200 resp_size=4757
2026-01-15 01:15:44.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410944&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-15 01:15:48.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768410948 status=200 resp_size=5591
2026-01-15 01:15:49.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410948&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:15:50.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768410950 status=200 resp_size=5853
2026-01-15 01:15:50.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410950&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 01:15:58.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768410957 status=200 resp_size=5360
2026-01-15 01:15:58.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410958&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-15 01:16:09.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768410968 status=200 resp_size=5662
2026-01-15 01:16:09.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410969&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 01:16:09.417 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
2026-01-15 01:16:15.870 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:16:15.870 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-15 01:16:25.270 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.39 秒后继续...
2026-01-15 01:16:25.270 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 18/26 页...
2026-01-15 01:16:25.270 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:16:25.290 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:16:25.866 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:16:27.349 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:16:29.499 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:16:29.499 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:16:30.065 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768410985 status=200 resp_size=131037
2026-01-15 01:16:30.065 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:16:30.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job&timestamp=1768410990 status=200 resp_size=5317
2026-01-15 01:16:30.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410990&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:16:32.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job&timestamp=1768410991 status=200 resp_size=5651
2026-01-15 01:16:32.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410992&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 01:16:33.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768410993 status=200 resp_size=4333
2026-01-15 01:16:34.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768410993&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-15 01:16:43.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768411002 status=200 resp_size=6269
2026-01-15 01:16:43.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411003&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-15 01:16:52.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768411011 status=200 resp_size=5510
2026-01-15 01:16:52.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411012&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:16:55.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768411015 status=200 resp_size=5151
2026-01-15 01:16:56.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411015&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:17:05.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768411024 status=200 resp_size=5481
2026-01-15 01:17:05.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411025&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-15 01:17:10.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768411030 status=200 resp_size=6454
2026-01-15 01:17:10.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411030&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 01:17:19.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768411038 status=200 resp_size=8675
2026-01-15 01:17:19.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411039&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-15 01:17:23.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job&timestamp=1768411043 status=200 resp_size=5938
2026-01-15 01:17:23.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411043&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-15 01:17:33.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768411052 status=200 resp_size=8440
2026-01-15 01:17:33.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411053&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
2026-01-15 01:17:41.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768411060 status=200 resp_size=6458
2026-01-15 01:17:41.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411061&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 01:17:48.848 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job&timestamp=1768411068 status=200 resp_size=5227
2026-01-15 01:17:49.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411068&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 01:17:58.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768411077 status=200 resp_size=5162
2026-01-15 01:17:58.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411078&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-15 01:18:02.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job&timestamp=1768411082 status=200 resp_size=6408
2026-01-15 01:18:02.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411082&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
2026-01-15 01:18:10.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768411089 status=200 resp_size=6062
2026-01-15 01:18:10.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411090&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-15 01:18:16.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job&timestamp=1768411095 status=200 resp_size=5449
2026-01-15 01:18:16.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411096&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 01:18:24.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768411103 status=200 resp_size=5712
2026-01-15 01:18:24.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411104&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 01:18:26.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768411105 status=200 resp_size=6972
2026-01-15 01:18:26.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411106&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 01:18:27.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768411107 status=200 resp_size=5825
2026-01-15 01:18:28.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411107&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 01:18:28.175 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
2026-01-15 01:18:34.033 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:18:34.033 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-15 01:18:43.742 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.71 秒后继续...
2026-01-15 01:18:43.742 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 19/26 页...
2026-01-15 01:18:43.742 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:18:43.752 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:18:44.533 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:18:45.717 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:18:47.901 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:18:47.901 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:18:48.364 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768411123 status=200 resp_size=107904
2026-01-15 01:18:48.371 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:18:48.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768411128 status=200 resp_size=5494
2026-01-15 01:18:48.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411128&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 01:18:50.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768411129 status=200 resp_size=5845
2026-01-15 01:18:50.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411130&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 01:18:59.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768411137 status=200 resp_size=6139
2026-01-15 01:18:59.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411139&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 01:19:08.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768411148 status=200 resp_size=5603
2026-01-15 01:19:08.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411148&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 01:19:15.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768411154 status=200 resp_size=5636
2026-01-15 01:19:15.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411155&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-15 01:19:22.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768411161 status=200 resp_size=6222
2026-01-15 01:19:22.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411162&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 01:19:30.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job&timestamp=1768411169 status=200 resp_size=7704
2026-01-15 01:19:30.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411170&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 01:19:40.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768411180 status=200 resp_size=5400
2026-01-15 01:19:41.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411180&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 01:19:48.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768411188 status=200 resp_size=5846
2026-01-15 01:19:49.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411188&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 01:19:57.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768411196 status=200 resp_size=4627
2026-01-15 01:19:57.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411197&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 01:20:00.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768411199 status=200 resp_size=6070
2026-01-15 01:20:00.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411200&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:20:07.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768411206 status=200 resp_size=6340
2026-01-15 01:20:07.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411207&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-15 01:20:11.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768411210 status=200 resp_size=6892
2026-01-15 01:20:11.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411211&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 01:20:16.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768411216 status=200 resp_size=5290
2026-01-15 01:20:16.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411216&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 01:20:18.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768411218 status=200 resp_size=5964
2026-01-15 01:20:18.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411218&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:20:28.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768411228 status=200 resp_size=6423
2026-01-15 01:20:29.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411228&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 01:20:34.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768411234 status=200 resp_size=6490
2026-01-15 01:20:34.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411234&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-15 01:20:42.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768411241 status=200 resp_size=6194
2026-01-15 01:20:42.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411242&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-15 01:20:52.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768411252 status=200 resp_size=6066
2026-01-15 01:20:53.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411252&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:20:56.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768411256 status=200 resp_size=5526
2026-01-15 01:20:56.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411256&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-15 01:20:56.633 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
2026-01-15 01:21:02.071 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:21:02.071 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-15 01:21:06.016 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.93 秒后继续...
2026-01-15 01:21:06.016 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 20/26 页...
2026-01-15 01:21:06.016 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:21:06.040 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:21:06.668 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:21:07.815 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:21:09.968 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:21:09.968 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:21:10.361 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768411266 status=200 resp_size=106112
2026-01-15 01:21:10.361 | WARNING | __main__:get_recommend_jobs:745 - 第 20 页发现 1 个重复职位(已跳过)
2026-01-15 01:21:10.361 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:21:10.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768411270 status=200 resp_size=6815
2026-01-15 01:21:10.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411270&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-15 01:21:11.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768411271 status=200 resp_size=5822
2026-01-15 01:21:12.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411271&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 01:21:18.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768411277 status=200 resp_size=4786
2026-01-15 01:21:19.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411278&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 01:21:24.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768411284 status=200 resp_size=6984
2026-01-15 01:21:25.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411284&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-15 01:21:32.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768411292 status=200 resp_size=5414
2026-01-15 01:21:32.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411292&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 01:21:39.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768411299 status=200 resp_size=6066
2026-01-15 01:21:40.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411299&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 01:21:47.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768411306 status=200 resp_size=5541
2026-01-15 01:21:47.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411307&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 01:21:57.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768411316 status=200 resp_size=6058
2026-01-15 01:21:57.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411317&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-15 01:22:01.563 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job&timestamp=1768411321 status=200 resp_size=5879
2026-01-15 01:22:01.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411321&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 01:22:08.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768411327 status=200 resp_size=5379
2026-01-15 01:22:08.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411328&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 01:22:12.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768411332 status=200 resp_size=5651
2026-01-15 01:22:13.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411332&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 01:22:21.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768411340 status=200 resp_size=6286
2026-01-15 01:22:21.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411341&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 01:22:30.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job&timestamp=1768411350 status=200 resp_size=5496
2026-01-15 01:22:30.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411350&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 01:22:34.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job&timestamp=1768411354 status=200 resp_size=6106
2026-01-15 01:22:35.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411354&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-15 01:22:42.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768411361 status=200 resp_size=6326
2026-01-15 01:22:42.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411362&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-15 01:22:46.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768411366 status=200 resp_size=5398
2026-01-15 01:22:47.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411366&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 01:22:57.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768411376 status=200 resp_size=5294
2026-01-15 01:22:57.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411377&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:23:08.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768411387 status=200 resp_size=5984
2026-01-15 01:23:08.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411388&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-15 01:23:16.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768411395 status=200 resp_size=5679
2026-01-15 01:23:16.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411396&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
2026-01-15 01:23:16.637 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 19
2026-01-15 01:23:16.904 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:23:16.904 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-15 01:23:21.223 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.31 秒后继续...
2026-01-15 01:23:21.223 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 21/26 页...
2026-01-15 01:23:21.223 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:23:21.238 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:23:22.258 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:23:23.358 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:23:25.494 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:23:25.494 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:23:25.966 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768411401 status=200 resp_size=129203
2026-01-15 01:23:25.966 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:23:26.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job&timestamp=1768411405 status=200 resp_size=5833
2026-01-15 01:23:26.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411406&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
2026-01-15 01:23:32.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768411411 status=200 resp_size=6131
2026-01-15 01:23:32.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411412&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-15 01:23:43.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768411422 status=200 resp_size=6100
2026-01-15 01:23:43.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411423&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:23:45.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job&timestamp=1768411424 status=200 resp_size=5951
2026-01-15 01:23:45.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411425&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 01:23:49.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768411429 status=200 resp_size=6219
2026-01-15 01:23:49.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411429&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-15 01:23:55.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768411435 status=200 resp_size=6031
2026-01-15 01:23:56.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411435&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 01:23:57.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768411437 status=200 resp_size=5663
2026-01-15 01:23:57.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411437&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:23:59.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768411439 status=200 resp_size=5849
2026-01-15 01:23:59.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411439&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 01:24:05.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768411445 status=200 resp_size=6321
2026-01-15 01:24:06.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411445&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:24:09.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768411449 status=200 resp_size=6351
2026-01-15 01:24:09.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411449&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-15 01:24:14.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768411453 status=200 resp_size=5829
2026-01-15 01:24:14.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411454&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 01:24:17.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768411456 status=200 resp_size=5335
2026-01-15 01:24:17.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411457&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:24:25.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768411465 status=200 resp_size=6113
2026-01-15 01:24:26.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411465&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 01:24:32.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768411471 status=200 resp_size=5095
2026-01-15 01:24:32.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411472&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-15 01:24:34.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768411474 status=200 resp_size=5107
2026-01-15 01:24:35.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411474&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-15 01:24:39.019 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768411478 status=200 resp_size=6497
2026-01-15 01:24:39.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411479&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:24:46.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768411486 status=200 resp_size=6385
2026-01-15 01:24:46.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411486&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 01:24:55.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job&timestamp=1768411495 status=200 resp_size=4774
2026-01-15 01:24:55.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411495&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
2026-01-15 01:24:59.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job&timestamp=1768411499 status=200 resp_size=5463
2026-01-15 01:24:59.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411499&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 01:25:00.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768411500 status=200 resp_size=5473
2026-01-15 01:25:01.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411500&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:25:01.040 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
2026-01-15 01:25:06.962 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:25:06.962 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-15 01:25:16.502 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.53 秒后继续...
2026-01-15 01:25:16.502 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 22/26 页...
2026-01-15 01:25:16.502 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:25:16.528 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:25:17.110 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:25:18.273 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:25:20.411 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:25:20.411 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:25:20.866 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768411516 status=200 resp_size=138940
2026-01-15 01:25:20.866 | WARNING | __main__:get_recommend_jobs:745 - 第 22 页发现 1 个重复职位(已跳过)
2026-01-15 01:25:20.866 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:25:21.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768411520 status=200 resp_size=6963
2026-01-15 01:25:21.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411521&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 01:25:23.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768411523 status=200 resp_size=5448
2026-01-15 01:25:23.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411523&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 01:25:33.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768411531 status=200 resp_size=6053
2026-01-15 01:25:33.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411533&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 01:25:37.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768411537 status=200 resp_size=6074
2026-01-15 01:25:37.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411537&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:25:40.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768411540 status=200 resp_size=7079
2026-01-15 01:25:40.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411540&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 01:25:50.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job&timestamp=1768411549 status=200 resp_size=5197
2026-01-15 01:25:50.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411550&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:25:55.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768411555 status=200 resp_size=7337
2026-01-15 01:25:55.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411555&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 01:26:00.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job&timestamp=1768411560 status=200 resp_size=5503
2026-01-15 01:26:00.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411560&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:26:04.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768411564 status=200 resp_size=6216
2026-01-15 01:26:05.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411564&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 01:26:13.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768411573 status=200 resp_size=5703
2026-01-15 01:26:14.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411573&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:26:22.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job&timestamp=1768411581 status=200 resp_size=5924
2026-01-15 01:26:22.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411582&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 01:26:26.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768411586 status=200 resp_size=5236
2026-01-15 01:26:26.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411586&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:26:30.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768411590 status=200 resp_size=6271
2026-01-15 01:26:30.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411590&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-15 01:26:40.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768411599 status=200 resp_size=4841
2026-01-15 01:26:40.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411600&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:26:50.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768411609 status=200 resp_size=6316
2026-01-15 01:26:50.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411610&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 01:26:58.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768411618 status=200 resp_size=5321
2026-01-15 01:26:58.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411618&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:27:03.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768411622 status=200 resp_size=5112
2026-01-15 01:27:03.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411623&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:27:08.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768411628 status=200 resp_size=6150
2026-01-15 01:27:08.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411628&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 01:27:12.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768411632 status=200 resp_size=5188
2026-01-15 01:27:12.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411632&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:27:12.976 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 19
2026-01-15 01:27:18.756 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:27:18.756 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-15 01:27:28.650 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.89 秒后继续...
2026-01-15 01:27:28.650 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 23/26 页...
2026-01-15 01:27:28.650 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:27:28.665 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:27:29.435 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:27:30.612 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:27:32.795 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:27:32.795 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:27:33.266 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768411648 status=200 resp_size=133050
2026-01-15 01:27:33.266 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:27:33.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job&timestamp=1768411653 status=200 resp_size=5166
2026-01-15 01:27:33.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411653&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:27:39.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768411659 status=200 resp_size=5373
2026-01-15 01:27:39.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411659&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:27:42.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job&timestamp=1768411661 status=200 resp_size=5148
2026-01-15 01:27:42.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411662&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:27:48.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768411667 status=200 resp_size=4861
2026-01-15 01:27:48.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411668&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:27:50.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768411669 status=200 resp_size=5055
2026-01-15 01:27:50.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411670&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:27:52.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768411672 status=200 resp_size=4962
2026-01-15 01:27:52.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411672&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:27:53.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768411673 status=200 resp_size=4847
2026-01-15 01:27:53.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411673&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:27:56.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768411676 status=200 resp_size=5409
2026-01-15 01:27:56.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411676&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:28:05.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job&timestamp=1768411684 status=200 resp_size=5600
2026-01-15 01:28:05.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411685&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:28:11.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768411690 status=200 resp_size=5570
2026-01-15 01:28:11.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411691&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:28:16.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768411696 status=200 resp_size=5032
2026-01-15 01:28:16.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411696&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:28:23.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768411703 status=200 resp_size=5461
2026-01-15 01:28:23.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411703&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:28:33.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768411713 status=200 resp_size=5182
2026-01-15 01:28:33.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411713&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:28:41.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768411721 status=200 resp_size=5200
2026-01-15 01:28:42.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411721&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:28:52.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768411731 status=200 resp_size=5552
2026-01-15 01:28:52.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411732&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:29:02.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768411742 status=200 resp_size=5207
2026-01-15 01:29:03.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411742&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:29:04.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job&timestamp=1768411744 status=200 resp_size=5489
2026-01-15 01:29:04.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411744&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:29:06.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768411745 status=200 resp_size=5173
2026-01-15 01:29:06.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411746&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:29:13.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768411753 status=200 resp_size=5295
2026-01-15 01:29:13.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411753&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:29:22.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job&timestamp=1768411761 status=200 resp_size=4383
2026-01-15 01:29:22.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411762&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
2026-01-15 01:29:22.479 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
2026-01-15 01:29:28.556 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:29:28.556 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-15 01:29:36.547 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.99 秒后继续...
2026-01-15 01:29:36.547 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 24/26 页...
2026-01-15 01:29:36.547 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:29:36.566 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:29:37.053 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:29:38.168 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:29:40.287 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:29:40.287 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:29:40.774 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768411776 status=200 resp_size=125924
2026-01-15 01:29:40.774 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:29:40.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job&timestamp=1768411780 status=200 resp_size=6576
2026-01-15 01:29:41.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411780&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 01:29:49.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768411789 status=200 resp_size=10670
2026-01-15 01:29:50.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411789&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 01:29:59.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768411798 status=200 resp_size=4985
2026-01-15 01:29:59.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411799&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:30:09.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job&timestamp=1768411809 status=200 resp_size=5236
2026-01-15 01:30:10.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411809&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 01:30:17.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768411816 status=200 resp_size=4315
2026-01-15 01:30:17.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411817&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-15 01:30:27.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768411826 status=200 resp_size=7628
2026-01-15 01:30:27.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411827&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 01:30:30.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768411830 status=200 resp_size=4972
2026-01-15 01:30:30.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411830&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:30:33.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job&timestamp=1768411833 status=200 resp_size=6205
2026-01-15 01:30:33.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411833&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
2026-01-15 01:30:42.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job&timestamp=1768411842 status=200 resp_size=4425
2026-01-15 01:30:42.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411842&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 01:30:49.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768411849 status=200 resp_size=6095
2026-01-15 01:30:49.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411849&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:31:00.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768411859 status=200 resp_size=5158
2026-01-15 01:31:00.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411860&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:31:07.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768411867 status=200 resp_size=5147
2026-01-15 01:31:07.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411867&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-15 01:31:14.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job&timestamp=1768411873 status=200 resp_size=5806
2026-01-15 01:31:14.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411874&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 01:31:21.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768411879 status=200 resp_size=6101
2026-01-15 01:31:21.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411881&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:31:29.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768411888 status=200 resp_size=4978
2026-01-15 01:31:29.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411889&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:31:35.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768411894 status=200 resp_size=6401
2026-01-15 01:31:35.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411895&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 01:31:39.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768411899 status=200 resp_size=4991
2026-01-15 01:31:39.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411899&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-15 01:31:42.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768411901 status=200 resp_size=6117
2026-01-15 01:31:42.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411902&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:31:46.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768411906 status=200 resp_size=5026
2026-01-15 01:31:46.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411906&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:31:55.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768411914 status=200 resp_size=6793
2026-01-15 01:31:55.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411915&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 01:31:55.461 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
2026-01-15 01:32:01.491 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:32:01.491 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-15 01:32:05.989 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.49 秒后继续...
2026-01-15 01:32:05.989 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 25/26 页...
2026-01-15 01:32:05.989 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:32:06.016 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:32:06.739 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:32:07.933 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:32:10.119 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:32:10.119 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:32:10.759 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768411926 status=200 resp_size=144015
2026-01-15 01:32:10.759 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:32:10.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job&timestamp=1768411930 status=200 resp_size=5111
2026-01-15 01:32:11.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411930&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:32:20.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768411939 status=200 resp_size=6108
2026-01-15 01:32:20.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411940&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:32:23.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768411943 status=200 resp_size=4859
2026-01-15 01:32:23.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411943&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:32:25.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job&timestamp=1768411945 status=200 resp_size=6546
2026-01-15 01:32:25.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411945&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 01:32:34.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job&timestamp=1768411953 status=200 resp_size=5325
2026-01-15 01:32:34.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411954&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
2026-01-15 01:32:36.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job&timestamp=1768411956 status=200 resp_size=6109
2026-01-15 01:32:36.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411956&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:32:45.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job&timestamp=1768411964 status=200 resp_size=5992
2026-01-15 01:32:45.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411965&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 01:32:52.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job&timestamp=1768411971 status=200 resp_size=6315
2026-01-15 01:32:52.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411972&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
2026-01-15 01:33:00.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768411980 status=200 resp_size=7170
2026-01-15 01:33:01.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411980&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 01:33:02.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768411982 status=200 resp_size=6115
2026-01-15 01:33:03.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411982&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:33:08.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job&timestamp=1768411988 status=200 resp_size=4835
2026-01-15 01:33:08.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411988&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 01:33:17.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768411996 status=200 resp_size=7131
2026-01-15 01:33:17.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768411997&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-15 01:33:24.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768412003 status=200 resp_size=6770
2026-01-15 01:33:24.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412004&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 01:33:32.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768412011 status=200 resp_size=6044
2026-01-15 01:33:32.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412012&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:33:40.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768412019 status=200 resp_size=5684
2026-01-15 01:33:41.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412020&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:33:51.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768412030 status=200 resp_size=5215
2026-01-15 01:33:51.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412031&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-15 01:34:00.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768412040 status=200 resp_size=6794
2026-01-15 01:34:01.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412040&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 01:34:02.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768412042 status=200 resp_size=6107
2026-01-15 01:34:03.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412042&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:34:08.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job&timestamp=1768412047 status=200 resp_size=6749
2026-01-15 01:34:08.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412048&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
2026-01-15 01:34:18.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768412058 status=200 resp_size=4990
2026-01-15 01:34:18.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412058&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-15 01:34:18.993 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
2026-01-15 01:34:19.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:34:19.338 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-15 01:34:28.512 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.17 秒后继续...
2026-01-15 01:34:28.512 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 26/26 页...
2026-01-15 01:34:28.512 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:34:28.537 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=广安, 工作类型=1318
2026-01-15 01:34:29.652 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:34:31.332 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:34:33.662 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:34:33.671 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:34:34.195 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412068 status=200 resp_size=115722
2026-01-15 01:34:34.205 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17 | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
2026-01-15 01:34:34.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768412074 status=200 resp_size=6113
2026-01-15 01:34:34.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412074&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:34:43.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768412083 status=200 resp_size=6544
2026-01-15 01:34:44.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412083&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 01:34:46.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768412086 status=200 resp_size=7105
2026-01-15 01:34:46.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412086&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-15 01:34:52.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768412091 status=200 resp_size=6107
2026-01-15 01:34:52.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412092&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:35:01.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768412101 status=200 resp_size=6531
2026-01-15 01:35:01.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412101&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-15 01:35:05.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768412105 status=200 resp_size=4704
2026-01-15 01:35:05.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412105&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-15 01:35:16.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768412115 status=200 resp_size=6427
2026-01-15 01:35:16.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412116&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 01:35:24.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768412123 status=200 resp_size=6109
2026-01-15 01:35:24.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412124&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:35:33.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job&timestamp=1768412132 status=200 resp_size=5737
2026-01-15 01:35:33.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412133&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 01:35:44.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768412143 status=200 resp_size=5499
2026-01-15 01:35:44.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412144&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-15 01:35:47.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768412147 status=200 resp_size=5880
2026-01-15 01:35:47.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412147&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 01:35:55.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768412153 status=200 resp_size=6111
2026-01-15 01:35:55.585 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412155&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:36:01.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768412161 status=200 resp_size=5139
2026-01-15 01:36:02.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412161&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:36:06.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768412166 status=200 resp_size=5903
2026-01-15 01:36:06.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412166&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-15 01:36:08.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768412168 status=200 resp_size=5129
2026-01-15 01:36:08.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412168&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 01:36:15.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768412174 status=200 resp_size=6122
2026-01-15 01:36:15.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412175&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 01:36:18.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768412178 status=200 resp_size=5241
2026-01-15 01:36:18.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412178&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 01:36:18.534 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
2026-01-15 01:36:23.624 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 509 条
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 8 条
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 广安(广安)
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 专科医生(1318)
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 98.45% (509/517)
2026-01-15 01:36:23.624 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(509) < API返回总数(517),可能存在分页问题或数据过滤
2026-01-15 01:36:23.640 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-15 01:36:23.640 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-15 01:36:23.640 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 509 条记录)
2026-01-15 01:36:23.640 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 509 个职位
2026-01-15 01:36:23.640 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-15 01:36:31.906 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:36:31.920 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:36:32.263 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-15 01:36:32.263 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:36:32.295 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:36:32.860 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:36:33.958 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:36:36.093 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:36:36.093 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:36:36.642 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412192 status=200 resp_size=114197
2026-01-15 01:36:36.642 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:36:36.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768412196 status=200 resp_size=5670
2026-01-15 01:36:36.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412196&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 01:36:40.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768412200 status=200 resp_size=5820
2026-01-15 01:36:40.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412200&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 01:36:46.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768412206 status=200 resp_size=5184
2026-01-15 01:36:46.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412206&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 01:36:50.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job&timestamp=1768412210 status=200 resp_size=5761
2026-01-15 01:36:50.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412210&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 01:36:59.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768412219 status=200 resp_size=5029
2026-01-15 01:37:00.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412219&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 01:37:03.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768412223 status=200 resp_size=5579
2026-01-15 01:37:04.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412223&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 01:37:11.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768412230 status=200 resp_size=5000
2026-01-15 01:37:11.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412231&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-15 01:37:17.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768412236 status=200 resp_size=5546
2026-01-15 01:37:17.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412237&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 01:37:26.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768412245 status=200 resp_size=4913
2026-01-15 01:37:26.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412246&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 01:37:34.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768412254 status=200 resp_size=5630
2026-01-15 01:37:34.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412254&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 01:37:43.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768412262 status=200 resp_size=6579
2026-01-15 01:37:43.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412263&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-15 01:37:52.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768412272 status=200 resp_size=5739
2026-01-15 01:37:52.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412272&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-15 01:38:00.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768412280 status=200 resp_size=4954
2026-01-15 01:38:01.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412280&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 01:38:09.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768412288 status=200 resp_size=6192
2026-01-15 01:38:09.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412289&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 01:38:10.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768412290 status=200 resp_size=5890
2026-01-15 01:38:11.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412290&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 01:38:17.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768412297 status=200 resp_size=4892
2026-01-15 01:38:17.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412297&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 01:38:21.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job&timestamp=1768412301 status=200 resp_size=5976
2026-01-15 01:38:21.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412301&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 01:38:24.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768412304 status=200 resp_size=5431
2026-01-15 01:38:24.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412304&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-15 01:38:34.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768412313 status=200 resp_size=6023
2026-01-15 01:38:34.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412314&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 01:38:36.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768412316 status=200 resp_size=6048
2026-01-15 01:38:37.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412316&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 01:38:37.191 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
2026-01-15 01:38:37.475 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:38:37.475 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-15 01:38:37.475 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-15 01:38:43.692 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.20 秒后继续...
2026-01-15 01:38:43.692 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-15 01:38:43.692 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:38:43.711 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:38:44.276 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:38:45.391 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:38:47.536 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:38:47.542 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:38:47.982 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412323 status=200 resp_size=112524
2026-01-15 01:38:47.997 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:38:48.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768412327 status=200 resp_size=6399
2026-01-15 01:38:48.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412328&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:38:50.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job&timestamp=1768412330 status=200 resp_size=6192
2026-01-15 01:38:50.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412330&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
2026-01-15 01:39:01.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768412340 status=200 resp_size=5721
2026-01-15 01:39:01.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412341&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-15 01:39:11.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768412350 status=200 resp_size=5634
2026-01-15 01:39:11.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412351&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 01:39:20.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768412359 status=200 resp_size=6015
2026-01-15 01:39:20.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412360&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-15 01:39:26.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job&timestamp=1768412365 status=200 resp_size=6787
2026-01-15 01:39:26.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412366&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
2026-01-15 01:39:34.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768412373 status=200 resp_size=5480
2026-01-15 01:39:34.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412374&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-15 01:39:36.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768412376 status=200 resp_size=5189
2026-01-15 01:39:37.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412376&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-15 01:39:40.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job&timestamp=1768412380 status=200 resp_size=6137
2026-01-15 01:39:40.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412380&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
2026-01-15 01:39:50.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768412389 status=200 resp_size=6134
2026-01-15 01:39:50.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412390&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-15 01:39:59.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768412399 status=200 resp_size=5591
2026-01-15 01:39:59.785 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412399&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-15 01:40:06.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768412406 status=200 resp_size=5110
2026-01-15 01:40:07.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412406&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-15 01:40:10.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768412410 status=200 resp_size=5974
2026-01-15 01:40:11.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412410&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:40:13.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768412413 status=200 resp_size=5940
2026-01-15 01:40:13.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412413&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-15 01:40:18.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768412418 status=200 resp_size=5601
2026-01-15 01:40:18.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412418&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:40:21.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768412421 status=200 resp_size=5374
2026-01-15 01:40:21.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412421&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 01:40:26.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job&timestamp=1768412426 status=200 resp_size=6179
2026-01-15 01:40:26.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412426&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 01:40:33.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768412432 status=200 resp_size=5478
2026-01-15 01:40:33.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412433&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 01:40:36.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768412436 status=200 resp_size=5610
2026-01-15 01:40:37.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412436&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 01:40:46.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768412445 status=200 resp_size=5682
2026-01-15 01:40:46.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412446&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:40:46.452 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
2026-01-15 01:40:52.702 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:40:52.702 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-15 01:41:01.489 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.78 秒后继续...
2026-01-15 01:41:01.489 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-15 01:41:01.489 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:41:01.513 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:41:02.095 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:41:03.225 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:41:05.878 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:41:05.878 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:41:06.271 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412461 status=200 resp_size=110443
2026-01-15 01:41:06.271 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:41:06.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job&timestamp=1768412466 status=200 resp_size=5524
2026-01-15 01:41:06.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412466&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
2026-01-15 01:41:12.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768412472 status=200 resp_size=5502
2026-01-15 01:41:12.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412472&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 01:41:16.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job&timestamp=1768412476 status=200 resp_size=6076
2026-01-15 01:41:16.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412476&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 01:41:19.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768412479 status=200 resp_size=5653
2026-01-15 01:41:19.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412479&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-15 01:41:29.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job&timestamp=1768412488 status=200 resp_size=5677
2026-01-15 01:41:29.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412489&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
2026-01-15 01:41:34.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768412494 status=200 resp_size=5513
2026-01-15 01:41:34.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412494&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-15 01:41:41.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768412500 status=200 resp_size=6285
2026-01-15 01:41:41.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412501&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-15 01:41:45.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768412505 status=200 resp_size=5127
2026-01-15 01:41:46.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412505&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-15 01:41:49.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job&timestamp=1768412509 status=200 resp_size=5845
2026-01-15 01:41:49.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412509&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:41:58.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768412517 status=200 resp_size=5182
2026-01-15 01:41:58.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412518&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-15 01:42:05.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768412524 status=200 resp_size=5968
2026-01-15 01:42:05.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412525&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-15 01:42:14.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768412533 status=200 resp_size=5321
2026-01-15 01:42:14.630 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412534&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:42:24.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768412544 status=200 resp_size=6318
2026-01-15 01:42:24.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412544&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-15 01:42:34.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768412553 status=200 resp_size=5732
2026-01-15 01:42:34.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412554&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 01:42:36.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768412556 status=200 resp_size=5729
2026-01-15 01:42:36.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412556&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 01:42:40.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job&timestamp=1768412560 status=200 resp_size=5222
2026-01-15 01:42:40.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412560&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 01:42:43.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job&timestamp=1768412562 status=200 resp_size=5613
2026-01-15 01:42:43.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412563&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 01:42:46.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768412566 status=200 resp_size=5711
2026-01-15 01:42:46.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412566&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 01:42:53.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768412572 status=200 resp_size=6024
2026-01-15 01:42:53.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412573&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-15 01:43:01.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768412580 status=200 resp_size=5245
2026-01-15 01:43:01.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412581&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 01:43:01.432 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
2026-01-15 01:43:01.761 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:43:01.761 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-15 01:43:06.539 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.77 秒后继续...
2026-01-15 01:43:06.539 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-15 01:43:06.539 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:43:06.567 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:43:07.012 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:43:08.107 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:43:10.196 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:43:10.196 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:43:10.604 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412586 status=200 resp_size=119936
2026-01-15 01:43:10.604 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:43:10.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768412590 status=200 resp_size=7499
2026-01-15 01:43:10.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412590&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 01:43:20.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job&timestamp=1768412599 status=200 resp_size=6139
2026-01-15 01:43:20.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412600&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 01:43:28.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768412607 status=200 resp_size=6651
2026-01-15 01:43:28.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412608&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 01:43:37.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768412617 status=200 resp_size=5825
2026-01-15 01:43:38.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412617&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:43:45.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768412624 status=200 resp_size=6511
2026-01-15 01:43:45.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412625&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:43:51.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768412631 status=200 resp_size=6448
2026-01-15 01:43:51.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412631&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 01:44:01.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768412641 status=200 resp_size=6466
2026-01-15 01:44:02.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412641&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 01:44:03.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768412643 status=200 resp_size=5785
2026-01-15 01:44:03.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412643&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:44:10.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768412649 status=200 resp_size=6422
2026-01-15 01:44:10.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412650&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-15 01:44:15.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768412655 status=200 resp_size=5803
2026-01-15 01:44:15.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412655&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 01:44:22.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768412661 status=200 resp_size=5961
2026-01-15 01:44:22.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412662&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:44:29.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768412668 status=200 resp_size=6392
2026-01-15 01:44:29.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412669&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 01:44:31.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768412671 status=200 resp_size=8364
2026-01-15 01:44:31.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412671&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-15 01:44:42.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768412681 status=200 resp_size=6045
2026-01-15 01:44:42.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412682&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:44:49.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768412688 status=200 resp_size=6511
2026-01-15 01:44:49.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412689&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 01:44:51.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768412691 status=200 resp_size=5936
2026-01-15 01:44:52.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412691&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:44:56.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job&timestamp=1768412696 status=200 resp_size=5876
2026-01-15 01:44:56.585 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412696&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 01:44:59.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768412699 status=200 resp_size=4058
2026-01-15 01:45:00.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412699&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-15 01:45:02.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768412702 status=200 resp_size=5228
2026-01-15 01:45:03.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412702&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:45:05.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768412705 status=200 resp_size=6177
2026-01-15 01:45:06.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412705&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 01:45:06.084 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
2026-01-15 01:45:06.460 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:45:06.460 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-15 01:45:12.748 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.29 秒后继续...
2026-01-15 01:45:12.748 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-15 01:45:12.748 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:45:12.775 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:45:13.292 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:45:14.549 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:45:16.699 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:45:16.699 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:45:17.186 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412712 status=200 resp_size=139609
2026-01-15 01:45:17.186 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:45:17.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768412717 status=200 resp_size=5756
2026-01-15 01:45:17.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412717&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:45:23.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768412723 status=200 resp_size=5634
2026-01-15 01:45:23.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412723&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:45:25.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768412725 status=200 resp_size=6125
2026-01-15 01:45:25.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412725&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 01:45:30.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768412729 status=200 resp_size=5888
2026-01-15 01:45:30.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412730&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 01:45:33.786 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768412733 status=200 resp_size=6856
2026-01-15 01:45:33.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412733&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
2026-01-15 01:45:40.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768412739 status=200 resp_size=6055
2026-01-15 01:45:40.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412740&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 01:45:45.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768412745 status=200 resp_size=5455
2026-01-15 01:45:45.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412745&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 01:45:51.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job&timestamp=1768412750 status=200 resp_size=7534
2026-01-15 01:45:51.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412751&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
2026-01-15 01:45:55.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768412754 status=200 resp_size=6718
2026-01-15 01:45:55.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412755&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-15 01:45:58.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768412758 status=200 resp_size=6314
2026-01-15 01:45:58.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412758&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
2026-01-15 01:46:04.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768412764 status=200 resp_size=6573
2026-01-15 01:46:04.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412764&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 01:46:14.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768412773 status=200 resp_size=6058
2026-01-15 01:46:14.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412774&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:46:23.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768412783 status=200 resp_size=6715
2026-01-15 01:46:23.829 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412783&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-15 01:46:25.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768412785 status=200 resp_size=5699
2026-01-15 01:46:25.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412785&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 01:46:33.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job&timestamp=1768412792 status=200 resp_size=5845
2026-01-15 01:46:33.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412793&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
2026-01-15 01:46:42.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768412802 status=200 resp_size=6473
2026-01-15 01:46:42.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412802&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:46:45.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768412805 status=200 resp_size=5211
2026-01-15 01:46:45.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412805&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
2026-01-15 01:46:54.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768412813 status=200 resp_size=5942
2026-01-15 01:46:54.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412814&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 01:46:59.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job&timestamp=1768412819 status=200 resp_size=8574
2026-01-15 01:46:59.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412819&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 01:47:02.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job&timestamp=1768412822 status=200 resp_size=6024
2026-01-15 01:47:02.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412822&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:47:02.769 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
2026-01-15 01:47:09.161 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:47:09.161 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-15 01:47:18.329 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.16 秒后继续...
2026-01-15 01:47:18.329 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-15 01:47:18.329 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:47:18.351 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:47:18.916 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:47:20.064 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:47:22.183 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:47:22.183 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:47:22.638 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412838 status=200 resp_size=139904
2026-01-15 01:47:22.638 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:47:22.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768412842 status=200 resp_size=6366
2026-01-15 01:47:22.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412842&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-15 01:47:26.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768412846 status=200 resp_size=6419
2026-01-15 01:47:26.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412846&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:47:27.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768412847 status=200 resp_size=7551
2026-01-15 01:47:27.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412847&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-15 01:47:36.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768412856 status=200 resp_size=5421
2026-01-15 01:47:36.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412856&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:47:38.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768412858 status=200 resp_size=5784
2026-01-15 01:47:39.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412858&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 01:47:47.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768412867 status=200 resp_size=5306
2026-01-15 01:47:48.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412867&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-15 01:47:50.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768412870 status=200 resp_size=7182
2026-01-15 01:47:50.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412870&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-15 01:47:59.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768412878 status=200 resp_size=5687
2026-01-15 01:47:59.554 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412879&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:48:09.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job&timestamp=1768412888 status=200 resp_size=5407
2026-01-15 01:48:09.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412889&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
2026-01-15 01:48:14.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768412893 status=200 resp_size=7285
2026-01-15 01:48:14.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412894&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 01:48:20.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job&timestamp=1768412899 status=200 resp_size=6343
2026-01-15 01:48:20.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412900&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
2026-01-15 01:48:29.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768412909 status=200 resp_size=6958
2026-01-15 01:48:30.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412909&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:48:31.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768412911 status=200 resp_size=8231
2026-01-15 01:48:32.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412911&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-15 01:48:40.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768412920 status=200 resp_size=7119
2026-01-15 01:48:40.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412920&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 01:48:45.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768412924 status=200 resp_size=5615
2026-01-15 01:48:45.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412925&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 01:48:54.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768412933 status=200 resp_size=6552
2026-01-15 01:48:54.270 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412934&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:49:00.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768412939 status=200 resp_size=6714
2026-01-15 01:49:00.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412940&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 01:49:04.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768412943 status=200 resp_size=5775
2026-01-15 01:49:04.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412944&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-15 01:49:11.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768412950 status=200 resp_size=6684
2026-01-15 01:49:11.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412951&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-15 01:49:13.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768412953 status=200 resp_size=5497
2026-01-15 01:49:13.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412953&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:49:13.619 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
2026-01-15 01:49:19.949 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:49:19.949 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-15 01:49:23.871 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.92 秒后继续...
2026-01-15 01:49:23.871 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-15 01:49:23.871 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:49:23.891 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:49:24.330 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:49:25.444 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:49:27.564 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:49:27.564 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:49:28.035 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768412963 status=200 resp_size=138138
2026-01-15 01:49:28.035 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:49:28.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768412968 status=200 resp_size=13102
2026-01-15 01:49:28.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412968&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 01:49:37.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768412976 status=200 resp_size=5128
2026-01-15 01:49:37.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412977&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 01:49:41.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job&timestamp=1768412981 status=200 resp_size=6362
2026-01-15 01:49:41.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412981&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 01:49:47.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768412987 status=200 resp_size=6689
2026-01-15 01:49:47.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412987&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:49:53.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768412993 status=200 resp_size=6527
2026-01-15 01:49:53.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768412993&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 01:50:03.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job&timestamp=1768413002 status=200 resp_size=7130
2026-01-15 01:50:03.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413003&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 01:50:05.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768413004 status=200 resp_size=7415
2026-01-15 01:50:05.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413005&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
2026-01-15 01:50:12.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job&timestamp=1768413011 status=200 resp_size=6390
2026-01-15 01:50:12.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413012&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:50:20.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job&timestamp=1768413019 status=200 resp_size=5152
2026-01-15 01:50:20.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413020&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
2026-01-15 01:50:25.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768413025 status=200 resp_size=5877
2026-01-15 01:50:25.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413025&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
2026-01-15 01:50:32.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768413031 status=200 resp_size=6041
2026-01-15 01:50:32.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413032&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-15 01:50:38.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768413037 status=200 resp_size=6254
2026-01-15 01:50:38.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413038&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:50:41.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768413041 status=200 resp_size=5098
2026-01-15 01:50:42.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413041&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 01:50:52.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768413051 status=200 resp_size=5711
2026-01-15 01:50:52.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413052&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 01:51:03.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768413062 status=200 resp_size=6970
2026-01-15 01:51:03.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413063&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 01:51:10.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job&timestamp=1768413069 status=200 resp_size=7120
2026-01-15 01:51:10.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413070&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:51:14.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768413074 status=200 resp_size=5109
2026-01-15 01:51:14.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413074&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 01:51:20.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job&timestamp=1768413080 status=200 resp_size=7717
2026-01-15 01:51:20.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413080&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
2026-01-15 01:51:23.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job&timestamp=1768413083 status=200 resp_size=8734
2026-01-15 01:51:23.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413083&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
2026-01-15 01:51:24.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768413084 status=200 resp_size=6230
2026-01-15 01:51:25.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413084&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:51:25.104 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
2026-01-15 01:51:31.389 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 01:51:31.389 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-15 01:51:37.313 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.92 秒后继续...
2026-01-15 01:51:37.313 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-15 01:51:37.313 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:51:37.340 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:51:38.031 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:51:39.195 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:51:41.360 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:51:41.360 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:51:41.848 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413097 status=200 resp_size=137357
2026-01-15 01:51:41.848 | WARNING | __main__:get_recommend_jobs:745 - 第 8 页发现 1 个重复职位(已跳过)
2026-01-15 01:51:41.848 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:51:42.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job&timestamp=1768413101 status=200 resp_size=4321
2026-01-15 01:51:42.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413102&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
2026-01-15 01:51:50.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job&timestamp=1768413110 status=200 resp_size=5531
2026-01-15 01:51:51.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413110&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
2026-01-15 01:52:00.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job&timestamp=1768413120 status=200 resp_size=5920
2026-01-15 01:52:00.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413120&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:52:03.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768413122 status=200 resp_size=6522
2026-01-15 01:52:03.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413123&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 01:52:05.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768413125 status=200 resp_size=7756
2026-01-15 01:52:05.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413125&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 01:52:12.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768413131 status=200 resp_size=7299
2026-01-15 01:52:12.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413132&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-15 01:52:19.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768413138 status=200 resp_size=6445
2026-01-15 01:52:19.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413139&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:52:26.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job&timestamp=1768413145 status=200 resp_size=5458
2026-01-15 01:52:26.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413146&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
2026-01-15 01:52:28.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job&timestamp=1768413148 status=200 resp_size=7237
2026-01-15 01:52:28.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413148&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
2026-01-15 01:52:36.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768413155 status=200 resp_size=4995
2026-01-15 01:52:36.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413156&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:52:37.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768413157 status=200 resp_size=5342
2026-01-15 01:52:37.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413157&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-15 01:52:44.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job&timestamp=1768413163 status=200 resp_size=6431
2026-01-15 01:52:44.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413164&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
2026-01-15 01:52:47.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job&timestamp=1768413167 status=200 resp_size=7607
2026-01-15 01:52:48.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413167&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 01:52:54.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768413173 status=200 resp_size=6501
2026-01-15 01:52:54.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413174&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:53:02.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job&timestamp=1768413181 status=200 resp_size=6416
2026-01-15 01:53:02.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413182&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 01:53:07.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job&timestamp=1768413186 status=200 resp_size=5678
2026-01-15 01:53:07.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413187&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:53:10.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job&timestamp=1768413190 status=200 resp_size=6646
2026-01-15 01:53:10.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413190&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
2026-01-15 01:53:13.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768413193 status=200 resp_size=5477
2026-01-15 01:53:13.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413193&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-15 01:53:23.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768413202 status=200 resp_size=6449
2026-01-15 01:53:23.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413203&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-15 01:53:23.325 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 19
2026-01-15 01:53:29.434 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:53:29.434 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-15 01:53:34.647 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.20 秒后继续...
2026-01-15 01:53:34.647 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-15 01:53:34.648 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:53:34.664 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:53:35.308 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:53:36.471 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:53:38.623 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:53:38.623 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:53:39.161 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413214 status=200 resp_size=165078
2026-01-15 01:53:39.161 | WARNING | __main__:get_recommend_jobs:745 - 第 9 页发现 1 个重复职位(已跳过)
2026-01-15 01:53:39.161 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:53:39.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768413219 status=200 resp_size=8457
2026-01-15 01:53:39.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413219&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:53:41.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768413221 status=200 resp_size=5925
2026-01-15 01:53:42.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413221&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
2026-01-15 01:53:48.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768413227 status=200 resp_size=7750
2026-01-15 01:53:48.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413228&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 01:53:57.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768413237 status=200 resp_size=7971
2026-01-15 01:53:58.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413237&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 01:54:07.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768413246 status=200 resp_size=6764
2026-01-15 01:54:07.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413247&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:54:09.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768413249 status=200 resp_size=8313
2026-01-15 01:54:09.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413249&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-15 01:54:16.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job&timestamp=1768413256 status=200 resp_size=5424
2026-01-15 01:54:16.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413256&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
2026-01-15 01:54:24.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job&timestamp=1768413264 status=200 resp_size=8301
2026-01-15 01:54:25.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413264&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
2026-01-15 01:54:33.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768413272 status=200 resp_size=6168
2026-01-15 01:54:33.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413273&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:54:40.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768413279 status=200 resp_size=8701
2026-01-15 01:54:40.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413280&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-15 01:54:43.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job&timestamp=1768413283 status=200 resp_size=5378
2026-01-15 01:54:43.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413283&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
2026-01-15 01:54:50.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job&timestamp=1768413289 status=200 resp_size=7262
2026-01-15 01:54:50.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413290&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 01:54:56.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job&timestamp=1768413295 status=200 resp_size=7967
2026-01-15 01:54:56.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413296&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
2026-01-15 01:55:07.245 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768413306 status=200 resp_size=5253
2026-01-15 01:55:07.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413307&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 01:55:17.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768413316 status=200 resp_size=5431
2026-01-15 01:55:17.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413317&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 01:55:19.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768413319 status=200 resp_size=6119
2026-01-15 01:55:20.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413319&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:55:23.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768413322 status=200 resp_size=6080
2026-01-15 01:55:23.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413323&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 01:55:28.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768413328 status=200 resp_size=5916
2026-01-15 01:55:28.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413328&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-15 01:55:33.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768413333 status=200 resp_size=4916
2026-01-15 01:55:33.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413333&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 01:55:33.684 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 19
2026-01-15 01:55:40.092 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:55:40.092 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-15 01:55:47.529 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.42 秒后继续...
2026-01-15 01:55:47.529 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-15 01:55:47.529 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:55:47.551 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:55:48.101 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:55:49.218 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:55:51.355 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:55:51.355 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:55:51.826 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413347 status=200 resp_size=134843
2026-01-15 01:55:51.826 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 2 个重复职位(已跳过)
2026-01-15 01:55:51.826 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 18 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:55:51.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768413351 status=200 resp_size=6053
2026-01-15 01:55:52.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413351&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 01:55:59.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768413358 status=200 resp_size=6494
2026-01-15 01:55:59.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413359&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
2026-01-15 01:56:02.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768413362 status=200 resp_size=6226
2026-01-15 01:56:02.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413362&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-15 01:56:04.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768413364 status=200 resp_size=6284
2026-01-15 01:56:04.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413364&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:56:08.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768413368 status=200 resp_size=6176
2026-01-15 01:56:08.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413368&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-15 01:56:18.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768413378 status=200 resp_size=5673
2026-01-15 01:56:19.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413378&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-15 01:56:25.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job&timestamp=1768413385 status=200 resp_size=6731
2026-01-15 01:56:25.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413385&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 01:56:27.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768413387 status=200 resp_size=5856
2026-01-15 01:56:27.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413387&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:56:34.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job&timestamp=1768413393 status=200 resp_size=5575
2026-01-15 01:56:34.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413394&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 01:56:44.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768413403 status=200 resp_size=5731
2026-01-15 01:56:44.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413404&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-15 01:56:54.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768413413 status=200 resp_size=7075
2026-01-15 01:56:54.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413414&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 01:57:01.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768413420 status=200 resp_size=5792
2026-01-15 01:57:01.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413421&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:57:11.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768413430 status=200 resp_size=6526
2026-01-15 01:57:11.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413431&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:57:21.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768413440 status=200 resp_size=8973
2026-01-15 01:57:21.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413441&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
2026-01-15 01:57:28.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768413448 status=200 resp_size=8559
2026-01-15 01:57:29.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413448&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
2026-01-15 01:57:30.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768413450 status=200 resp_size=6688
2026-01-15 01:57:30.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413450&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-15 01:57:37.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768413457 status=200 resp_size=5290
2026-01-15 01:57:38.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413457&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 01:57:44.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768413464 status=200 resp_size=5982
2026-01-15 01:57:45.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413464&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-15 01:57:45.024 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 18
2026-01-15 01:57:50.695 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-15 01:57:50.695 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-15 01:57:54.180 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.47 秒后继续...
2026-01-15 01:57:54.180 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-15 01:57:54.180 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:57:54.193 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:57:54.696 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:57:55.796 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:57:57.916 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:57:57.916 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:57:58.371 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413474 status=200 resp_size=139155
2026-01-15 01:57:58.371 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
2026-01-15 01:57:58.371 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:57:58.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job&timestamp=1768413478 status=200 resp_size=7919
2026-01-15 01:57:58.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413478&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
2026-01-15 01:58:02.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job&timestamp=1768413482 status=200 resp_size=7681
2026-01-15 01:58:02.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413482&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
2026-01-15 01:58:08.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768413488 status=200 resp_size=5259
2026-01-15 01:58:09.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413488&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 01:58:10.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job&timestamp=1768413490 status=200 resp_size=5414
2026-01-15 01:58:10.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413490&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 01:58:16.019 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job&timestamp=1768413495 status=200 resp_size=6660
2026-01-15 01:58:16.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413496&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 01:58:26.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job&timestamp=1768413506 status=200 resp_size=7952
2026-01-15 01:58:26.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413506&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
2026-01-15 01:58:30.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job&timestamp=1768413509 status=200 resp_size=6635
2026-01-15 01:58:30.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413510&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
2026-01-15 01:58:40.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768413520 status=200 resp_size=5277
2026-01-15 01:58:40.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413520&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-15 01:58:50.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768413529 status=200 resp_size=7175
2026-01-15 01:58:50.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413530&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-15 01:58:56.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768413535 status=200 resp_size=6280
2026-01-15 01:58:56.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413536&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:59:04.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768413544 status=200 resp_size=5924
2026-01-15 01:59:05.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413544&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-15 01:59:12.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768413551 status=200 resp_size=6003
2026-01-15 01:59:12.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413552&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-15 01:59:13.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768413553 status=200 resp_size=5672
2026-01-15 01:59:13.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413553&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-15 01:59:17.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768413557 status=200 resp_size=5378
2026-01-15 01:59:17.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413557&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-15 01:59:21.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768413560 status=200 resp_size=5084
2026-01-15 01:59:21.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413561&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 01:59:24.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768413564 status=200 resp_size=9486
2026-01-15 01:59:24.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413564&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 01:59:32.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768413571 status=200 resp_size=5363
2026-01-15 01:59:32.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413572&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-15 01:59:38.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job&timestamp=1768413577 status=200 resp_size=13285
2026-01-15 01:59:38.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413578&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 01:59:44.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768413583 status=200 resp_size=6869
2026-01-15 01:59:44.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413584&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 01:59:44.427 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
2026-01-15 01:59:50.349 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 01:59:50.349 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-15 01:59:54.956 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.60 秒后继续...
2026-01-15 01:59:54.956 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-15 01:59:54.956 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 01:59:54.982 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 01:59:55.579 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:59:56.706 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:59:58.815 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 01:59:58.815 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 01:59:59.255 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413594 status=200 resp_size=125658
2026-01-15 01:59:59.255 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 01:59:59.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job&timestamp=1768413599 status=200 resp_size=6041
2026-01-15 01:59:59.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413599&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
2026-01-15 02:00:10.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768413609 status=200 resp_size=5390
2026-01-15 02:00:10.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413610&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-15 02:00:14.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job&timestamp=1768413614 status=200 resp_size=8070
2026-01-15 02:00:14.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413614&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 02:00:23.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768413622 status=200 resp_size=6588
2026-01-15 02:00:23.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413623&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 02:00:30.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job&timestamp=1768413629 status=200 resp_size=6300
2026-01-15 02:00:30.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413630&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
2026-01-15 02:00:32.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768413632 status=200 resp_size=6069
2026-01-15 02:00:33.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413632&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:00:42.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768413642 status=200 resp_size=7194
2026-01-15 02:00:42.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413642&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 02:00:46.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768413646 status=200 resp_size=7170
2026-01-15 02:00:46.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413646&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 02:00:56.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job&timestamp=1768413655 status=200 resp_size=4572
2026-01-15 02:00:56.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413656&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
2026-01-15 02:01:05.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768413665 status=200 resp_size=4992
2026-01-15 02:01:06.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413665&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-15 02:01:12.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768413672 status=200 resp_size=7194
2026-01-15 02:01:13.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413672&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-15 02:01:21.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768413680 status=200 resp_size=5332
2026-01-15 02:01:21.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413681&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 02:01:23.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768413682 status=200 resp_size=5554
2026-01-15 02:01:23.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413683&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:01:33.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768413692 status=200 resp_size=5280
2026-01-15 02:01:33.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413693&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 02:01:40.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768413699 status=200 resp_size=5040
2026-01-15 02:01:40.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413700&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-15 02:01:44.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768413704 status=200 resp_size=4993
2026-01-15 02:01:44.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413704&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:01:45.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768413705 status=200 resp_size=6748
2026-01-15 02:01:45.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413705&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:01:55.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768413714 status=200 resp_size=5883
2026-01-15 02:01:55.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413715&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-15 02:01:57.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768413717 status=200 resp_size=5764
2026-01-15 02:01:57.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413717&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 02:02:05.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768413724 status=200 resp_size=6980
2026-01-15 02:02:05.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413725&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 02:02:05.282 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
2026-01-15 02:02:11.076 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:02:11.076 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-15 02:02:17.297 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.22 秒后继续...
2026-01-15 02:02:17.297 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-15 02:02:17.297 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:02:17.312 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:02:17.925 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:02:19.056 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:02:21.179 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:02:21.179 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:02:21.729 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413737 status=200 resp_size=148282
2026-01-15 02:02:21.729 | WARNING | __main__:get_recommend_jobs:745 - 第 13 页发现 1 个重复职位(已跳过)
2026-01-15 02:02:21.729 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:02:21.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768413741 status=200 resp_size=5283
2026-01-15 02:02:22.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413741&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:02:25.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768413744 status=200 resp_size=5501
2026-01-15 02:02:25.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413745&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-15 02:02:35.251 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768413754 status=200 resp_size=6659
2026-01-15 02:02:35.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413755&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 02:02:38.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job&timestamp=1768413758 status=200 resp_size=5165
2026-01-15 02:02:38.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413758&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
2026-01-15 02:02:40.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job&timestamp=1768413760 status=200 resp_size=5570
2026-01-15 02:02:41.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413760&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
2026-01-15 02:02:42.726 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768413762 status=200 resp_size=9108
2026-01-15 02:02:42.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413762&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-15 02:02:47.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768413766 status=200 resp_size=5688
2026-01-15 02:02:47.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413767&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
2026-01-15 02:02:50.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768413770 status=200 resp_size=6380
2026-01-15 02:02:50.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413770&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 02:02:57.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job&timestamp=1768413776 status=200 resp_size=6621
2026-01-15 02:02:57.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413777&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
2026-01-15 02:03:01.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job&timestamp=1768413780 status=200 resp_size=7975
2026-01-15 02:03:01.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413781&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
2026-01-15 02:03:06.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job&timestamp=1768413785 status=200 resp_size=5984
2026-01-15 02:03:06.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413786&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 02:03:13.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job&timestamp=1768413793 status=200 resp_size=5582
2026-01-15 02:03:14.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413793&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 02:03:20.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768413799 status=200 resp_size=6939
2026-01-15 02:03:20.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413800&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-15 02:03:24.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job&timestamp=1768413804 status=200 resp_size=5924
2026-01-15 02:03:24.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413804&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
2026-01-15 02:03:30.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job&timestamp=1768413810 status=200 resp_size=6027
2026-01-15 02:03:31.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413810&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
2026-01-15 02:03:33.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job&timestamp=1768413813 status=200 resp_size=6028
2026-01-15 02:03:33.578 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413813&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 02:03:35.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768413815 status=200 resp_size=6111
2026-01-15 02:03:35.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413815&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
2026-01-15 02:03:37.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768413817 status=200 resp_size=8782
2026-01-15 02:03:37.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413817&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 02:03:45.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768413825 status=200 resp_size=8655
2026-01-15 02:03:46.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413825&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-15 02:03:46.061 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 19
2026-01-15 02:03:51.796 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 02:03:51.796 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-15 02:03:54.815 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.01 秒后继续...
2026-01-15 02:03:54.815 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-15 02:03:54.815 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:03:54.843 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:03:55.455 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:03:56.602 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:03:58.769 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:03:58.769 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:03:59.240 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413834 status=200 resp_size=143984
2026-01-15 02:03:59.240 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:03:59.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job&timestamp=1768413839 status=200 resp_size=6440
2026-01-15 02:03:59.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413839&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
2026-01-15 02:04:06.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768413845 status=200 resp_size=7907
2026-01-15 02:04:06.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413846&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-15 02:04:12.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job&timestamp=1768413852 status=200 resp_size=4592
2026-01-15 02:04:13.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413852&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
2026-01-15 02:04:21.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768413861 status=200 resp_size=5878
2026-01-15 02:04:21.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413861&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 02:04:26.349 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job&timestamp=1768413866 status=200 resp_size=6437
2026-01-15 02:04:26.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413866&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 02:04:37.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768413876 status=200 resp_size=7313
2026-01-15 02:04:37.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413877&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-15 02:04:44.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job&timestamp=1768413884 status=200 resp_size=6958
2026-01-15 02:04:45.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413884&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
2026-01-15 02:04:46.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768413886 status=200 resp_size=6694
2026-01-15 02:04:46.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413886&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
2026-01-15 02:04:55.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768413895 status=200 resp_size=6568
2026-01-15 02:04:56.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413895&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-15 02:05:04.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768413903 status=200 resp_size=5922
2026-01-15 02:05:04.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413904&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 02:05:13.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job&timestamp=1768413913 status=200 resp_size=5499
2026-01-15 02:05:14.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413913&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
2026-01-15 02:05:22.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768413922 status=200 resp_size=6184
2026-01-15 02:05:23.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413922&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-15 02:05:24.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768413924 status=200 resp_size=5673
2026-01-15 02:05:24.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413924&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-15 02:05:30.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768413929 status=200 resp_size=7081
2026-01-15 02:05:30.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413930&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 02:05:37.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768413936 status=200 resp_size=7664
2026-01-15 02:05:37.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413937&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 02:05:45.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768413944 status=200 resp_size=6652
2026-01-15 02:05:45.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413945&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-15 02:05:49.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768413949 status=200 resp_size=4733
2026-01-15 02:05:49.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413949&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:05:59.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768413958 status=200 resp_size=4926
2026-01-15 02:05:59.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413959&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 02:06:06.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768413965 status=200 resp_size=4906
2026-01-15 02:06:06.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413966&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 02:06:12.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job&timestamp=1768413972 status=200 resp_size=7369
2026-01-15 02:06:12.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413972&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 02:06:12.622 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
2026-01-15 02:06:18.698 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:06:18.698 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-15 02:06:25.374 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.67 秒后继续...
2026-01-15 02:06:25.374 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-15 02:06:25.374 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:06:25.403 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:06:26.063 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:06:27.224 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:06:29.376 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:06:29.376 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:06:29.879 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768413985 status=200 resp_size=136405
2026-01-15 02:06:29.879 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:06:30.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768413989 status=200 resp_size=4834
2026-01-15 02:06:30.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413990&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:06:33.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768413993 status=200 resp_size=5006
2026-01-15 02:06:33.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413993&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 02:06:39.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768413999 status=200 resp_size=5363
2026-01-15 02:06:39.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768413999&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-15 02:06:47.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768414007 status=200 resp_size=5241
2026-01-15 02:06:47.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414007&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-15 02:06:56.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768414015 status=200 resp_size=5232
2026-01-15 02:06:56.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414016&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-15 02:07:03.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job&timestamp=1768414022 status=200 resp_size=6946
2026-01-15 02:07:03.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414023&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
2026-01-15 02:07:12.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768414031 status=200 resp_size=4956
2026-01-15 02:07:12.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414032&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:07:16.967 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768414036 status=200 resp_size=7382
2026-01-15 02:07:17.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414036&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 02:07:27.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768414047 status=200 resp_size=7331
2026-01-15 02:07:28.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414047&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 02:07:30.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job&timestamp=1768414050 status=200 resp_size=5087
2026-01-15 02:07:30.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414050&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
2026-01-15 02:07:32.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job&timestamp=1768414052 status=200 resp_size=6551
2026-01-15 02:07:33.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414052&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
2026-01-15 02:07:34.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768414054 status=200 resp_size=4515
2026-01-15 02:07:34.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414054&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-15 02:07:38.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768414058 status=200 resp_size=4865
2026-01-15 02:07:39.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414058&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-15 02:07:43.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job&timestamp=1768414062 status=200 resp_size=5494
2026-01-15 02:07:43.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414063&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 02:07:49.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768414068 status=200 resp_size=6572
2026-01-15 02:07:49.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414069&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-15 02:07:58.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768414078 status=200 resp_size=5674
2026-01-15 02:07:58.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414078&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 02:08:01.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768414081 status=200 resp_size=6139
2026-01-15 02:08:01.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414081&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-15 02:08:11.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768414091 status=200 resp_size=6303
2026-01-15 02:08:11.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414091&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 02:08:21.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768414101 status=200 resp_size=5469
2026-01-15 02:08:22.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414101&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 02:08:25.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768414104 status=200 resp_size=5725
2026-01-15 02:08:25.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414105&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-15 02:08:25.368 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
2026-01-15 02:08:31.113 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:08:31.113 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-15 02:08:34.993 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.88 秒后继续...
2026-01-15 02:08:34.993 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 16/26 页...
2026-01-15 02:08:34.993 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:08:35.009 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:08:35.480 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:08:36.602 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:08:38.713 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:08:38.713 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:08:39.153 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768414115 status=200 resp_size=137375
2026-01-15 02:08:39.153 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:08:39.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job&timestamp=1768414119 status=200 resp_size=4737
2026-01-15 02:08:39.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414119&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 02:08:48.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job&timestamp=1768414127 status=200 resp_size=4297
2026-01-15 02:08:48.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414128&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
2026-01-15 02:08:51.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768414131 status=200 resp_size=6856
2026-01-15 02:08:51.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414131&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 02:08:58.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job&timestamp=1768414137 status=200 resp_size=5259
2026-01-15 02:08:58.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414138&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
2026-01-15 02:09:08.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768414148 status=200 resp_size=4786
2026-01-15 02:09:08.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414148&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 02:09:10.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768414150 status=200 resp_size=5746
2026-01-15 02:09:11.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414150&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 02:09:18.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768414158 status=200 resp_size=7248
2026-01-15 02:09:19.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414158&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 02:09:23.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768414163 status=200 resp_size=6326
2026-01-15 02:09:23.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414163&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 02:09:28.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768414168 status=200 resp_size=5483
2026-01-15 02:09:28.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414168&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 02:09:31.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job&timestamp=1768414171 status=200 resp_size=5037
2026-01-15 02:09:31.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414171&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 02:09:41.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job&timestamp=1768414180 status=200 resp_size=5631
2026-01-15 02:09:41.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414181&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 02:09:43.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job&timestamp=1768414183 status=200 resp_size=5979
2026-01-15 02:09:43.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414183&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
2026-01-15 02:09:45.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768414184 status=200 resp_size=6264
2026-01-15 02:09:45.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414185&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-15 02:09:52.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768414191 status=200 resp_size=5973
2026-01-15 02:09:52.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414192&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-15 02:09:57.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768414197 status=200 resp_size=5928
2026-01-15 02:09:57.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414197&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 02:10:00.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768414200 status=200 resp_size=6295
2026-01-15 02:10:00.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414200&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-15 02:10:03.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job&timestamp=1768414202 status=200 resp_size=5806
2026-01-15 02:10:03.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414203&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 02:10:07.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768414207 status=200 resp_size=5174
2026-01-15 02:10:08.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414207&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-15 02:10:14.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768414213 status=200 resp_size=6666
2026-01-15 02:10:14.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414214&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 02:10:19.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768414218 status=200 resp_size=4654
2026-01-15 02:10:19.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414219&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-15 02:10:19.259 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
2026-01-15 02:10:25.398 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:10:25.398 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-15 02:10:29.373 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.96 秒后继续...
2026-01-15 02:10:29.373 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 17/26 页...
2026-01-15 02:10:29.373 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:10:29.389 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:10:29.908 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:10:31.038 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:10:33.174 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:10:33.174 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:10:33.645 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768414229 status=200 resp_size=118859
2026-01-15 02:10:33.645 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:10:33.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job&timestamp=1768414233 status=200 resp_size=7057
2026-01-15 02:10:33.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414233&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
2026-01-15 02:10:40.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768414240 status=200 resp_size=6546
2026-01-15 02:10:41.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414240&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-15 02:10:45.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job&timestamp=1768414245 status=200 resp_size=4679
2026-01-15 02:10:45.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414245&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-15 02:10:49.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768414249 status=200 resp_size=4783
2026-01-15 02:10:49.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414249&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 02:10:58.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768414257 status=200 resp_size=5359
2026-01-15 02:10:58.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414258&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:11:00.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job&timestamp=1768414260 status=200 resp_size=6325
2026-01-15 02:11:01.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414260&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 02:11:04.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768414264 status=200 resp_size=5106
2026-01-15 02:11:05.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414264&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
2026-01-15 02:11:07.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768414267 status=200 resp_size=5306
2026-01-15 02:11:07.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414267&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-15 02:11:10.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768414270 status=200 resp_size=6073
2026-01-15 02:11:11.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414270&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-15 02:11:16.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768414275 status=200 resp_size=5111
2026-01-15 02:11:16.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414276&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 02:11:19.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job&timestamp=1768414278 status=200 resp_size=5915
2026-01-15 02:11:19.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414279&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 02:11:25.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768414284 status=200 resp_size=5282
2026-01-15 02:11:25.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414285&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 02:11:32.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job&timestamp=1768414291 status=200 resp_size=7722
2026-01-15 02:11:32.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414292&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 02:11:38.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768414298 status=200 resp_size=4719
2026-01-15 02:11:39.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414298&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-15 02:11:45.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job&timestamp=1768414304 status=200 resp_size=5693
2026-01-15 02:11:46.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414305&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:11:54.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job&timestamp=1768414314 status=200 resp_size=7688
2026-01-15 02:11:55.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414314&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 02:11:58.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job&timestamp=1768414317 status=200 resp_size=5294
2026-01-15 02:11:58.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414318&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:12:04.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job&timestamp=1768414323 status=200 resp_size=5943
2026-01-15 02:12:04.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414324&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
2026-01-15 02:12:12.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768414332 status=200 resp_size=4757
2026-01-15 02:12:12.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414332&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-15 02:12:19.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768414338 status=200 resp_size=5591
2026-01-15 02:12:19.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414339&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:12:19.574 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
2026-01-15 02:12:25.115 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:12:25.115 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-15 02:12:26.237 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.12 秒后继续...
2026-01-15 02:12:26.237 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 18/26 页...
2026-01-15 02:12:26.237 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:12:26.263 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:12:26.843 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:12:27.974 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:12:30.112 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:12:30.112 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:12:30.646 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768414346 status=200 resp_size=133535
2026-01-15 02:12:30.646 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:12:30.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768414350 status=200 resp_size=5853
2026-01-15 02:12:30.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414350&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 02:12:38.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768414357 status=200 resp_size=5360
2026-01-15 02:12:38.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414358&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-15 02:12:47.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768414366 status=200 resp_size=5666
2026-01-15 02:12:47.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414367&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 02:12:53.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job&timestamp=1768414372 status=200 resp_size=5317
2026-01-15 02:12:53.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414373&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:12:54.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job&timestamp=1768414374 status=200 resp_size=5651
2026-01-15 02:12:54.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414374&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 02:13:02.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job&timestamp=1768414382 status=200 resp_size=4864
2026-01-15 02:13:03.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414382&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:13:06.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768414386 status=200 resp_size=4333
2026-01-15 02:13:06.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414386&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-15 02:13:07.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768414387 status=200 resp_size=5510
2026-01-15 02:13:08.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414387&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:13:12.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768414392 status=200 resp_size=6269
2026-01-15 02:13:12.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414392&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-15 02:13:21.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768414400 status=200 resp_size=5151
2026-01-15 02:13:22.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414401&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:13:33.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768414412 status=200 resp_size=5481
2026-01-15 02:13:33.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414413&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-15 02:13:36.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768414416 status=200 resp_size=6454
2026-01-15 02:13:36.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414416&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 02:13:38.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768414417 status=200 resp_size=8675
2026-01-15 02:13:38.251 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414418&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-15 02:13:46.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job&timestamp=1768414425 status=200 resp_size=5938
2026-01-15 02:13:46.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414426&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-15 02:13:54.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768414434 status=200 resp_size=8440
2026-01-15 02:13:55.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414434&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
2026-01-15 02:14:05.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768414444 status=200 resp_size=6458
2026-01-15 02:14:05.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414445&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 02:14:08.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job&timestamp=1768414448 status=200 resp_size=5227
2026-01-15 02:14:08.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414448&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 02:14:13.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768414453 status=200 resp_size=5162
2026-01-15 02:14:13.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414453&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-15 02:14:15.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job&timestamp=1768414455 status=200 resp_size=6414
2026-01-15 02:14:15.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414455&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
2026-01-15 02:14:26.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768414465 status=200 resp_size=6062
2026-01-15 02:14:26.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414466&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-15 02:14:26.827 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
2026-01-15 02:14:32.829 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:14:32.829 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-15 02:14:40.843 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.00 秒后继续...
2026-01-15 02:14:40.843 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 19/26 页...
2026-01-15 02:14:40.843 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:14:40.868 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:14:41.371 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:14:42.503 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:14:44.623 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:14:44.623 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:14:45.047 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768414480 status=200 resp_size=108713
2026-01-15 02:14:45.047 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:14:45.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job&timestamp=1768414485 status=200 resp_size=5449
2026-01-15 02:14:45.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414485&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 02:14:52.725 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768414492 status=200 resp_size=5712
2026-01-15 02:14:52.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414492&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 02:15:01.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768414501 status=200 resp_size=6976
2026-01-15 02:15:01.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414501&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 02:15:07.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768414507 status=200 resp_size=5837
2026-01-15 02:15:08.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414507&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 02:15:18.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768414517 status=200 resp_size=5503
2026-01-15 02:15:18.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414518&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 02:15:26.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768414525 status=200 resp_size=5845
2026-01-15 02:15:26.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414526&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 02:15:32.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768414532 status=200 resp_size=6139
2026-01-15 02:15:33.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414532&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 02:15:40.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768414540 status=200 resp_size=5603
2026-01-15 02:15:41.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414540&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 02:15:49.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768414548 status=200 resp_size=5636
2026-01-15 02:15:49.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414549&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-15 02:15:54.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768414553 status=200 resp_size=6222
2026-01-15 02:15:54.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414554&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 02:15:58.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job&timestamp=1768414558 status=200 resp_size=7746
2026-01-15 02:15:59.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414558&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 02:16:06.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768414566 status=200 resp_size=5400
2026-01-15 02:16:07.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414566&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 02:16:10.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768414570 status=200 resp_size=5846
2026-01-15 02:16:10.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414570&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 02:16:12.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768414571 status=200 resp_size=4627
2026-01-15 02:16:12.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414572&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 02:16:21.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768414581 status=200 resp_size=6070
2026-01-15 02:16:22.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414581&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:16:29.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768414588 status=200 resp_size=6340
2026-01-15 02:16:29.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414589&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-15 02:16:32.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768414592 status=200 resp_size=6896
2026-01-15 02:16:32.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414592&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 02:16:42.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768414601 status=200 resp_size=5290
2026-01-15 02:16:42.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414602&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 02:16:52.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768414611 status=200 resp_size=5964
2026-01-15 02:16:52.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414612&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:17:01.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768414620 status=200 resp_size=6432
2026-01-15 02:17:01.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414621&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 02:17:01.393 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
2026-01-15 02:17:06.794 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:17:06.810 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-15 02:17:16.174 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.36 秒后继续...
2026-01-15 02:17:16.174 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 20/26 页...
2026-01-15 02:17:16.174 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:17:16.187 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:17:16.879 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:17:18.042 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:17:20.210 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:17:20.210 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:17:20.666 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768414636 status=200 resp_size=106463
2026-01-15 02:17:20.666 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:17:20.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768414640 status=200 resp_size=6490
2026-01-15 02:17:21.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414640&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-15 02:17:30.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768414650 status=200 resp_size=6190
2026-01-15 02:17:31.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414650&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-15 02:17:36.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768414655 status=200 resp_size=6066
2026-01-15 02:17:36.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414656&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:17:45.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768414665 status=200 resp_size=5526
2026-01-15 02:17:46.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414665&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-15 02:17:50.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768414669 status=200 resp_size=6819
2026-01-15 02:17:50.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414670&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-15 02:18:00.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768414679 status=200 resp_size=5820
2026-01-15 02:18:00.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414680&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 02:18:02.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768414682 status=200 resp_size=4782
2026-01-15 02:18:02.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414682&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:18:10.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768414689 status=200 resp_size=6984
2026-01-15 02:18:10.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414690&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-15 02:18:15.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768414695 status=200 resp_size=5414
2026-01-15 02:18:15.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414695&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 02:18:17.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768414697 status=200 resp_size=6066
2026-01-15 02:18:18.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414697&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 02:18:19.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768414699 status=200 resp_size=5541
2026-01-15 02:18:19.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414699&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 02:18:29.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768414709 status=200 resp_size=6058
2026-01-15 02:18:29.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414709&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-15 02:18:36.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job&timestamp=1768414715 status=200 resp_size=5879
2026-01-15 02:18:36.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414716&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 02:18:40.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768414720 status=200 resp_size=5379
2026-01-15 02:18:40.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414720&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 02:18:43.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768414723 status=200 resp_size=5655
2026-01-15 02:18:43.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414723&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 02:18:52.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768414731 status=200 resp_size=6286
2026-01-15 02:18:52.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414732&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 02:19:00.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job&timestamp=1768414739 status=200 resp_size=5496
2026-01-15 02:19:00.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414740&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 02:19:08.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job&timestamp=1768414748 status=200 resp_size=6106
2026-01-15 02:19:08.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414748&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-15 02:19:10.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768414750 status=200 resp_size=6326
2026-01-15 02:19:10.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414750&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-15 02:19:17.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768414756 status=200 resp_size=5398
2026-01-15 02:19:17.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414757&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 02:19:17.455 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
2026-01-15 02:19:18.035 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:19:18.035 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-15 02:19:19.759 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.71 秒后继续...
2026-01-15 02:19:19.759 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 21/26 页...
2026-01-15 02:19:19.759 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:19:19.778 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:19:20.438 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:19:21.600 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:19:23.767 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:19:23.767 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:19:24.254 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768414759 status=200 resp_size=121017
2026-01-15 02:19:24.254 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:19:24.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768414764 status=200 resp_size=5294
2026-01-15 02:19:24.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414764&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:19:26.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768414766 status=200 resp_size=5984
2026-01-15 02:19:27.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414766&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-15 02:19:36.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768414775 status=200 resp_size=5662
2026-01-15 02:19:36.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414776&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
2026-01-15 02:19:45.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job&timestamp=1768414785 status=200 resp_size=5833
2026-01-15 02:19:46.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414785&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
2026-01-15 02:19:53.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768414792 status=200 resp_size=6131
2026-01-15 02:19:53.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414793&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-15 02:20:01.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768414801 status=200 resp_size=6100
2026-01-15 02:20:01.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414801&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:20:08.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job&timestamp=1768414808 status=200 resp_size=5951
2026-01-15 02:20:08.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414808&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 02:20:13.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768414812 status=200 resp_size=6219
2026-01-15 02:20:13.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414813&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-15 02:20:17.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768414817 status=200 resp_size=6029
2026-01-15 02:20:17.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414817&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 02:20:26.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768414825 status=200 resp_size=5681
2026-01-15 02:20:26.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414826&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:20:30.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768414830 status=200 resp_size=5849
2026-01-15 02:20:30.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414830&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 02:20:34.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768414834 status=200 resp_size=5335
2026-01-15 02:20:34.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414834&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:20:36.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768414836 status=200 resp_size=6351
2026-01-15 02:20:37.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414836&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-15 02:20:46.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768414845 status=200 resp_size=5829
2026-01-15 02:20:46.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414846&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 02:20:56.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768414855 status=200 resp_size=6321
2026-01-15 02:20:56.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414856&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:20:59.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768414859 status=200 resp_size=6113
2026-01-15 02:20:59.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414859&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 02:21:09.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768414869 status=200 resp_size=5095
2026-01-15 02:21:10.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414869&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-15 02:21:17.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768414877 status=200 resp_size=5107
2026-01-15 02:21:18.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414877&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-15 02:21:21.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768414881 status=200 resp_size=6497
2026-01-15 02:21:21.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414881&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:21:28.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768414888 status=200 resp_size=6385
2026-01-15 02:21:28.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414888&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 02:21:28.997 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
2026-01-15 02:21:34.716 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:21:34.716 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-15 02:21:40.290 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.56 秒后继续...
2026-01-15 02:21:40.290 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 22/26 页...
2026-01-15 02:21:40.290 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:21:40.309 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:21:40.796 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:21:41.896 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:21:44.000 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:21:44.000 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:21:44.456 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768414900 status=200 resp_size=143660
2026-01-15 02:21:44.456 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:21:44.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job&timestamp=1768414904 status=200 resp_size=4774
2026-01-15 02:21:44.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414904&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
2026-01-15 02:21:46.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job&timestamp=1768414906 status=200 resp_size=5463
2026-01-15 02:21:46.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414906&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 02:21:54.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768414913 status=200 resp_size=5473
2026-01-15 02:21:54.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414914&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:22:01.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768414921 status=200 resp_size=6963
2026-01-15 02:22:02.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414921&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 02:22:10.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768414929 status=200 resp_size=5448
2026-01-15 02:22:10.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414930&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 02:22:19.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768414938 status=200 resp_size=6053
2026-01-15 02:22:19.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414939&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 02:22:24.726 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768414944 status=200 resp_size=6074
2026-01-15 02:22:24.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414944&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:22:31.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768414950 status=200 resp_size=7079
2026-01-15 02:22:31.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414951&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 02:22:42.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job&timestamp=1768414961 status=200 resp_size=5197
2026-01-15 02:22:42.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414962&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:22:52.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768414972 status=200 resp_size=7337
2026-01-15 02:22:53.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414972&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 02:22:55.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job&timestamp=1768414974 status=200 resp_size=5503
2026-01-15 02:22:55.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414975&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:23:01.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768414980 status=200 resp_size=6216
2026-01-15 02:23:01.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414981&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 02:23:04.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768414984 status=200 resp_size=5703
2026-01-15 02:23:04.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414984&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:23:07.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job&timestamp=1768414986 status=200 resp_size=5924
2026-01-15 02:23:07.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414987&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 02:23:10.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768414990 status=200 resp_size=5236
2026-01-15 02:23:10.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414990&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:23:14.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768414994 status=200 resp_size=6275
2026-01-15 02:23:14.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768414994&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-15 02:23:22.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768415001 status=200 resp_size=4841
2026-01-15 02:23:22.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415002&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:23:29.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768415008 status=200 resp_size=6316
2026-01-15 02:23:29.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415009&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 02:23:35.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768415014 status=200 resp_size=5321
2026-01-15 02:23:35.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415015&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:23:43.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job&timestamp=1768415023 status=200 resp_size=6213
2026-01-15 02:23:43.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415023&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
2026-01-15 02:23:43.866 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
2026-01-15 02:23:49.852 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:23:49.852 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-15 02:23:52.469 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.61 秒后继续...
2026-01-15 02:23:52.469 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 23/26 页...
2026-01-15 02:23:52.469 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:23:52.489 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:23:53.150 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:23:54.296 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:23:56.448 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:23:56.448 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:23:56.887 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415032 status=200 resp_size=134521
2026-01-15 02:23:56.887 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:23:57.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768415036 status=200 resp_size=5112
2026-01-15 02:23:57.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415037&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:24:02.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768415042 status=200 resp_size=6150
2026-01-15 02:24:02.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415042&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 02:24:07.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768415047 status=200 resp_size=5188
2026-01-15 02:24:07.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415047&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:24:11.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job&timestamp=1768415051 status=200 resp_size=5166
2026-01-15 02:24:11.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415051&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:24:15.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768415055 status=200 resp_size=5373
2026-01-15 02:24:15.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415055&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:24:31.665 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
2026-01-15 02:24:31.665 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
2026-01-15 02:24:31.680 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:24:31.680 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
2026-01-15 02:24:31.680 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:24:32.309 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job&timestamp=1768415061 status=200 resp_size=5148
2026-01-15 02:24:32.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415072&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:24:35.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768415075 status=200 resp_size=4861
2026-01-15 02:24:35.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415075&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:24:38.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768415078 status=200 resp_size=5055
2026-01-15 02:24:38.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415078&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:24:48.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768415088 status=200 resp_size=4962
2026-01-15 02:24:49.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415088&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:24:53.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768415092 status=200 resp_size=4847
2026-01-15 02:24:53.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415093&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:25:09.735 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
2026-01-15 02:25:09.735 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
2026-01-15 02:25:09.735 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:25:09.735 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
2026-01-15 02:25:09.735 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:25:10.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768415099 status=200 resp_size=5409
2026-01-15 02:25:10.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415110&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:25:28.188 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
2026-01-15 02:25:28.188 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
2026-01-15 02:25:28.188 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:25:28.188 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
2026-01-15 02:25:28.188 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:25:38.350 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 2/3): 517 Proxy Setup Failed
2026-01-15 02:25:38.350 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
2026-01-15 02:25:38.350 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:25:38.350 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
2026-01-15 02:25:38.350 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:25:39.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job&timestamp=1768415118 status=200 resp_size=5600
2026-01-15 02:25:39.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415139&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:25:45.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768415145 status=200 resp_size=5570
2026-01-15 02:25:45.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415145&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:25:49.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768415149 status=200 resp_size=5032
2026-01-15 02:25:49.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415149&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:25:54.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768415154 status=200 resp_size=5461
2026-01-15 02:25:55.165 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415154&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:26:05.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768415164 status=200 resp_size=5182
2026-01-15 02:26:05.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415165&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:26:14.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768415173 status=200 resp_size=5200
2026-01-15 02:26:14.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415174&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:26:19.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768415179 status=200 resp_size=5552
2026-01-15 02:26:19.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415179&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:26:28.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768415187 status=200 resp_size=5207
2026-01-15 02:26:28.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415188&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:26:37.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job&timestamp=1768415196 status=200 resp_size=5489
2026-01-15 02:26:37.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415197&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:26:37.728 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
2026-01-15 02:26:43.851 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:26:43.851 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-15 02:26:46.839 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.98 秒后继续...
2026-01-15 02:26:46.839 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 24/26 页...
2026-01-15 02:26:46.839 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:26:46.866 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:26:47.400 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:26:48.514 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:26:50.635 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:26:50.635 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:26:51.121 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415206 status=200 resp_size=128204
2026-01-15 02:26:51.121 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:26:51.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768415211 status=200 resp_size=5173
2026-01-15 02:26:51.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415211&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:26:57.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768415216 status=200 resp_size=5295
2026-01-15 02:26:57.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415217&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:26:59.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job&timestamp=1768415218 status=200 resp_size=4383
2026-01-15 02:26:59.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415219&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
2026-01-15 02:27:06.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job&timestamp=1768415226 status=200 resp_size=6576
2026-01-15 02:27:07.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415226&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 02:27:09.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768415228 status=200 resp_size=10634
2026-01-15 02:27:09.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415229&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 02:27:16.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768415235 status=200 resp_size=4985
2026-01-15 02:27:16.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415236&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:27:23.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768415242 status=200 resp_size=4990
2026-01-15 02:27:23.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415243&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-15 02:27:31.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job&timestamp=1768415251 status=200 resp_size=5236
2026-01-15 02:27:31.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415251&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 02:27:34.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768415254 status=200 resp_size=4315
2026-01-15 02:27:34.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415254&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-15 02:27:35.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768415255 status=200 resp_size=4972
2026-01-15 02:27:35.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415255&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:27:40.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768415260 status=200 resp_size=7628
2026-01-15 02:27:40.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415260&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 02:27:47.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job&timestamp=1768415267 status=200 resp_size=6205
2026-01-15 02:27:47.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415267&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
2026-01-15 02:27:55.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job&timestamp=1768415274 status=200 resp_size=4425
2026-01-15 02:27:55.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415275&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 02:28:04.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768415284 status=200 resp_size=5158
2026-01-15 02:28:04.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415284&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:28:12.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768415292 status=200 resp_size=6095
2026-01-15 02:28:13.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415292&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:28:15.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768415295 status=200 resp_size=5147
2026-01-15 02:28:15.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415295&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-15 02:28:19.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768415299 status=200 resp_size=6401
2026-01-15 02:28:20.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415299&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 02:28:26.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768415306 status=200 resp_size=4978
2026-01-15 02:28:27.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415306&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:28:33.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768415313 status=200 resp_size=6101
2026-01-15 02:28:33.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415313&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:28:36.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768415316 status=200 resp_size=4991
2026-01-15 02:28:36.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415316&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-15 02:28:36.348 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
2026-01-15 02:28:36.694 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:28:36.694 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-15 02:28:42.311 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.60 秒后继续...
2026-01-15 02:28:42.311 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 25/26 页...
2026-01-15 02:28:42.311 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:28:42.334 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:28:43.001 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:28:44.157 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:28:46.311 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:28:46.311 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:28:46.843 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415322 status=200 resp_size=139622
2026-01-15 02:28:46.860 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:28:47.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768415326 status=200 resp_size=6793
2026-01-15 02:28:47.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415327&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 02:28:50.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768415330 status=200 resp_size=5026
2026-01-15 02:28:50.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415330&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:28:59.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768415339 status=200 resp_size=6117
2026-01-15 02:29:00.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415339&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:29:04.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job&timestamp=1768415344 status=200 resp_size=5111
2026-01-15 02:29:05.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415344&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:29:07.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job&timestamp=1768415347 status=200 resp_size=6546
2026-01-15 02:29:07.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415347&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 02:29:15.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768415355 status=200 resp_size=4859
2026-01-15 02:29:15.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415355&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:29:25.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768415364 status=200 resp_size=6108
2026-01-15 02:29:25.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415365&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:29:35.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job&timestamp=1768415374 status=200 resp_size=5325
2026-01-15 02:29:35.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415375&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
2026-01-15 02:29:40.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job&timestamp=1768415380 status=200 resp_size=6315
2026-01-15 02:29:40.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415380&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
2026-01-15 02:29:42.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job&timestamp=1768415382 status=200 resp_size=5992
2026-01-15 02:29:43.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415382&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 02:29:49.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job&timestamp=1768415388 status=200 resp_size=6109
2026-01-15 02:29:49.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415389&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:29:53.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job&timestamp=1768415393 status=200 resp_size=4835
2026-01-15 02:29:54.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415393&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 02:30:03.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768415403 status=200 resp_size=7131
2026-01-15 02:30:03.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415403&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-15 02:30:11.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768415411 status=200 resp_size=6770
2026-01-15 02:30:12.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415411&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 02:30:15.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768415415 status=200 resp_size=6115
2026-01-15 02:30:15.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415415&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:30:25.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768415424 status=200 resp_size=5215
2026-01-15 02:30:25.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415425&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-15 02:30:29.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job&timestamp=1768415428 status=200 resp_size=6749
2026-01-15 02:30:29.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415429&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
2026-01-15 02:30:31.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768415431 status=200 resp_size=6794
2026-01-15 02:30:31.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415431&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 02:30:32.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768415432 status=200 resp_size=6044
2026-01-15 02:30:32.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415432&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:30:42.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768415441 status=200 resp_size=6544
2026-01-15 02:30:42.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415442&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 02:30:42.179 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
2026-01-15 02:30:48.492 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:30:48.492 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-15 02:30:51.828 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.33 秒后继续...
2026-01-15 02:30:51.828 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 26/26 页...
2026-01-15 02:30:51.828 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:30:51.853 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=阜阳, 工作类型=6101
2026-01-15 02:30:52.403 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:30:53.519 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:30:55.655 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:30:55.655 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:30:56.159 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415451 status=200 resp_size=115115
2026-01-15 02:30:56.159 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17 | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
2026-01-15 02:30:56.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768415456 status=200 resp_size=7105
2026-01-15 02:30:56.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415456&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-15 02:31:05.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768415464 status=200 resp_size=6107
2026-01-15 02:31:05.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415465&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:31:06.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768415466 status=200 resp_size=6531
2026-01-15 02:31:06.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415466&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-15 02:31:12.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768415471 status=200 resp_size=4704
2026-01-15 02:31:12.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415472&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-15 02:31:14.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768415474 status=200 resp_size=6427
2026-01-15 02:31:14.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415474&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 02:31:21.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768415480 status=200 resp_size=6113
2026-01-15 02:31:21.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415481&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:31:27.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job&timestamp=1768415486 status=200 resp_size=5737
2026-01-15 02:31:27.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415487&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 02:31:34.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768415494 status=200 resp_size=5499
2026-01-15 02:31:35.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415494&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-15 02:31:41.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768415501 status=200 resp_size=5880
2026-01-15 02:31:42.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415501&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 02:31:44.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768415504 status=200 resp_size=6107
2026-01-15 02:31:44.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415504&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:31:47.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768415507 status=200 resp_size=5139
2026-01-15 02:31:47.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415507&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:31:55.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768415514 status=200 resp_size=5903
2026-01-15 02:31:55.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415515&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-15 02:32:04.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768415523 status=200 resp_size=5129
2026-01-15 02:32:04.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415524&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 02:32:14.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768415533 status=200 resp_size=6109
2026-01-15 02:32:14.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415534&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:32:22.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768415542 status=200 resp_size=5241
2026-01-15 02:32:23.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415542&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:32:31.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768415550 status=200 resp_size=6111
2026-01-15 02:32:31.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415551&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:32:36.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768415556 status=200 resp_size=6122
2026-01-15 02:32:36.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415556&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 02:32:36.440 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
2026-01-15 02:32:36.800 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 511 条
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 6 条
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 阜阳(阜阳)
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 网店店长(6101)
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 98.84% (511/517)
2026-01-15 02:32:36.816 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(511) < API返回总数(517),可能存在分页问题或数据过滤
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-15 02:32:36.816 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 511 条记录)
2026-01-15 02:32:36.816 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 511 个职位
2026-01-15 02:32:36.819 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-15 02:32:41.886 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:32:41.904 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:32:42.422 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-15 02:32:42.422 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:32:42.452 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:32:43.049 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:32:44.196 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:32:46.348 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:32:46.348 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:32:46.849 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415562 status=200 resp_size=116600
2026-01-15 02:32:46.849 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:32:47.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768415566 status=200 resp_size=5699
2026-01-15 02:32:47.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415567&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 02:32:51.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768415571 status=200 resp_size=5184
2026-01-15 02:32:51.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415571&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 02:32:58.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768415578 status=200 resp_size=5579
2026-01-15 02:32:58.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415578&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 02:33:07.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768415586 status=200 resp_size=5000
2026-01-15 02:33:07.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415587&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-15 02:33:12.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768415592 status=200 resp_size=5029
2026-01-15 02:33:12.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415592&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 02:33:21.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768415601 status=200 resp_size=5546
2026-01-15 02:33:22.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415601&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 02:33:31.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768415610 status=200 resp_size=5630
2026-01-15 02:33:31.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415611&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 02:33:35.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768415615 status=200 resp_size=6579
2026-01-15 02:33:36.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415615&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-15 02:33:39.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768415619 status=200 resp_size=4954
2026-01-15 02:33:39.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415619&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 02:33:49.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768415628 status=200 resp_size=5739
2026-01-15 02:33:49.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415629&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-15 02:33:52.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768415632 status=200 resp_size=6192
2026-01-15 02:33:52.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415632&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 02:33:57.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768415637 status=200 resp_size=5803
2026-01-15 02:33:57.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415637&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 02:34:05.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job&timestamp=1768415644 status=200 resp_size=5976
2026-01-15 02:34:05.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415645&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 02:34:11.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768415650 status=200 resp_size=5890
2026-01-15 02:34:11.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415651&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 02:34:19.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768415659 status=200 resp_size=4892
2026-01-15 02:34:20.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415659&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 02:34:28.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768415667 status=200 resp_size=5431
2026-01-15 02:34:28.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415668&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-15 02:34:32.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768415672 status=200 resp_size=6399
2026-01-15 02:34:33.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415672&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:34:38.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768415678 status=200 resp_size=6023
2026-01-15 02:34:38.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415678&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 02:34:48.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768415688 status=200 resp_size=6048
2026-01-15 02:34:48.846 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415688&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 02:34:56.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job&timestamp=1768415695 status=200 resp_size=6192
2026-01-15 02:34:56.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415696&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
2026-01-15 02:34:56.589 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
2026-01-15 02:35:02.477 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:35:02.477 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-15 02:35:02.477 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-15 02:35:05.949 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.47 秒后继续...
2026-01-15 02:35:05.949 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-15 02:35:05.949 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:35:05.980 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:35:06.420 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:35:07.535 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:35:09.641 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:35:09.641 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:35:09.986 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415705 status=200 resp_size=106552
2026-01-15 02:35:09.986 | WARNING | __main__:get_recommend_jobs:745 - 第 2 页发现 1 个重复职位(已跳过)
2026-01-15 02:35:09.986 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:35:10.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768415710 status=200 resp_size=6015
2026-01-15 02:35:10.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415710&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-15 02:35:13.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job&timestamp=1768415713 status=200 resp_size=5744
2026-01-15 02:35:13.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415713&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 02:35:17.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768415717 status=200 resp_size=5721
2026-01-15 02:35:17.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415717&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-15 02:35:19.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768415719 status=200 resp_size=5634
2026-01-15 02:35:20.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415719&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 02:35:27.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job&timestamp=1768415726 status=200 resp_size=6137
2026-01-15 02:35:27.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415727&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
2026-01-15 02:35:32.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job&timestamp=1768415732 status=200 resp_size=6787
2026-01-15 02:35:32.726 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415732&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
2026-01-15 02:35:39.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768415738 status=200 resp_size=5480
2026-01-15 02:35:39.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415739&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-15 02:35:42.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768415742 status=200 resp_size=5190
2026-01-15 02:35:42.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415742&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-15 02:35:50.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768415750 status=200 resp_size=6366
2026-01-15 02:35:50.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415750&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-15 02:36:00.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768415759 status=200 resp_size=6134
2026-01-15 02:36:00.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415760&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-15 02:36:07.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768415767 status=200 resp_size=5591
2026-01-15 02:36:08.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415767&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-15 02:36:11.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768415771 status=200 resp_size=5110
2026-01-15 02:36:11.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415771&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-15 02:36:14.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768415774 status=200 resp_size=6423
2026-01-15 02:36:14.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415774&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:36:17.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768415776 status=200 resp_size=5960
2026-01-15 02:36:17.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415777&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-15 02:36:27.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768415787 status=200 resp_size=5613
2026-01-15 02:36:28.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415787&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:36:34.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768415793 status=200 resp_size=5374
2026-01-15 02:36:34.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415794&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 02:36:39.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768415799 status=200 resp_size=5478
2026-01-15 02:36:39.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415799&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 02:36:47.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768415807 status=200 resp_size=5603
2026-01-15 02:36:48.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415807&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 02:36:54.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768415813 status=200 resp_size=5694
2026-01-15 02:36:54.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415814&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:36:54.227 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 19
2026-01-15 02:36:59.707 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 02:36:59.707 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-15 02:37:07.710 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.00 秒后继续...
2026-01-15 02:37:07.710 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-15 02:37:07.710 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:37:07.729 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:37:08.310 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:37:09.441 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:37:11.579 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:37:11.579 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:37:12.051 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415827 status=200 resp_size=121946
2026-01-15 02:37:12.051 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:37:12.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job&timestamp=1768415832 status=200 resp_size=6179
2026-01-15 02:37:12.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415832&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 02:37:15.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768415835 status=200 resp_size=5506
2026-01-15 02:37:15.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415835&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:37:23.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job&timestamp=1768415842 status=200 resp_size=6076
2026-01-15 02:37:23.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415843&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 02:37:31.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768415851 status=200 resp_size=5653
2026-01-15 02:37:31.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415851&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-15 02:37:33.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job&timestamp=1768415853 status=200 resp_size=5677
2026-01-15 02:37:34.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415853&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
2026-01-15 02:37:42.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768415861 status=200 resp_size=5513
2026-01-15 02:37:42.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415862&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-15 02:37:51.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768415871 status=200 resp_size=6285
2026-01-15 02:37:52.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415871&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-15 02:38:00.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768415880 status=200 resp_size=5127
2026-01-15 02:38:00.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415880&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-15 02:38:06.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768415886 status=200 resp_size=5974
2026-01-15 02:38:06.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415886&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:38:12.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768415891 status=200 resp_size=5182
2026-01-15 02:38:12.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415892&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-15 02:38:17.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768415896 status=200 resp_size=5985
2026-01-15 02:38:17.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415897&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-15 02:38:20.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768415900 status=200 resp_size=5340
2026-01-15 02:38:20.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415900&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:38:29.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job&timestamp=1768415908 status=200 resp_size=7311
2026-01-15 02:38:29.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415909&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
2026-01-15 02:38:37.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768415916 status=200 resp_size=5725
2026-01-15 02:38:37.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415917&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 02:38:39.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768415919 status=200 resp_size=5729
2026-01-15 02:38:39.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415919&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 02:38:48.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job&timestamp=1768415928 status=200 resp_size=5222
2026-01-15 02:38:49.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415928&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 02:38:57.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768415936 status=200 resp_size=7499
2026-01-15 02:38:57.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415937&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 02:38:59.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768415939 status=200 resp_size=5723
2026-01-15 02:38:59.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415939&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 02:39:01.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768415941 status=200 resp_size=6025
2026-01-15 02:39:01.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415941&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-15 02:39:10.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768415949 status=200 resp_size=5245
2026-01-15 02:39:10.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415950&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 02:39:10.641 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
2026-01-15 02:39:16.260 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:39:16.260 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-15 02:39:25.893 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.62 秒后继续...
2026-01-15 02:39:25.893 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-15 02:39:25.893 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:39:25.918 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:39:26.469 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:39:27.614 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:39:29.752 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:39:29.752 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:39:30.223 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768415965 status=200 resp_size=118718
2026-01-15 02:39:30.239 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:39:30.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768415970 status=200 resp_size=8364
2026-01-15 02:39:30.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415970&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-15 02:39:35.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job&timestamp=1768415975 status=200 resp_size=6139
2026-01-15 02:39:35.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415975&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 02:39:42.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768415981 status=200 resp_size=6651
2026-01-15 02:39:42.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415982&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 02:39:45.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768415984 status=200 resp_size=5833
2026-01-15 02:39:45.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415985&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:39:48.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768415988 status=200 resp_size=5756
2026-01-15 02:39:49.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415988&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:39:58.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768415998 status=200 resp_size=6448
2026-01-15 02:39:59.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768415998&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 02:40:06.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768416006 status=200 resp_size=6466
2026-01-15 02:40:06.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416006&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 02:40:09.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768416009 status=200 resp_size=5793
2026-01-15 02:40:09.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416009&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:40:12.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job&timestamp=1768416012 status=200 resp_size=5632
2026-01-15 02:40:13.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416012&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
2026-01-15 02:40:21.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768416020 status=200 resp_size=5803
2026-01-15 02:40:21.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416021&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 02:40:23.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768416023 status=200 resp_size=5961
2026-01-15 02:40:23.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416023&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:40:27.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768416026 status=200 resp_size=6392
2026-01-15 02:40:27.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416027&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 02:40:30.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768416030 status=200 resp_size=6718
2026-01-15 02:40:30.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416030&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-15 02:40:36.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768416036 status=200 resp_size=6049
2026-01-15 02:40:37.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416036&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:40:43.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768416042 status=200 resp_size=6511
2026-01-15 02:40:43.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416043&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 02:40:48.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768416047 status=200 resp_size=5940
2026-01-15 02:40:48.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416048&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:40:50.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768416050 status=200 resp_size=6573
2026-01-15 02:40:51.088 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416050&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 02:40:58.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768416057 status=200 resp_size=4058
2026-01-15 02:40:58.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416058&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-15 02:41:04.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768416063 status=200 resp_size=5232
2026-01-15 02:41:04.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416064&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:41:13.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768416072 status=200 resp_size=6177
2026-01-15 02:41:13.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416073&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 02:41:13.670 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
2026-01-15 02:41:19.638 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:41:19.638 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-15 02:41:21.996 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.35 秒后继续...
2026-01-15 02:41:21.996 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-15 02:41:21.996 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:41:22.011 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:41:22.929 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:41:24.117 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:41:26.597 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:41:26.597 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:41:27.115 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416082 status=200 resp_size=132803
2026-01-15 02:41:27.115 | WARNING | __main__:get_recommend_jobs:745 - 第 5 页发现 1 个重复职位(已跳过)
2026-01-15 02:41:27.115 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:41:27.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768416087 status=200 resp_size=6473
2026-01-15 02:41:27.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416087&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:41:29.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768416088 status=200 resp_size=5634
2026-01-15 02:41:29.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416089&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:41:37.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768416097 status=200 resp_size=6125
2026-01-15 02:41:37.968 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416097&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 02:41:40.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768416099 status=200 resp_size=5888
2026-01-15 02:41:40.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416100&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 02:41:48.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768416108 status=200 resp_size=6715
2026-01-15 02:41:48.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416108&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-15 02:41:55.341 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768416114 status=200 resp_size=6055
2026-01-15 02:41:55.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416115&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 02:41:58.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768416118 status=200 resp_size=5455
2026-01-15 02:41:58.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416118&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 02:42:01.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job&timestamp=1768416121 status=200 resp_size=7534
2026-01-15 02:42:01.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416121&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
2026-01-15 02:42:06.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768416126 status=200 resp_size=6314
2026-01-15 02:42:06.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416126&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
2026-01-15 02:42:10.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job&timestamp=1768416130 status=200 resp_size=5857
2026-01-15 02:42:10.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416130&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
2026-01-15 02:42:20.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job&timestamp=1768416140 status=200 resp_size=6024
2026-01-15 02:42:20.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416140&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:42:22.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768416142 status=200 resp_size=5211
2026-01-15 02:42:22.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416142&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
2026-01-15 02:42:32.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768416151 status=200 resp_size=5942
2026-01-15 02:42:32.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416152&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 02:42:39.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job&timestamp=1768416159 status=200 resp_size=8574
2026-01-15 02:42:39.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416159&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 02:42:46.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768416165 status=200 resp_size=5421
2026-01-15 02:42:46.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416166&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:42:53.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768416172 status=200 resp_size=7551
2026-01-15 02:42:53.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416173&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-15 02:42:55.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768416175 status=200 resp_size=5784
2026-01-15 02:42:56.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416175&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 02:43:02.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768416182 status=200 resp_size=5306
2026-01-15 02:43:03.087 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416182&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-15 02:43:05.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768416185 status=200 resp_size=5687
2026-01-15 02:43:05.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416185&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:43:05.852 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 19
2026-01-15 02:43:11.694 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 02:43:11.694 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-15 02:43:18.607 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.91 秒后继续...
2026-01-15 02:43:18.607 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-15 02:43:18.607 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:43:18.632 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:43:19.275 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:43:20.423 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:43:22.575 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:43:22.575 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:43:23.062 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416198 status=200 resp_size=152402
2026-01-15 02:43:23.062 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:43:23.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768416203 status=200 resp_size=7182
2026-01-15 02:43:23.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416203&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-15 02:43:30.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job&timestamp=1768416209 status=200 resp_size=5407
2026-01-15 02:43:30.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416210&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
2026-01-15 02:43:38.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job&timestamp=1768416218 status=200 resp_size=6343
2026-01-15 02:43:38.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416218&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
2026-01-15 02:43:43.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768416223 status=200 resp_size=6958
2026-01-15 02:43:43.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416223&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:43:46.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768416226 status=200 resp_size=5655
2026-01-15 02:43:46.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416226&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 02:43:48.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768416228 status=200 resp_size=8225
2026-01-15 02:43:48.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416228&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-15 02:43:56.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768416236 status=200 resp_size=7119
2026-01-15 02:43:56.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416236&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 02:44:02.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768416241 status=200 resp_size=5497
2026-01-15 02:44:02.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416242&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:44:11.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768416251 status=200 resp_size=5615
2026-01-15 02:44:12.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416251&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 02:44:13.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768416253 status=200 resp_size=6714
2026-01-15 02:44:13.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416253&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 02:44:20.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768416259 status=200 resp_size=5775
2026-01-15 02:44:20.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416260&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-15 02:44:30.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768416270 status=200 resp_size=6689
2026-01-15 02:44:31.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416270&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:44:41.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768416280 status=200 resp_size=6696
2026-01-15 02:44:41.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416281&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-15 02:44:42.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768416282 status=200 resp_size=13102
2026-01-15 02:44:43.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416282&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 02:44:45.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768416285 status=200 resp_size=5128
2026-01-15 02:44:46.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416285&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 02:44:53.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job&timestamp=1768416293 status=200 resp_size=6390
2026-01-15 02:44:53.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416293&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:44:56.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job&timestamp=1768416296 status=200 resp_size=6362
2026-01-15 02:44:56.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416296&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 02:44:57.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768416297 status=200 resp_size=6529
2026-01-15 02:44:57.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416297&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 02:45:00.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job&timestamp=1768416300 status=200 resp_size=7130
2026-01-15 02:45:00.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416300&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 02:45:02.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job&timestamp=1768416302 status=200 resp_size=7126
2026-01-15 02:45:02.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416302&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:45:02.307 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
2026-01-15 02:45:02.700 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:45:02.700 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-15 02:45:08.185 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.47 秒后继续...
2026-01-15 02:45:08.185 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-15 02:45:08.185 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:45:08.210 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:45:08.650 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:45:09.750 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:45:11.869 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:45:11.869 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:45:12.309 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416308 status=200 resp_size=139442
2026-01-15 02:45:12.309 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:45:12.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768416312 status=200 resp_size=7415
2026-01-15 02:45:12.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416312&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
2026-01-15 02:45:19.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job&timestamp=1768416318 status=200 resp_size=5152
2026-01-15 02:45:19.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416319&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
2026-01-15 02:45:23.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768416323 status=200 resp_size=5877
2026-01-15 02:45:24.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416323&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
2026-01-15 02:45:28.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768416328 status=200 resp_size=6230
2026-01-15 02:45:28.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416328&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:45:38.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768416337 status=200 resp_size=6041
2026-01-15 02:45:38.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416338&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-15 02:45:40.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768416339 status=200 resp_size=5098
2026-01-15 02:45:40.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416340&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 02:45:46.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768416346 status=200 resp_size=5711
2026-01-15 02:45:47.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416346&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 02:45:50.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768416350 status=200 resp_size=8808
2026-01-15 02:45:50.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416350&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:45:58.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768416358 status=200 resp_size=6970
2026-01-15 02:45:59.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416358&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 02:46:02.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768416361 status=200 resp_size=5109
2026-01-15 02:46:02.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416362&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 02:46:06.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job&timestamp=1768416366 status=200 resp_size=7717
2026-01-15 02:46:06.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416366&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
2026-01-15 02:46:16.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job&timestamp=1768416375 status=200 resp_size=5920
2026-01-15 02:46:16.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416376&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:46:26.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job&timestamp=1768416385 status=200 resp_size=8734
2026-01-15 02:46:26.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416386&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
2026-01-15 02:46:28.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768416388 status=200 resp_size=5686
2026-01-15 02:46:28.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416388&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
2026-01-15 02:46:30.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job&timestamp=1768416390 status=200 resp_size=4321
2026-01-15 02:46:30.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416390&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
2026-01-15 02:46:36.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768416396 status=200 resp_size=6445
2026-01-15 02:46:37.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416396&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:46:47.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job&timestamp=1768416406 status=200 resp_size=5533
2026-01-15 02:46:47.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416407&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
2026-01-15 02:46:55.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job&timestamp=1768416415 status=200 resp_size=5524
2026-01-15 02:46:55.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416415&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
2026-01-15 02:47:02.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768416421 status=200 resp_size=6522
2026-01-15 02:47:02.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416422&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 02:47:06.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768416425 status=200 resp_size=6501
2026-01-15 02:47:06.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416426&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:47:06.301 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
2026-01-15 02:47:12.473 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:47:12.473 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-15 02:47:21.141 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.66 秒后继续...
2026-01-15 02:47:21.141 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-15 02:47:21.141 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:47:21.160 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:47:21.631 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:47:22.746 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:47:24.851 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:47:24.851 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:47:25.339 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416441 status=200 resp_size=141677
2026-01-15 02:47:25.339 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:47:25.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768416445 status=200 resp_size=7756
2026-01-15 02:47:25.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416445&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 02:47:30.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768416450 status=200 resp_size=6318
2026-01-15 02:47:30.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416450&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-15 02:47:39.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job&timestamp=1768416458 status=200 resp_size=5458
2026-01-15 02:47:39.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416459&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
2026-01-15 02:47:47.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job&timestamp=1768416466 status=200 resp_size=5678
2026-01-15 02:47:47.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416467&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:47:50.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job&timestamp=1768416469 status=200 resp_size=7237
2026-01-15 02:47:50.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416470&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
2026-01-15 02:47:53.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768416473 status=200 resp_size=5342
2026-01-15 02:47:53.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416473&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-15 02:47:59.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job&timestamp=1768416479 status=200 resp_size=6431
2026-01-15 02:47:59.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416479&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
2026-01-15 02:48:09.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768416489 status=200 resp_size=8457
2026-01-15 02:48:09.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416489&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:48:19.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job&timestamp=1768416498 status=200 resp_size=7607
2026-01-15 02:48:19.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416499&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 02:48:23.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job&timestamp=1768416503 status=200 resp_size=6416
2026-01-15 02:48:24.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416503&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 02:48:33.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768416512 status=200 resp_size=6168
2026-01-15 02:48:33.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416513&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:48:40.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job&timestamp=1768416520 status=200 resp_size=5876
2026-01-15 02:48:40.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416520&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 02:48:42.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job&timestamp=1768416522 status=200 resp_size=6646
2026-01-15 02:48:42.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416522&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
2026-01-15 02:48:47.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768416527 status=200 resp_size=6511
2026-01-15 02:48:47.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416527&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:48:52.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768416532 status=200 resp_size=5477
2026-01-15 02:48:52.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416532&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-15 02:48:55.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768416535 status=200 resp_size=6449
2026-01-15 02:48:55.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416535&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-15 02:49:02.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768416541 status=200 resp_size=5925
2026-01-15 02:49:02.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416542&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
2026-01-15 02:49:09.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768416549 status=200 resp_size=6119
2026-01-15 02:49:09.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416549&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:49:18.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768416557 status=200 resp_size=7750
2026-01-15 02:49:18.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416558&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 02:49:22.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768416562 status=200 resp_size=7971
2026-01-15 02:49:22.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416562&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 02:49:22.918 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
2026-01-15 02:49:29.623 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:49:29.623 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-15 02:49:34.312 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.68 秒后继续...
2026-01-15 02:49:34.312 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-15 02:49:34.312 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:49:34.337 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:49:35.013 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:49:36.175 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:49:38.343 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:49:38.343 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:49:38.813 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416574 status=200 resp_size=159753
2026-01-15 02:49:38.813 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:49:39.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768416578 status=200 resp_size=8313
2026-01-15 02:49:39.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416579&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-15 02:49:47.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768416587 status=200 resp_size=6058
2026-01-15 02:49:48.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416587&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:49:50.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job&timestamp=1768416590 status=200 resp_size=5424
2026-01-15 02:49:50.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416590&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
2026-01-15 02:49:58.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job&timestamp=1768416597 status=200 resp_size=8274
2026-01-15 02:49:58.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416598&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
2026-01-15 02:50:02.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768416602 status=200 resp_size=8701
2026-01-15 02:50:02.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416602&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-15 02:50:06.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768416606 status=200 resp_size=6284
2026-01-15 02:50:06.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416606&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:50:08.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job&timestamp=1768416608 status=200 resp_size=5378
2026-01-15 02:50:08.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416608&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
2026-01-15 02:50:13.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768416613 status=200 resp_size=7299
2026-01-15 02:50:13.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416613&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-15 02:50:17.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job&timestamp=1768416617 status=200 resp_size=7262
2026-01-15 02:50:17.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416617&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 02:50:24.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768416623 status=200 resp_size=6248
2026-01-15 02:50:24.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416624&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:50:29.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job&timestamp=1768416628 status=200 resp_size=7967
2026-01-15 02:50:29.341 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416629&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
2026-01-15 02:50:37.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768416637 status=200 resp_size=5253
2026-01-15 02:50:37.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416637&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 02:50:46.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768416646 status=200 resp_size=5431
2026-01-15 02:50:47.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416646&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 02:50:56.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768416655 status=200 resp_size=4995
2026-01-15 02:50:56.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416656&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:51:06.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768416666 status=200 resp_size=6080
2026-01-15 02:51:07.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416666&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 02:51:13.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768416673 status=200 resp_size=5945
2026-01-15 02:51:14.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416673&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-15 02:51:19.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768416678 status=200 resp_size=4916
2026-01-15 02:51:19.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416679&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 02:51:21.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768416680 status=200 resp_size=5446
2026-01-15 02:51:21.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416681&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-15 02:51:28.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768416687 status=200 resp_size=6506
2026-01-15 02:51:28.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416688&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
2026-01-15 02:51:36.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768416695 status=200 resp_size=5862
2026-01-15 02:51:36.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416696&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:51:36.443 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
2026-01-15 02:51:42.975 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:51:42.975 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-15 02:51:47.774 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.80 秒后继续...
2026-01-15 02:51:47.774 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-15 02:51:47.774 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:51:47.798 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:51:48.440 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:51:49.572 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:51:51.724 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:51:51.724 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:51:52.227 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416707 status=200 resp_size=140761
2026-01-15 02:51:52.227 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:51:52.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768416712 status=200 resp_size=6226
2026-01-15 02:51:52.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416712&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-15 02:51:57.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job&timestamp=1768416717 status=200 resp_size=5613
2026-01-15 02:51:57.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416717&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 02:52:06.029 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768416725 status=200 resp_size=6422
2026-01-15 02:52:06.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416726&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-15 02:52:08.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768416728 status=200 resp_size=5792
2026-01-15 02:52:08.967 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416728&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:52:14.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768416734 status=200 resp_size=6176
2026-01-15 02:52:14.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416734&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-15 02:52:21.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job&timestamp=1768416740 status=200 resp_size=6731
2026-01-15 02:52:21.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416741&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 02:52:30.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job&timestamp=1768416750 status=200 resp_size=5575
2026-01-15 02:52:31.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416750&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 02:52:32.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768416752 status=200 resp_size=6856
2026-01-15 02:52:32.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416752&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
2026-01-15 02:52:35.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768416755 status=200 resp_size=6768
2026-01-15 02:52:35.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416755&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:52:37.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768416757 status=200 resp_size=5731
2026-01-15 02:52:38.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416757&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-15 02:52:48.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768416766 status=200 resp_size=7075
2026-01-15 02:52:48.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416768&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 02:52:52.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768416772 status=200 resp_size=6530
2026-01-15 02:52:53.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416772&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:52:59.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768416778 status=200 resp_size=8973
2026-01-15 02:52:59.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416779&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
2026-01-15 02:53:09.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768416789 status=200 resp_size=8559
2026-01-15 02:53:10.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416789&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
2026-01-15 02:53:19.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768416799 status=200 resp_size=6688
2026-01-15 02:53:20.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416799&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-15 02:53:30.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768416809 status=200 resp_size=5290
2026-01-15 02:53:30.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416810&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 02:53:37.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768416816 status=200 resp_size=5982
2026-01-15 02:53:37.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416817&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-15 02:53:49.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job&timestamp=1768416827 status=200 resp_size=7919
2026-01-15 02:53:49.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416829&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
2026-01-15 02:53:59.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job&timestamp=1768416838 status=200 resp_size=7681
2026-01-15 02:53:59.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416839&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
2026-01-15 02:54:06.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768416846 status=200 resp_size=5278
2026-01-15 02:54:07.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416846&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 02:54:07.141 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 20
2026-01-15 02:54:14.336 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:54:14.336 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-15 02:54:23.504 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.16 秒后继续...
2026-01-15 02:54:23.504 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-15 02:54:23.504 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:54:23.524 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:54:24.152 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:54:25.314 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:54:27.483 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:54:27.483 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:54:27.938 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416863 status=200 resp_size=132236
2026-01-15 02:54:27.938 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:54:28.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job&timestamp=1768416867 status=200 resp_size=5414
2026-01-15 02:54:28.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416868&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 02:54:32.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job&timestamp=1768416872 status=200 resp_size=6660
2026-01-15 02:54:32.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416872&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 02:54:34.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job&timestamp=1768416873 status=200 resp_size=7952
2026-01-15 02:54:34.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416874&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
2026-01-15 02:54:39.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768416878 status=200 resp_size=5277
2026-01-15 02:54:39.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416879&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-15 02:54:48.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768416887 status=200 resp_size=7175
2026-01-15 02:54:48.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416888&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-15 02:54:52.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768416892 status=200 resp_size=6284
2026-01-15 02:54:53.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416892&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:54:59.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768416898 status=200 resp_size=5673
2026-01-15 02:54:59.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416899&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-15 02:55:02.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768416901 status=200 resp_size=5924
2026-01-15 02:55:03.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416902&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-15 02:55:07.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768416907 status=200 resp_size=6003
2026-01-15 02:55:07.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416907&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-15 02:55:12.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768416912 status=200 resp_size=5672
2026-01-15 02:55:12.838 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416912&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-15 02:55:14.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768416914 status=200 resp_size=5378
2026-01-15 02:55:14.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416914&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-15 02:55:24.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768416923 status=200 resp_size=5084
2026-01-15 02:55:24.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416924&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:55:26.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768416925 status=200 resp_size=4913
2026-01-15 02:55:26.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416926&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 02:55:34.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768416934 status=200 resp_size=9486
2026-01-15 02:55:34.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416934&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 02:55:46.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768416941 status=200 resp_size=5363
2026-01-15 02:55:48.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416946&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-15 02:55:50.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job&timestamp=1768416950 status=200 resp_size=13285
2026-01-15 02:55:51.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416950&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 02:55:59.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768416958 status=200 resp_size=6873
2026-01-15 02:55:59.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416959&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:56:06.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job&timestamp=1768416965 status=200 resp_size=6041
2026-01-15 02:56:06.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416966&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
2026-01-15 02:56:14.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job&timestamp=1768416973 status=200 resp_size=6635
2026-01-15 02:56:14.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416974&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
2026-01-15 02:56:16.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768416975 status=200 resp_size=5390
2026-01-15 02:56:16.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416976&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-15 02:56:16.401 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 20
2026-01-15 02:56:22.824 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:56:22.824 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-15 02:56:32.063 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.23 秒后继续...
2026-01-15 02:56:32.063 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-15 02:56:32.063 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:56:32.090 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:56:32.703 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:56:33.833 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:56:35.969 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:56:35.969 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:56:36.440 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768416992 status=200 resp_size=124843
2026-01-15 02:56:36.440 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:56:36.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job&timestamp=1768416996 status=200 resp_size=8070
2026-01-15 02:56:36.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768416996&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 02:56:46.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768417006 status=200 resp_size=6588
2026-01-15 02:56:47.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417006&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 02:56:53.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job&timestamp=1768417012 status=200 resp_size=6300
2026-01-15 02:56:53.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417013&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
2026-01-15 02:56:55.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768417014 status=200 resp_size=6073
2026-01-15 02:56:55.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417015&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:57:00.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768417020 status=200 resp_size=7194
2026-01-15 02:57:00.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417020&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 02:57:02.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768417021 status=200 resp_size=6053
2026-01-15 02:57:02.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417022&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 02:57:09.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768417029 status=200 resp_size=7170
2026-01-15 02:57:09.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417029&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 02:57:19.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job&timestamp=1768417039 status=200 resp_size=4572
2026-01-15 02:57:19.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417039&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
2026-01-15 02:57:28.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768417047 status=200 resp_size=4992
2026-01-15 02:57:29.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417048&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-15 02:57:31.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768417050 status=200 resp_size=7194
2026-01-15 02:57:31.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417051&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-15 02:57:36.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768417055 status=200 resp_size=5356
2026-01-15 02:57:36.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417056&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 02:57:41.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768417061 status=200 resp_size=5554
2026-01-15 02:57:41.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417061&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:57:44.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768417064 status=200 resp_size=5280
2026-01-15 02:57:44.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417064&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 02:57:56.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768417074 status=200 resp_size=5040
2026-01-15 02:57:56.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417076&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-15 02:58:06.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768417085 status=200 resp_size=4993
2026-01-15 02:58:06.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417086&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 02:58:10.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768417090 status=200 resp_size=6752
2026-01-15 02:58:10.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417090&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:58:20.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768417099 status=200 resp_size=5887
2026-01-15 02:58:20.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417100&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-15 02:58:27.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768417106 status=200 resp_size=5764
2026-01-15 02:58:27.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417107&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 02:58:31.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768417111 status=200 resp_size=5688
2026-01-15 02:58:32.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417111&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 02:58:34.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768417113 status=200 resp_size=6980
2026-01-15 02:58:34.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417114&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 02:58:34.255 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
2026-01-15 02:58:40.003 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 02:58:40.003 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-15 02:58:48.750 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.74 秒后继续...
2026-01-15 02:58:48.750 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-15 02:58:48.750 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 02:58:48.780 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 02:58:49.284 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:58:50.399 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:58:52.535 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 02:58:52.535 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 02:58:52.975 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768417128 status=200 resp_size=144475
2026-01-15 02:58:52.975 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 02:58:53.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768417132 status=200 resp_size=5283
2026-01-15 02:58:53.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417133&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 02:58:56.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768417136 status=200 resp_size=5215
2026-01-15 02:58:56.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417136&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-15 02:58:58.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768417138 status=200 resp_size=5501
2026-01-15 02:58:58.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417138&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-15 02:59:07.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768417146 status=200 resp_size=6659
2026-01-15 02:59:07.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417147&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 02:59:17.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job&timestamp=1768417153 status=200 resp_size=5165
2026-01-15 02:59:17.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417157&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
2026-01-15 02:59:20.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job&timestamp=1768417160 status=200 resp_size=5570
2026-01-15 02:59:20.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417160&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
2026-01-15 02:59:27.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768417166 status=200 resp_size=9108
2026-01-15 02:59:27.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417167&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-15 02:59:33.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768417173 status=200 resp_size=5688
2026-01-15 02:59:34.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417173&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
2026-01-15 02:59:36.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768417176 status=200 resp_size=6380
2026-01-15 02:59:36.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417176&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 02:59:41.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job&timestamp=1768417181 status=200 resp_size=6612
2026-01-15 02:59:41.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417181&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
2026-01-15 02:59:54.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job&timestamp=1768417187 status=200 resp_size=7975
2026-01-15 03:00:01.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417194&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
2026-01-15 03:00:08.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job&timestamp=1768417207 status=200 resp_size=5984
2026-01-15 03:00:08.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417208&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 03:00:16.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768417215 status=200 resp_size=7270
2026-01-15 03:00:16.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417216&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 03:00:23.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job&timestamp=1768417222 status=200 resp_size=5580
2026-01-15 03:00:23.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417223&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 03:00:30.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768417230 status=200 resp_size=6935
2026-01-15 03:00:30.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417230&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-15 03:00:41.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job&timestamp=1768417240 status=200 resp_size=5924
2026-01-15 03:00:41.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417241&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
2026-01-15 03:00:50.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job&timestamp=1768417249 status=200 resp_size=6027
2026-01-15 03:00:50.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417250&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
2026-01-15 03:00:54.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job&timestamp=1768417254 status=200 resp_size=6028
2026-01-15 03:00:54.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417254&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 03:00:59.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768417259 status=200 resp_size=6111
2026-01-15 03:00:59.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417259&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
2026-01-15 03:01:09.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768417269 status=200 resp_size=8782
2026-01-15 03:01:09.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417269&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 03:01:09.973 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
2026-01-15 03:01:10.303 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:01:10.303 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-15 03:01:19.274 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.97 秒后继续...
2026-01-15 03:01:19.274 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-15 03:01:19.274 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:01:19.303 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:01:19.838 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:01:20.954 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:01:23.075 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:01:23.075 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:01:23.514 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768417279 status=200 resp_size=146271
2026-01-15 03:01:23.514 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:01:23.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768417283 status=200 resp_size=8655
2026-01-15 03:01:23.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417283&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-15 03:01:33.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job&timestamp=1768417293 status=200 resp_size=6440
2026-01-15 03:01:34.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417293&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
2026-01-15 03:01:35.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768417295 status=200 resp_size=7907
2026-01-15 03:01:35.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417295&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-15 03:01:40.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job&timestamp=1768417300 status=200 resp_size=4592
2026-01-15 03:01:40.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417300&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
2026-01-15 03:02:22.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768417307 status=200 resp_size=5878
2026-01-15 03:02:31.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417342&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 03:02:38.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job&timestamp=1768417354 status=200 resp_size=6437
2026-01-15 03:02:43.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417358&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 03:02:50.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768417369 status=200 resp_size=7313
2026-01-15 03:02:50.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417370&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-15 03:02:55.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job&timestamp=1768417375 status=200 resp_size=6958
2026-01-15 03:02:55.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417375&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
2026-01-15 03:02:57.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768417376 status=200 resp_size=6694
2026-01-15 03:02:57.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417377&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
2026-01-15 03:03:07.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768417387 status=200 resp_size=6568
2026-01-15 03:03:07.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417387&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-15 03:03:23.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768417394 status=200 resp_size=5922
2026-01-15 03:03:28.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417403&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 03:03:35.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job&timestamp=1768417414 status=200 resp_size=5499
2026-01-15 03:03:35.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417415&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
2026-01-15 03:03:45.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768417424 status=200 resp_size=6184
2026-01-15 03:03:45.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417425&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-15 03:03:49.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768417429 status=200 resp_size=5673
2026-01-15 03:03:50.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417429&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-15 03:03:53.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768417433 status=200 resp_size=7081
2026-01-15 03:03:53.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417433&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 03:03:55.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768417435 status=200 resp_size=7664
2026-01-15 03:03:56.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417435&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 03:04:07.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768417441 status=200 resp_size=6652
2026-01-15 03:04:09.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417447&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-15 03:04:16.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768417455 status=200 resp_size=4733
2026-01-15 03:04:16.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417456&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 03:04:19.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768417458 status=200 resp_size=4926
2026-01-15 03:04:19.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417459&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 03:04:27.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768417467 status=200 resp_size=4906
2026-01-15 03:04:27.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417467&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 03:04:27.992 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
2026-01-15 03:04:28.322 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:04:28.322 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-15 03:04:29.410 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.08 秒后继续...
2026-01-15 03:04:29.410 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-15 03:04:29.410 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:04:29.421 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:04:30.096 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:04:31.258 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:04:33.409 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:04:33.409 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:04:33.943 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768417469 status=200 resp_size=137298
2026-01-15 03:04:33.943 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:04:34.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job&timestamp=1768417473 status=200 resp_size=7369
2026-01-15 03:04:34.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417474&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 03:04:35.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768417475 status=200 resp_size=4834
2026-01-15 03:04:36.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417475&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 03:04:37.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768417477 status=200 resp_size=5006
2026-01-15 03:04:38.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417477&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 03:04:47.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768417486 status=200 resp_size=5363
2026-01-15 03:04:47.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417487&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-15 03:04:50.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768417489 status=200 resp_size=5232
2026-01-15 03:04:50.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417490&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-15 03:04:57.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job&timestamp=1768417497 status=200 resp_size=6946
2026-01-15 03:04:57.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417497&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
2026-01-15 03:05:04.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768417504 status=200 resp_size=4956
2026-01-15 03:05:05.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417504&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:05:14.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768417514 status=200 resp_size=7382
2026-01-15 03:05:14.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417514&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 03:05:18.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768417518 status=200 resp_size=7331
2026-01-15 03:05:18.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417518&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 03:05:26.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job&timestamp=1768417525 status=200 resp_size=5087
2026-01-15 03:05:26.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417526&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
2026-01-15 03:05:36.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job&timestamp=1768417535 status=200 resp_size=6551
2026-01-15 03:05:36.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417536&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
2026-01-15 03:05:46.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768417545 status=200 resp_size=4515
2026-01-15 03:05:46.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417546&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-15 03:05:48.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768417548 status=200 resp_size=4865
2026-01-15 03:05:49.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417548&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-15 03:05:54.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768417554 status=200 resp_size=5241
2026-01-15 03:05:55.161 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417554&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-15 03:06:05.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job&timestamp=1768417564 status=200 resp_size=5494
2026-01-15 03:06:05.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417565&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 03:06:07.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768417567 status=200 resp_size=6572
2026-01-15 03:06:07.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417567&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-15 03:06:15.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768417574 status=200 resp_size=5674
2026-01-15 03:06:15.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417575&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 03:06:25.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768417584 status=200 resp_size=6137
2026-01-15 03:06:25.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417585&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-15 03:06:35.270 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768417594 status=200 resp_size=6303
2026-01-15 03:06:35.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417595&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 03:06:38.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768417598 status=200 resp_size=5471
2026-01-15 03:06:39.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417598&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 03:06:39.007 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
2026-01-15 03:06:44.835 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:06:44.835 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-15 03:06:52.992 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.15 秒后继续...
2026-01-15 03:06:52.992 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 16/26 页...
2026-01-15 03:06:52.992 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:06:53.021 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:06:53.569 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:06:54.685 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:06:56.820 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:06:56.820 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:06:57.339 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768417613 status=200 resp_size=135665
2026-01-15 03:06:57.339 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:06:57.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768417617 status=200 resp_size=5725
2026-01-15 03:06:57.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417617&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-15 03:07:03.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job&timestamp=1768417623 status=200 resp_size=4737
2026-01-15 03:07:03.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417623&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 03:07:14.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job&timestamp=1768417630 status=200 resp_size=4297
2026-01-15 03:07:15.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417634&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
2026-01-15 03:07:18.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768417637 status=200 resp_size=6856
2026-01-15 03:07:19.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417638&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 03:07:24.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job&timestamp=1768417643 status=200 resp_size=5259
2026-01-15 03:07:26.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417644&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
2026-01-15 03:07:30.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768417649 status=200 resp_size=4786
2026-01-15 03:07:31.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417650&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 03:07:45.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768417658 status=200 resp_size=5746
2026-01-15 03:07:47.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417665&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 03:07:55.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768417674 status=200 resp_size=5466
2026-01-15 03:07:55.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417675&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 03:07:57.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job&timestamp=1768417677 status=200 resp_size=5037
2026-01-15 03:07:57.838 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417677&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 03:08:02.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job&timestamp=1768417682 status=200 resp_size=5631
2026-01-15 03:08:02.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417682&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 03:08:12.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job&timestamp=1768417691 status=200 resp_size=5979
2026-01-15 03:08:12.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417692&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
2026-01-15 03:08:19.668 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768417699 status=200 resp_size=6264
2026-01-15 03:08:19.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417699&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-15 03:08:29.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768417708 status=200 resp_size=5973
2026-01-15 03:08:29.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417709&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-15 03:08:35.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768417714 status=200 resp_size=5928
2026-01-15 03:08:35.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417715&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 03:08:41.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768417720 status=200 resp_size=6295
2026-01-15 03:08:41.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417721&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-15 03:08:49.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job&timestamp=1768417729 status=200 resp_size=5806
2026-01-15 03:08:50.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417729&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 03:09:00.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768417739 status=200 resp_size=5174
2026-01-15 03:09:00.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417740&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-15 03:09:10.578 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768417749 status=200 resp_size=6666
2026-01-15 03:09:10.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417750&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 03:09:17.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768417757 status=200 resp_size=4654
2026-01-15 03:09:17.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417757&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-15 03:09:20.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job&timestamp=1768417760 status=200 resp_size=7057
2026-01-15 03:09:20.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417760&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
2026-01-15 03:09:20.976 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
2026-01-15 03:09:26.891 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:09:26.891 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-15 03:09:33.076 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.18 秒后继续...
2026-01-15 03:09:33.076 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 17/26 页...
2026-01-15 03:09:33.076 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:09:33.101 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:09:33.603 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:09:34.734 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:09:36.838 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:09:36.838 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:09:37.262 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768417773 status=200 resp_size=117987
2026-01-15 03:09:37.262 | WARNING | __main__:get_recommend_jobs:745 - 第 17 页发现 1 个重复职位(已跳过)
2026-01-15 03:09:37.262 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:09:37.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768417777 status=200 resp_size=7248
2026-01-15 03:09:37.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417777&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 03:09:45.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job&timestamp=1768417785 status=200 resp_size=6546
2026-01-15 03:09:45.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417785&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 03:09:55.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768417794 status=200 resp_size=6546
2026-01-15 03:09:55.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417795&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-15 03:09:57.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job&timestamp=1768417797 status=200 resp_size=4679
2026-01-15 03:09:57.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417797&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-15 03:10:04.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768417803 status=200 resp_size=4783
2026-01-15 03:10:04.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417804&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 03:10:08.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768417807 status=200 resp_size=5359
2026-01-15 03:10:08.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417808&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:10:13.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768417813 status=200 resp_size=6326
2026-01-15 03:10:13.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417813&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 03:10:21.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768417820 status=200 resp_size=5106
2026-01-15 03:10:21.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417821&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
2026-01-15 03:10:31.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768417830 status=200 resp_size=5306
2026-01-15 03:10:31.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417831&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-15 03:10:35.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768417835 status=200 resp_size=6073
2026-01-15 03:10:35.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417835&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-15 03:10:43.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job&timestamp=1768417842 status=200 resp_size=6325
2026-01-15 03:10:43.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417843&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 03:10:53.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768417853 status=200 resp_size=5111
2026-01-15 03:10:53.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417853&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 03:10:57.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job&timestamp=1768417857 status=200 resp_size=5915
2026-01-15 03:10:58.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417857&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 03:11:02.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768417862 status=200 resp_size=5282
2026-01-15 03:11:03.088 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417862&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 03:11:12.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job&timestamp=1768417871 status=200 resp_size=7722
2026-01-15 03:11:12.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417872&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 03:11:18.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768417877 status=200 resp_size=4719
2026-01-15 03:11:18.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417878&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-15 03:11:20.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job&timestamp=1768417880 status=200 resp_size=5294
2026-01-15 03:11:20.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417880&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:11:26.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job&timestamp=1768417885 status=200 resp_size=7688
2026-01-15 03:11:26.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417886&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 03:11:53.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job&timestamp=1768417894 status=200 resp_size=5943
2026-01-15 03:11:56.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417913&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
2026-01-15 03:11:56.539 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 19
2026-01-15 03:11:56.821 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 03:11:56.837 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-15 03:12:01.405 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.57 秒后继续...
2026-01-15 03:12:01.405 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 18/26 页...
2026-01-15 03:12:01.407 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:12:01.422 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:12:02.020 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:12:03.150 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:12:05.287 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:12:05.287 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:12:05.742 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768417921 status=200 resp_size=135473
2026-01-15 03:12:05.757 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:12:05.962 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768417925 status=200 resp_size=4757
2026-01-15 03:12:06.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417925&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-15 03:12:08.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job&timestamp=1768417928 status=200 resp_size=5693
2026-01-15 03:12:08.385 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417928&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:12:26.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768417933 status=200 resp_size=5853
2026-01-15 03:12:28.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417946&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 03:12:35.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768417952 status=200 resp_size=5360
2026-01-15 03:12:36.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417955&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-15 03:12:43.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768417961 status=200 resp_size=5666
2026-01-15 03:12:45.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417963&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 03:12:50.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768417970 status=200 resp_size=5591
2026-01-15 03:12:52.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417970&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:13:02.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job&timestamp=1768417982 status=200 resp_size=5651
2026-01-15 03:13:03.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417982&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 03:13:10.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job&timestamp=1768417989 status=200 resp_size=4864
2026-01-15 03:13:10.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417990&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 03:13:16.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768417995 status=200 resp_size=4333
2026-01-15 03:13:16.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417996&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-15 03:13:19.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job&timestamp=1768417999 status=200 resp_size=5317
2026-01-15 03:13:19.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768417999&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:13:22.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768418002 status=200 resp_size=6269
2026-01-15 03:13:23.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418002&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-15 03:13:32.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768418011 status=200 resp_size=5151
2026-01-15 03:13:32.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418012&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:13:34.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768418013 status=200 resp_size=5481
2026-01-15 03:13:34.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418014&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-15 03:13:44.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768418024 status=200 resp_size=5510
2026-01-15 03:13:45.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418024&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:13:48.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768418028 status=200 resp_size=6454
2026-01-15 03:13:48.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418028&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 03:13:57.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768418037 status=200 resp_size=8675
2026-01-15 03:13:58.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418037&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-15 03:14:02.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job&timestamp=1768418042 status=200 resp_size=5938
2026-01-15 03:14:02.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418042&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-15 03:14:07.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768418047 status=200 resp_size=8440
2026-01-15 03:14:07.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418047&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
2026-01-15 03:14:16.718 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768418056 status=200 resp_size=6458
2026-01-15 03:14:16.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418056&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 03:14:28.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job&timestamp=1768418066 status=200 resp_size=5227
2026-01-15 03:14:30.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418068&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 03:14:30.115 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
2026-01-15 03:14:36.035 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:14:36.035 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-15 03:14:38.548 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.50 秒后继续...
2026-01-15 03:14:38.548 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 19/26 页...
2026-01-15 03:14:38.548 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:14:38.562 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:14:39.096 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:14:40.227 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:14:42.346 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:14:42.346 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:14:42.786 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768418078 status=200 resp_size=110526
2026-01-15 03:14:42.786 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:14:42.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768418082 status=200 resp_size=5162
2026-01-15 03:14:43.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418082&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-15 03:14:54.602 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job&timestamp=1768418088 status=200 resp_size=6414
2026-01-15 03:14:55.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418094&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
2026-01-15 03:15:01.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768418100 status=200 resp_size=6062
2026-01-15 03:15:02.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418101&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-15 03:15:13.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job&timestamp=1768418111 status=200 resp_size=5449
2026-01-15 03:15:14.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418113&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 03:15:21.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768418119 status=200 resp_size=5708
2026-01-15 03:15:22.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418121&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 03:15:29.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768418128 status=200 resp_size=6976
2026-01-15 03:15:29.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418129&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 03:15:37.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768418137 status=200 resp_size=5837
2026-01-15 03:15:38.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418137&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 03:15:46.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768418146 status=200 resp_size=5506
2026-01-15 03:15:47.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418146&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 03:15:49.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768418149 status=200 resp_size=5845
2026-01-15 03:15:49.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418149&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 03:16:00.148 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 515 Target Unavailable
2026-01-15 03:16:01.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768418155 status=200 resp_size=6139
2026-01-15 03:16:01.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418161&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 03:16:05.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768418165 status=200 resp_size=5599
2026-01-15 03:16:06.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418165&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 03:16:10.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768418170 status=200 resp_size=5636
2026-01-15 03:16:10.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418170&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-15 03:16:11.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768418171 status=200 resp_size=6222
2026-01-15 03:16:11.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418171&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 03:16:19.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job&timestamp=1768418178 status=200 resp_size=7704
2026-01-15 03:16:19.453 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418179&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 03:16:26.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768418186 status=200 resp_size=5400
2026-01-15 03:16:26.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418186&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 03:16:33.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768418192 status=200 resp_size=5846
2026-01-15 03:16:33.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418193&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 03:16:39.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768418198 status=200 resp_size=4627
2026-01-15 03:16:39.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418199&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 03:17:12.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768418205 status=200 resp_size=6090
2026-01-15 03:17:20.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418232&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:17:30.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768418250 status=200 resp_size=6341
2026-01-15 03:17:30.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418250&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-15 03:17:33.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768418253 status=200 resp_size=6896
2026-01-15 03:17:34.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418253&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 03:17:34.034 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
2026-01-15 03:17:39.467 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:17:39.467 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-15 03:17:41.007 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.53 秒后继续...
2026-01-15 03:17:41.007 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 20/26 页...
2026-01-15 03:17:41.007 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:17:41.037 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:17:41.713 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:17:42.874 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:17:45.027 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:17:45.027 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:17:45.498 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768418261 status=200 resp_size=107884
2026-01-15 03:17:45.498 | WARNING | __main__:get_recommend_jobs:745 - 第 20 页发现 1 个重复职位(已跳过)
2026-01-15 03:17:45.498 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:17:45.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768418265 status=200 resp_size=5290
2026-01-15 03:17:45.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418265&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 03:17:47.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768418267 status=200 resp_size=5976
2026-01-15 03:17:48.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418267&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:17:58.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768418277 status=200 resp_size=6435
2026-01-15 03:17:58.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418278&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 03:18:00.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768418279 status=200 resp_size=6490
2026-01-15 03:18:00.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418280&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-15 03:18:02.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768418282 status=200 resp_size=6194
2026-01-15 03:18:02.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418282&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-15 03:18:07.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768418287 status=200 resp_size=6078
2026-01-15 03:18:07.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418287&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:18:17.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768418296 status=200 resp_size=5526
2026-01-15 03:18:17.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418297&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-15 03:18:19.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768418299 status=200 resp_size=6819
2026-01-15 03:18:19.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418299&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-15 03:18:28.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768418308 status=200 resp_size=5830
2026-01-15 03:18:29.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418308&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 03:18:37.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768418316 status=200 resp_size=4786
2026-01-15 03:18:37.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418317&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 03:18:44.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768418324 status=200 resp_size=6984
2026-01-15 03:18:44.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418324&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-15 03:18:47.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768418327 status=200 resp_size=5443
2026-01-15 03:18:47.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418327&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 03:18:56.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768418336 status=200 resp_size=6066
2026-01-15 03:18:57.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418336&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 03:18:58.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768418338 status=200 resp_size=5541
2026-01-15 03:18:59.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418338&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 03:19:02.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768418342 status=200 resp_size=6058
2026-01-15 03:19:03.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418343&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-15 03:19:07.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job&timestamp=1768418347 status=200 resp_size=5879
2026-01-15 03:19:07.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418347&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 03:19:24.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768418356 status=200 resp_size=5379
2026-01-15 03:19:26.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418364&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 03:19:32.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768418371 status=200 resp_size=5655
2026-01-15 03:19:34.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418372&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 03:19:40.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768418378 status=200 resp_size=6286
2026-01-15 03:19:41.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418380&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 03:19:41.741 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 19
2026-01-15 03:19:42.070 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 03:19:42.070 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-15 03:19:47.318 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.24 秒后继续...
2026-01-15 03:19:47.318 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 21/26 页...
2026-01-15 03:19:47.318 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:19:47.334 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:19:47.867 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:19:49.008 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:19:51.135 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:19:51.135 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:19:51.559 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768418387 status=200 resp_size=116157
2026-01-15 03:19:51.559 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:19:51.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job&timestamp=1768418391 status=200 resp_size=5496
2026-01-15 03:19:51.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418391&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 03:20:03.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job&timestamp=1768418401 status=200 resp_size=6106
2026-01-15 03:20:05.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418403&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-15 03:20:08.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768418407 status=200 resp_size=6326
2026-01-15 03:20:08.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418408&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-15 03:20:13.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768418412 status=200 resp_size=5398
2026-01-15 03:20:15.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418413&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 03:20:37.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768418424 status=200 resp_size=5294
2026-01-15 03:20:39.968 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418437&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:20:43.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768418441 status=200 resp_size=5984
2026-01-15 03:20:48.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418443&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-15 03:20:54.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768418451 status=200 resp_size=5662
2026-01-15 03:20:56.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418454&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
2026-01-15 03:21:27.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job&timestamp=1768418465 status=200 resp_size=5835
2026-01-15 03:21:29.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418487&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
2026-01-15 03:21:36.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768418493 status=200 resp_size=6131
2026-01-15 03:21:38.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418496&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-15 03:21:46.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768418505 status=200 resp_size=6108
2026-01-15 03:21:46.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418506&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:21:51.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job&timestamp=1768418510 status=200 resp_size=5951
2026-01-15 03:21:51.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418511&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 03:21:58.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768418518 status=200 resp_size=6219
2026-01-15 03:21:59.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418518&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-15 03:22:01.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768418521 status=200 resp_size=6039
2026-01-15 03:22:02.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418521&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 03:22:03.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768418523 status=200 resp_size=5675
2026-01-15 03:22:03.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418523&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:22:11.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768418530 status=200 resp_size=5849
2026-01-15 03:22:11.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418531&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 03:22:18.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768418537 status=200 resp_size=5335
2026-01-15 03:22:18.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418538&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:22:26.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768418545 status=200 resp_size=6351
2026-01-15 03:22:26.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418546&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-15 03:22:31.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768418551 status=200 resp_size=6113
2026-01-15 03:22:31.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418551&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 03:22:41.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768418561 status=200 resp_size=5829
2026-01-15 03:22:41.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418561&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 03:22:48.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768418567 status=200 resp_size=6338
2026-01-15 03:22:48.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418568&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:22:48.354 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
2026-01-15 03:22:53.946 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:22:53.946 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-15 03:23:01.875 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.93 秒后继续...
2026-01-15 03:23:01.875 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 22/26 页...
2026-01-15 03:23:01.875 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:23:01.910 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:23:02.397 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:23:03.528 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:23:05.648 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:23:05.648 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:23:06.057 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768418581 status=200 resp_size=140737
2026-01-15 03:23:06.057 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:23:06.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768418586 status=200 resp_size=5107
2026-01-15 03:23:06.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418586&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-15 03:23:07.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768418587 status=200 resp_size=6385
2026-01-15 03:23:07.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418587&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 03:23:11.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768418591 status=200 resp_size=5106
2026-01-15 03:23:11.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418591&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-15 03:23:19.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768418599 status=200 resp_size=6535
2026-01-15 03:23:19.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418599&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:23:22.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job&timestamp=1768418602 status=200 resp_size=4774
2026-01-15 03:23:23.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418602&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
2026-01-15 03:23:26.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768418606 status=200 resp_size=6963
2026-01-15 03:23:26.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418606&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 03:23:31.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job&timestamp=1768418611 status=200 resp_size=5463
2026-01-15 03:23:31.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418611&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 03:23:38.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768418618 status=200 resp_size=5490
2026-01-15 03:23:38.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418618&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:23:46.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768418625 status=200 resp_size=5448
2026-01-15 03:23:46.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418626&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 03:23:57.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768418636 status=200 resp_size=7079
2026-01-15 03:23:57.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418637&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 03:24:05.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768418644 status=200 resp_size=6053
2026-01-15 03:24:05.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418645&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 03:24:09.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768418649 status=200 resp_size=6091
2026-01-15 03:24:09.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418649&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:24:18.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job&timestamp=1768418657 status=200 resp_size=5197
2026-01-15 03:24:18.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418658&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:24:20.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768418660 status=200 resp_size=7337
2026-01-15 03:24:21.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418660&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 03:24:27.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768418666 status=200 resp_size=6216
2026-01-15 03:24:27.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418667&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 03:24:36.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job&timestamp=1768418676 status=200 resp_size=5503
2026-01-15 03:24:36.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418676&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:24:44.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768418683 status=200 resp_size=5703
2026-01-15 03:24:44.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418684&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:24:53.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job&timestamp=1768418692 status=200 resp_size=5924
2026-01-15 03:24:53.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418693&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 03:24:55.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768418694 status=200 resp_size=6271
2026-01-15 03:24:55.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418695&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-15 03:25:00.106 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768418699 status=200 resp_size=5236
2026-01-15 03:25:00.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418700&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:25:00.247 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
2026-01-15 03:25:06.275 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:25:06.278 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-15 03:25:15.117 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.84 秒后继续...
2026-01-15 03:25:15.117 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 23/26 页...
2026-01-15 03:25:15.117 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:25:15.132 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:25:15.709 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:25:16.844 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:25:18.995 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:25:18.995 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:25:19.421 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768418715 status=200 resp_size=136557
2026-01-15 03:25:19.421 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:25:19.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768418719 status=200 resp_size=4841
2026-01-15 03:25:19.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418719&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:25:29.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768418728 status=200 resp_size=6316
2026-01-15 03:25:29.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418729&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 03:25:31.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job&timestamp=1768418731 status=200 resp_size=6215
2026-01-15 03:25:31.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418731&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
2026-01-15 03:25:38.798 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768418737 status=200 resp_size=5338
2026-01-15 03:25:38.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418738&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:25:42.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768418742 status=200 resp_size=5112
2026-01-15 03:25:42.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418742&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:25:49.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768418748 status=200 resp_size=6150
2026-01-15 03:25:49.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418749&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 03:25:59.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768418758 status=200 resp_size=5205
2026-01-15 03:26:00.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418759&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:26:08.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job&timestamp=1768418768 status=200 resp_size=5166
2026-01-15 03:26:08.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418768&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:26:13.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768418773 status=200 resp_size=5390
2026-01-15 03:26:13.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418773&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:26:22.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job&timestamp=1768418781 status=200 resp_size=5148
2026-01-15 03:26:22.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418782&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:26:23.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768418783 status=200 resp_size=4870
2026-01-15 03:26:24.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418784&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:26:34.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768418794 status=200 resp_size=5055
2026-01-15 03:26:34.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418794&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:26:38.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768418798 status=200 resp_size=4979
2026-01-15 03:26:38.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418798&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:26:48.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768418807 status=200 resp_size=4847
2026-01-15 03:26:48.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418808&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:26:53.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768418813 status=200 resp_size=5426
2026-01-15 03:26:53.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418813&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:26:56.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job&timestamp=1768418816 status=200 resp_size=5600
2026-01-15 03:26:57.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418816&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:27:04.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768418824 status=200 resp_size=5587
2026-01-15 03:27:04.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418824&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:27:11.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768418830 status=200 resp_size=5032
2026-01-15 03:27:11.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418831&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:27:21.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768418840 status=200 resp_size=5461
2026-01-15 03:27:21.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418841&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:27:25.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768418845 status=200 resp_size=5182
2026-01-15 03:27:25.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418845&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:27:25.378 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
2026-01-15 03:27:31.455 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:27:31.455 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-15 03:27:35.405 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.94 秒后继续...
2026-01-15 03:27:35.405 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 24/26 页...
2026-01-15 03:27:35.405 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:27:35.430 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:27:36.059 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:27:37.206 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:27:39.357 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:27:39.357 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:27:39.843 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768418855 status=200 resp_size=129871
2026-01-15 03:27:39.843 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:27:40.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768418859 status=200 resp_size=5200
2026-01-15 03:27:40.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418860&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:27:49.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768418868 status=200 resp_size=5552
2026-01-15 03:27:49.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418869&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:27:55.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768418875 status=200 resp_size=5224
2026-01-15 03:27:55.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418875&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:27:57.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job&timestamp=1768418877 status=200 resp_size=5489
2026-01-15 03:27:57.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418877&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:28:03.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768418882 status=200 resp_size=5190
2026-01-15 03:28:03.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418883&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:28:08.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768418888 status=200 resp_size=5295
2026-01-15 03:28:08.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418888&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:28:12.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job&timestamp=1768418891 status=200 resp_size=4383
2026-01-15 03:28:12.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418892&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
2026-01-15 03:28:16.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768418896 status=200 resp_size=10632
2026-01-15 03:28:16.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418896&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 03:28:19.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768418898 status=200 resp_size=4990
2026-01-15 03:28:19.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418899&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-15 03:28:23.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768418902 status=200 resp_size=4985
2026-01-15 03:28:23.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418903&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:28:26.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job&timestamp=1768418906 status=200 resp_size=5236
2026-01-15 03:28:26.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418906&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 03:28:29.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768418908 status=200 resp_size=4315
2026-01-15 03:28:29.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418909&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-15 03:28:33.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768418913 status=200 resp_size=7628
2026-01-15 03:28:33.675 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418913&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 03:28:43.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768418923 status=200 resp_size=4972
2026-01-15 03:28:43.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418923&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:28:53.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job&timestamp=1768418933 status=200 resp_size=6205
2026-01-15 03:28:53.855 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418933&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
2026-01-15 03:28:58.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job&timestamp=1768418937 status=200 resp_size=4425
2026-01-15 03:28:58.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418938&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 03:29:00.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768418940 status=200 resp_size=6095
2026-01-15 03:29:01.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418940&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:29:09.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768418949 status=200 resp_size=5158
2026-01-15 03:29:09.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418949&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:29:11.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768418951 status=200 resp_size=5147
2026-01-15 03:29:11.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418951&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-15 03:29:15.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768418955 status=200 resp_size=6401
2026-01-15 03:29:15.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418955&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 03:29:15.795 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
2026-01-15 03:29:21.683 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:29:21.683 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-15 03:29:28.899 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.21 秒后继续...
2026-01-15 03:29:28.899 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 25/26 页...
2026-01-15 03:29:28.899 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:29:28.920 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:29:29.438 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:29:30.536 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:29:32.658 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:29:32.658 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:29:33.084 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768418968 status=200 resp_size=135870
2026-01-15 03:29:33.084 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:29:33.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768418973 status=200 resp_size=6101
2026-01-15 03:29:33.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418973&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:29:42.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768418982 status=200 resp_size=4978
2026-01-15 03:29:43.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418982&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:29:44.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768418984 status=200 resp_size=4991
2026-01-15 03:29:44.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418984&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-15 03:29:47.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768418986 status=200 resp_size=6793
2026-01-15 03:29:47.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418987&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 03:29:51.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768418991 status=200 resp_size=6117
2026-01-15 03:29:51.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768418991&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:30:02.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768419001 status=200 resp_size=5026
2026-01-15 03:30:02.165 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419002&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:30:07.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job&timestamp=1768419007 status=200 resp_size=5128
2026-01-15 03:30:08.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419007&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:30:09.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job&timestamp=1768419009 status=200 resp_size=5325
2026-01-15 03:30:10.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419009&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
2026-01-15 03:30:11.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768419011 status=200 resp_size=6108
2026-01-15 03:30:11.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419011&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:30:21.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768419021 status=200 resp_size=4859
2026-01-15 03:30:21.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419021&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:30:25.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job&timestamp=1768419025 status=200 resp_size=4835
2026-01-15 03:30:25.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419025&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 03:30:27.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768419027 status=200 resp_size=7131
2026-01-15 03:30:27.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419027&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-15 03:30:30.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job&timestamp=1768419030 status=200 resp_size=6109
2026-01-15 03:30:30.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419030&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:30:39.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job&timestamp=1768419039 status=200 resp_size=5992
2026-01-15 03:30:39.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419039&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 03:30:41.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768419041 status=200 resp_size=6770
2026-01-15 03:30:41.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419041&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 03:30:45.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job&timestamp=1768419045 status=200 resp_size=6749
2026-01-15 03:30:45.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419045&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
2026-01-15 03:30:54.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768419053 status=200 resp_size=6115
2026-01-15 03:30:54.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419054&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:30:58.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768419058 status=200 resp_size=6794
2026-01-15 03:30:58.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419058&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 03:31:02.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768419062 status=200 resp_size=6044
2026-01-15 03:31:02.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419062&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:31:03.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768419063 status=200 resp_size=6544
2026-01-15 03:31:04.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419063&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 03:31:04.112 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
2026-01-15 03:31:10.189 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:31:10.189 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-15 03:31:18.428 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.24 秒后继续...
2026-01-15 03:31:18.428 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 26/26 页...
2026-01-15 03:31:18.428 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:31:18.453 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=常德, 工作类型=3812
2026-01-15 03:31:18.923 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:31:20.038 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:31:22.160 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:31:22.160 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:31:22.600 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768419078 status=200 resp_size=115115
2026-01-15 03:31:22.600 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17 | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
2026-01-15 03:31:22.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768419082 status=200 resp_size=7105
2026-01-15 03:31:22.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419082&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-15 03:31:31.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768419091 status=200 resp_size=6531
2026-01-15 03:31:32.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419091&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-15 03:31:34.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768419094 status=200 resp_size=6107
2026-01-15 03:31:34.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419094&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:31:36.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768419096 status=200 resp_size=4704
2026-01-15 03:31:36.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419096&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-15 03:31:40.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768419100 status=200 resp_size=6427
2026-01-15 03:31:40.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419100&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 03:31:51.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job&timestamp=1768419110 status=200 resp_size=5737
2026-01-15 03:31:51.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419111&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 03:31:53.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768419113 status=200 resp_size=6113
2026-01-15 03:31:53.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419113&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:31:57.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768419117 status=200 resp_size=5499
2026-01-15 03:31:57.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419117&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-15 03:32:06.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768419126 status=200 resp_size=5880
2026-01-15 03:32:06.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419126&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 03:32:10.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768419130 status=200 resp_size=5139
2026-01-15 03:32:10.349 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419130&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:32:15.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768419135 status=200 resp_size=6107
2026-01-15 03:32:16.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419135&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:32:19.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768419139 status=200 resp_size=5903
2026-01-15 03:32:19.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419139&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-15 03:32:21.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768419141 status=200 resp_size=5129
2026-01-15 03:32:21.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419141&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 03:32:30.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768419150 status=200 resp_size=5241
2026-01-15 03:32:31.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419150&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:32:37.180 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768419156 status=200 resp_size=6109
2026-01-15 03:32:37.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419157&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:32:45.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768419165 status=200 resp_size=6111
2026-01-15 03:32:46.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419165&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:32:47.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768419167 status=200 resp_size=6122
2026-01-15 03:32:47.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419167&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 03:32:47.779 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
2026-01-15 03:32:52.932 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 513 条
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 4 条
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 常德(常德)
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 服装/纺织设计总监(3812)
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 99.23% (513/517)
2026-01-15 03:32:52.932 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(513) < API返回总数(517),可能存在分页问题或数据过滤
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-15 03:32:52.932 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 513 条记录)
2026-01-15 03:32:52.932 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 513 个职位
2026-01-15 03:32:52.932 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-15 03:32:59.519 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:32:59.531 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:32:59.873 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-15 03:32:59.873 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:32:59.904 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:33:00.437 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:33:01.567 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:33:03.704 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:33:03.704 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:33:04.159 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768419179 status=200 resp_size=107956
2026-01-15 03:33:04.159 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:33:04.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768419184 status=200 resp_size=5029
2026-01-15 03:33:04.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419184&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 03:33:07.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768419187 status=200 resp_size=5184
2026-01-15 03:33:07.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419187&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 03:33:09.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768419189 status=200 resp_size=5579
2026-01-15 03:33:09.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419189&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 03:33:11.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768419191 status=200 resp_size=5000
2026-01-15 03:33:12.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419191&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-15 03:33:16.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768419196 status=200 resp_size=4913
2026-01-15 03:33:16.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419196&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 03:33:18.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768419198 status=200 resp_size=5546
2026-01-15 03:33:19.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419198&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 03:33:21.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768419201 status=200 resp_size=5630
2026-01-15 03:33:21.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419201&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 03:33:26.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768419206 status=200 resp_size=6579
2026-01-15 03:33:26.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419206&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-15 03:33:32.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768419212 status=200 resp_size=4954
2026-01-15 03:33:32.838 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419212&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 03:33:39.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768419219 status=200 resp_size=5739
2026-01-15 03:33:39.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419219&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-15 03:33:49.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768419229 status=200 resp_size=6192
2026-01-15 03:33:49.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419229&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 03:33:52.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job&timestamp=1768419232 status=200 resp_size=6139
2026-01-15 03:33:52.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419232&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 03:33:56.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job&timestamp=1768419236 status=200 resp_size=5976
2026-01-15 03:33:56.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419236&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 03:33:59.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768419239 status=200 resp_size=5813
2026-01-15 03:33:59.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419239&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 03:34:08.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768419248 status=200 resp_size=5890
2026-01-15 03:34:08.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419248&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 03:34:18.675 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768419258 status=200 resp_size=4892
2026-01-15 03:34:18.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419258&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 03:34:28.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768419267 status=200 resp_size=6399
2026-01-15 03:34:28.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419268&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:34:38.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768419278 status=200 resp_size=5431
2026-01-15 03:34:38.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419278&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-15 03:34:48.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768419288 status=200 resp_size=6023
2026-01-15 03:34:48.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419288&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 03:34:53.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768419293 status=200 resp_size=6048
2026-01-15 03:34:53.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419293&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 03:34:53.957 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
2026-01-15 03:34:59.591 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:34:59.591 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-15 03:34:59.591 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-15 03:35:03.493 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.90 秒后继续...
2026-01-15 03:35:03.493 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-15 03:35:03.493 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:35:03.517 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:35:07.633 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:35:09.205 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:35:11.592 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:35:11.592 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:35:12.517 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768419303 status=200 resp_size=108042
2026-01-15 03:35:12.517 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:35:13.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768419312 status=200 resp_size=6015
2026-01-15 03:35:14.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419313&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-15 03:35:20.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job&timestamp=1768419319 status=200 resp_size=6192
2026-01-15 03:35:20.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419320&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
2026-01-15 03:35:28.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job&timestamp=1768419327 status=200 resp_size=5754
2026-01-15 03:35:28.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419328&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 03:35:30.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768419330 status=200 resp_size=5721
2026-01-15 03:35:30.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419330&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-15 03:35:39.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768419339 status=200 resp_size=5974
2026-01-15 03:35:40.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419339&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:35:48.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768419347 status=200 resp_size=5638
2026-01-15 03:35:48.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419348&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 03:35:54.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job&timestamp=1768419354 status=200 resp_size=6787
2026-01-15 03:35:55.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419354&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
2026-01-15 03:36:04.578 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768419363 status=200 resp_size=5480
2026-01-15 03:36:04.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419364&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-15 03:36:19.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job&timestamp=1768419373 status=200 resp_size=6137
2026-01-15 03:36:20.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419379&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
2026-01-15 03:36:30.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768419388 status=200 resp_size=5190
2026-01-15 03:36:31.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419390&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-15 03:36:40.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768419400 status=200 resp_size=6134
2026-01-15 03:36:41.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419400&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-15 03:36:46.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768419406 status=200 resp_size=5589
2026-01-15 03:36:46.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419406&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-15 03:36:54.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768419413 status=200 resp_size=6366
2026-01-15 03:36:54.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419414&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-15 03:37:01.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768419420 status=200 resp_size=5110
2026-01-15 03:37:01.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419421&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-15 03:37:04.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768419424 status=200 resp_size=5960
2026-01-15 03:37:04.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419424&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-15 03:37:08.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768419428 status=200 resp_size=5613
2026-01-15 03:37:09.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419428&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:37:10.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768419430 status=200 resp_size=6423
2026-01-15 03:37:11.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419430&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 03:37:21.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768419441 status=200 resp_size=5374
2026-01-15 03:37:22.003 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419441&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 03:37:27.612 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768419447 status=200 resp_size=5486
2026-01-15 03:37:27.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419447&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 03:37:33.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768419453 status=200 resp_size=5603
2026-01-15 03:37:34.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419453&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 03:37:34.209 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
2026-01-15 03:37:39.973 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:37:39.973 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-15 03:37:42.604 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.62 秒后继续...
2026-01-15 03:37:42.604 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-15 03:37:42.604 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:37:42.625 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:37:43.285 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:37:44.448 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:37:46.614 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:37:46.614 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:37:47.227 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768419462 status=200 resp_size=121747
2026-01-15 03:37:47.227 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:37:47.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job&timestamp=1768419467 status=200 resp_size=6179
2026-01-15 03:37:47.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419467&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 03:37:50.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768419470 status=200 resp_size=5506
2026-01-15 03:37:50.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419470&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 03:37:52.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job&timestamp=1768419471 status=200 resp_size=6076
2026-01-15 03:37:52.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419472&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 03:37:55.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768419475 status=200 resp_size=5653
2026-01-15 03:37:55.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419475&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-15 03:38:03.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job&timestamp=1768419482 status=200 resp_size=5845
2026-01-15 03:38:03.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419483&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:38:10.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768419489 status=200 resp_size=5513
2026-01-15 03:38:10.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419490&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-15 03:38:20.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768419499 status=200 resp_size=6285
2026-01-15 03:38:20.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419500&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-15 03:38:30.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768419510 status=200 resp_size=5127
2026-01-15 03:38:31.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419510&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-15 03:38:34.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job&timestamp=1768419513 status=200 resp_size=5677
2026-01-15 03:38:34.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419514&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
2026-01-15 03:38:41.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768419520 status=200 resp_size=5182
2026-01-15 03:38:41.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419521&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-15 03:38:48.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768419527 status=200 resp_size=5988
2026-01-15 03:38:48.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419528&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-15 03:38:56.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768419536 status=200 resp_size=5333
2026-01-15 03:38:56.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419536&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:39:09.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job&timestamp=1768419546 status=200 resp_size=7311
2026-01-15 03:39:10.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419549&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
2026-01-15 03:39:20.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768419559 status=200 resp_size=5725
2026-01-15 03:39:20.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419560&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 03:39:22.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768419562 status=200 resp_size=5729
2026-01-15 03:39:22.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419562&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 03:39:28.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job&timestamp=1768419568 status=200 resp_size=5222
2026-01-15 03:39:29.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419568&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 03:39:36.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768419575 status=200 resp_size=7499
2026-01-15 03:39:37.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419576&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 03:39:41.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768419581 status=200 resp_size=5723
2026-01-15 03:39:42.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419581&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 03:39:51.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768419591 status=200 resp_size=6025
2026-01-15 03:39:51.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419591&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-15 03:39:54.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768419594 status=200 resp_size=5245
2026-01-15 03:39:54.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419594&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 03:39:54.733 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
2026-01-15 03:39:55.015 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:39:55.015 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-15 03:40:00.494 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.47 秒后继续...
2026-01-15 03:40:00.494 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-15 03:40:00.494 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:40:00.526 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:40:01.153 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:40:02.473 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:40:04.702 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:40:04.702 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:40:05.253 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768419600 status=200 resp_size=118543
2026-01-15 03:40:05.253 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:40:05.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768419605 status=200 resp_size=5756
2026-01-15 03:40:05.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419605&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:40:12.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768419612 status=200 resp_size=6651
2026-01-15 03:40:12.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419612&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 03:40:22.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768419621 status=200 resp_size=5833
2026-01-15 03:40:22.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419622&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:40:25.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768419625 status=200 resp_size=6448
2026-01-15 03:40:25.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419625&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 03:40:35.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job&timestamp=1768419635 status=200 resp_size=5632
2026-01-15 03:40:35.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419635&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
2026-01-15 03:40:43.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768419642 status=200 resp_size=6466
2026-01-15 03:40:43.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419643&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 03:40:48.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768419648 status=200 resp_size=5793
2026-01-15 03:40:48.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419648&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:40:51.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768419651 status=200 resp_size=5803
2026-01-15 03:40:52.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419651&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 03:40:53.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768419653 status=200 resp_size=6718
2026-01-15 03:40:54.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419653&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-15 03:41:00.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768419659 status=200 resp_size=5961
2026-01-15 03:41:00.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419660&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:41:04.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768419664 status=200 resp_size=6392
2026-01-15 03:41:04.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419664&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 03:41:12.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768419670 status=200 resp_size=6049
2026-01-15 03:41:12.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419672&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:41:14.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768419673 status=200 resp_size=6573
2026-01-15 03:41:14.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419674&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 03:41:19.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768419678 status=200 resp_size=6511
2026-01-15 03:41:19.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419679&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 03:41:24.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768419684 status=200 resp_size=5940
2026-01-15 03:41:25.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419684&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:41:33.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768419692 status=200 resp_size=4058
2026-01-15 03:41:33.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419693&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-15 03:41:42.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768419701 status=200 resp_size=6473
2026-01-15 03:41:42.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419702&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:41:46.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768419706 status=200 resp_size=5232
2026-01-15 03:41:46.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419706&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:41:54.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768419714 status=200 resp_size=6177
2026-01-15 03:41:55.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419714&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 03:41:57.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768419717 status=200 resp_size=5634
2026-01-15 03:41:57.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419717&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:41:57.734 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
2026-01-15 03:42:04.016 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:42:04.016 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-15 03:42:13.444 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.42 秒后继续...
2026-01-15 03:42:13.444 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-15 03:42:13.444 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:42:13.470 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:42:14.066 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:42:15.197 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:42:17.350 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:42:17.350 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:42:17.830 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768419733 status=200 resp_size=125022
2026-01-15 03:42:17.830 | WARNING | __main__:get_recommend_jobs:745 - 第 5 页发现 1 个重复职位(已跳过)
2026-01-15 03:42:17.836 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:42:18.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768419737 status=200 resp_size=6715
2026-01-15 03:42:18.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419738&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-15 03:42:21.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768419741 status=200 resp_size=6125
2026-01-15 03:42:22.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419741&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 03:42:30.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768419750 status=200 resp_size=5888
2026-01-15 03:42:31.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419750&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 03:42:36.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768419756 status=200 resp_size=6055
2026-01-15 03:42:36.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419756&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 03:42:46.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768419765 status=200 resp_size=5699
2026-01-15 03:42:46.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419766&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 03:42:55.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768419775 status=200 resp_size=5455
2026-01-15 03:42:55.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419775&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 03:43:02.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job&timestamp=1768419781 status=200 resp_size=7534
2026-01-15 03:43:02.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419782&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
2026-01-15 03:43:04.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768419784 status=200 resp_size=6314
2026-01-15 03:43:04.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419784&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
2026-01-15 03:43:11.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job&timestamp=1768419791 status=200 resp_size=5857
2026-01-15 03:43:12.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419791&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
2026-01-15 03:43:18.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job&timestamp=1768419798 status=200 resp_size=6024
2026-01-15 03:43:19.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419798&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:43:21.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768419801 status=200 resp_size=5942
2026-01-15 03:43:21.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419801&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 03:43:26.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job&timestamp=1768419806 status=200 resp_size=8574
2026-01-15 03:43:26.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419806&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 03:43:36.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768419815 status=200 resp_size=7551
2026-01-15 03:43:36.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419816&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-15 03:43:42.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768419822 status=200 resp_size=5421
2026-01-15 03:43:42.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419822&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:43:51.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768419831 status=200 resp_size=5784
2026-01-15 03:43:51.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419831&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 03:44:00.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768419839 status=200 resp_size=5306
2026-01-15 03:44:00.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419840&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-15 03:44:14.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768419849 status=200 resp_size=7182
2026-01-15 03:44:15.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419854&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-15 03:44:24.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768419863 status=200 resp_size=5687
2026-01-15 03:44:24.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419864&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:44:33.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job&timestamp=1768419871 status=200 resp_size=5407
2026-01-15 03:44:34.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419873&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
2026-01-15 03:44:34.256 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 19
2026-01-15 03:44:34.680 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 03:44:34.680 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-15 03:44:39.353 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.66 秒后继续...
2026-01-15 03:44:39.353 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-15 03:44:39.353 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:44:39.374 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:44:39.892 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:44:41.022 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:44:43.156 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:44:43.156 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:44:43.578 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768419879 status=200 resp_size=157574
2026-01-15 03:44:43.578 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:44:43.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job&timestamp=1768419883 status=200 resp_size=6343
2026-01-15 03:44:43.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419883&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
2026-01-15 03:44:48.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768419888 status=200 resp_size=5655
2026-01-15 03:44:48.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419888&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 03:44:52.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768419892 status=200 resp_size=6958
2026-01-15 03:44:53.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419892&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:44:59.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768419898 status=200 resp_size=8235
2026-01-15 03:44:59.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419899&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-15 03:45:05.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768419905 status=200 resp_size=7119
2026-01-15 03:45:06.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419905&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 03:45:12.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768419911 status=200 resp_size=5615
2026-01-15 03:45:12.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419912&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 03:45:19.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768419919 status=200 resp_size=6552
2026-01-15 03:45:20.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419919&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:45:22.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768419922 status=200 resp_size=6714
2026-01-15 03:45:23.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419922&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 03:45:32.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768419931 status=200 resp_size=5775
2026-01-15 03:45:32.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419932&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-15 03:45:39.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768419938 status=200 resp_size=6696
2026-01-15 03:45:39.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419939&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-15 03:45:44.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768419944 status=200 resp_size=5497
2026-01-15 03:45:44.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419944&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:45:48.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768419948 status=200 resp_size=13102
2026-01-15 03:45:49.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419948&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 03:45:56.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768419955 status=200 resp_size=5128
2026-01-15 03:45:56.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419956&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 03:45:58.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job&timestamp=1768419958 status=200 resp_size=6362
2026-01-15 03:45:59.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419958&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 03:46:05.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768419964 status=200 resp_size=6689
2026-01-15 03:46:05.602 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419965&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:46:08.846 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768419968 status=200 resp_size=6527
2026-01-15 03:46:09.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419968&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 03:46:16.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job&timestamp=1768419976 status=200 resp_size=7130
2026-01-15 03:46:17.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419976&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 03:46:22.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768419981 status=200 resp_size=7415
2026-01-15 03:46:22.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419982&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
2026-01-15 03:46:31.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job&timestamp=1768419990 status=200 resp_size=6390
2026-01-15 03:46:31.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768419991&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:46:41.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job&timestamp=1768420000 status=200 resp_size=5152
2026-01-15 03:46:41.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420001&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
2026-01-15 03:46:41.626 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
2026-01-15 03:46:48.206 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:46:48.206 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-15 03:46:50.226 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.01 秒后继续...
2026-01-15 03:46:50.226 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-15 03:46:50.226 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:46:50.247 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:46:50.891 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:46:52.085 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:46:54.254 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:46:54.254 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:46:54.772 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420010 status=200 resp_size=147659
2026-01-15 03:46:54.772 | WARNING | __main__:get_recommend_jobs:745 - 第 7 页发现 1 个重复职位(已跳过)
2026-01-15 03:46:54.772 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:46:54.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768420014 status=200 resp_size=5877
2026-01-15 03:46:55.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420014&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
2026-01-15 03:47:01.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768420021 status=200 resp_size=5098
2026-01-15 03:47:02.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420021&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 03:47:03.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768420023 status=200 resp_size=6230
2026-01-15 03:47:03.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420023&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:47:14.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768420033 status=200 resp_size=5711
2026-01-15 03:47:14.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420034&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 03:47:16.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768420036 status=200 resp_size=6970
2026-01-15 03:47:16.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420036&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 03:47:26.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768420045 status=200 resp_size=5109
2026-01-15 03:47:26.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420046&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 03:47:27.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768420047 status=200 resp_size=8808
2026-01-15 03:47:27.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420047&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:47:35.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job&timestamp=1768420055 status=200 resp_size=7717
2026-01-15 03:47:35.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420055&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
2026-01-15 03:47:39.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job&timestamp=1768420059 status=200 resp_size=8734
2026-01-15 03:47:39.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420059&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
2026-01-15 03:47:49.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job&timestamp=1768420069 status=200 resp_size=5920
2026-01-15 03:47:49.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420069&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:48:01.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job&timestamp=1768420079 status=200 resp_size=4321
2026-01-15 03:48:01.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420081&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
2026-01-15 03:48:04.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job&timestamp=1768420084 status=200 resp_size=5533
2026-01-15 03:48:04.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420084&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
2026-01-15 03:48:08.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job&timestamp=1768420088 status=200 resp_size=5524
2026-01-15 03:48:08.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420088&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
2026-01-15 03:48:17.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768420096 status=200 resp_size=6445
2026-01-15 03:48:17.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420097&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:48:19.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768420098 status=200 resp_size=6522
2026-01-15 03:48:19.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420099&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 03:48:29.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768420108 status=200 resp_size=7756
2026-01-15 03:48:29.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420109&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 03:48:39.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768420118 status=200 resp_size=6318
2026-01-15 03:48:39.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420119&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-15 03:48:42.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768420122 status=200 resp_size=6501
2026-01-15 03:48:42.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420122&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:48:52.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job&timestamp=1768420131 status=200 resp_size=5458
2026-01-15 03:48:52.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420132&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
2026-01-15 03:48:52.617 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 19
2026-01-15 03:48:58.643 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 03:48:58.643 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-15 03:49:03.934 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.28 秒后继续...
2026-01-15 03:49:03.934 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-15 03:49:03.934 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:49:03.952 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:49:04.486 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:49:05.618 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:49:07.753 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:49:07.753 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:49:08.209 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420143 status=200 resp_size=137556
2026-01-15 03:49:08.209 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:49:08.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job&timestamp=1768420148 status=200 resp_size=7237
2026-01-15 03:49:08.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420148&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
2026-01-15 03:49:12.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job&timestamp=1768420152 status=200 resp_size=5678
2026-01-15 03:49:13.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420152&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:49:15.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768420155 status=200 resp_size=5342
2026-01-15 03:49:16.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420155&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-15 03:49:26.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job&timestamp=1768420165 status=200 resp_size=6431
2026-01-15 03:49:26.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420166&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
2026-01-15 03:49:29.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job&timestamp=1768420168 status=200 resp_size=7607
2026-01-15 03:49:29.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420169&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 03:49:39.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768420179 status=200 resp_size=8457
2026-01-15 03:49:40.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420179&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:49:44.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job&timestamp=1768420184 status=200 resp_size=6416
2026-01-15 03:49:45.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420184&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 03:49:47.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job&timestamp=1768420187 status=200 resp_size=5876
2026-01-15 03:49:47.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420187&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 03:49:51.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768420191 status=200 resp_size=6168
2026-01-15 03:49:51.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420191&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:49:57.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job&timestamp=1768420197 status=200 resp_size=6646
2026-01-15 03:49:58.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420197&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
2026-01-15 03:50:07.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768420206 status=200 resp_size=5485
2026-01-15 03:50:07.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420207&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-15 03:50:16.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768420215 status=200 resp_size=6511
2026-01-15 03:50:16.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420216&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:50:20.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768420220 status=200 resp_size=6449
2026-01-15 03:50:20.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420220&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-15 03:50:22.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768420222 status=200 resp_size=5925
2026-01-15 03:50:22.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420222&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
2026-01-15 03:50:32.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768420231 status=200 resp_size=7750
2026-01-15 03:50:32.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420232&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 03:50:38.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768420237 status=200 resp_size=6119
2026-01-15 03:50:38.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420238&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:50:46.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768420245 status=200 resp_size=7971
2026-01-15 03:50:46.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420246&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 03:50:51.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768420250 status=200 resp_size=8313
2026-01-15 03:50:51.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420251&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-15 03:50:58.962 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job&timestamp=1768420258 status=200 resp_size=5424
2026-01-15 03:50:59.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420258&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
2026-01-15 03:51:01.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768420261 status=200 resp_size=6058
2026-01-15 03:51:01.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420261&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:51:01.897 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
2026-01-15 03:51:08.355 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:51:08.355 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-15 03:51:15.718 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.36 秒后继续...
2026-01-15 03:51:15.719 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-15 03:51:15.719 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:51:15.751 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:51:16.348 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:51:17.510 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:51:19.645 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:51:19.645 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:51:20.164 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420275 status=200 resp_size=162095
2026-01-15 03:51:20.164 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:51:20.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job&timestamp=1768420280 status=200 resp_size=8274
2026-01-15 03:51:20.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420280&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
2026-01-15 03:51:27.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768420286 status=200 resp_size=8701
2026-01-15 03:51:27.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420287&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-15 03:51:36.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768420295 status=200 resp_size=5211
2026-01-15 03:51:36.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420296&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
2026-01-15 03:51:48.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768420306 status=200 resp_size=6284
2026-01-15 03:51:48.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420308&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:51:53.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job&timestamp=1768420312 status=200 resp_size=5378
2026-01-15 03:51:53.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420313&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
2026-01-15 03:51:58.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768420318 status=200 resp_size=7299
2026-01-15 03:51:58.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420318&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-15 03:52:03.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job&timestamp=1768420322 status=200 resp_size=7262
2026-01-15 03:52:03.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420323&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 03:52:09.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768420329 status=200 resp_size=6254
2026-01-15 03:52:10.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420329&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:52:17.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job&timestamp=1768420336 status=200 resp_size=7967
2026-01-15 03:52:17.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420337&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
2026-01-15 03:52:26.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768420345 status=200 resp_size=5253
2026-01-15 03:52:27.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420346&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 03:52:36.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768420355 status=200 resp_size=5431
2026-01-15 03:52:36.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420356&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 03:52:44.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768420364 status=200 resp_size=4995
2026-01-15 03:52:44.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420364&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:52:52.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768420371 status=200 resp_size=6080
2026-01-15 03:52:52.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420372&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 03:52:57.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768420377 status=200 resp_size=5936
2026-01-15 03:52:57.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420377&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-15 03:53:06.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768420385 status=200 resp_size=6039
2026-01-15 03:53:07.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420386&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-15 03:53:11.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768420391 status=200 resp_size=4916
2026-01-15 03:53:12.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420391&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 03:53:20.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768420399 status=200 resp_size=5446
2026-01-15 03:53:20.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420400&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-15 03:53:27.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768420406 status=200 resp_size=6494
2026-01-15 03:53:27.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420407&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
2026-01-15 03:53:31.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768420411 status=200 resp_size=5860
2026-01-15 03:53:31.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420411&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:53:37.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768420416 status=200 resp_size=6226
2026-01-15 03:53:37.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420417&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-15 03:53:37.275 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
2026-01-15 03:53:43.816 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:53:43.816 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-15 03:53:50.872 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.05 秒后继续...
2026-01-15 03:53:50.872 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-15 03:53:50.872 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:53:50.887 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:53:51.672 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:53:52.868 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:53:55.177 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:53:55.177 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:53:55.994 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420430 status=200 resp_size=142102
2026-01-15 03:53:55.994 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:53:56.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job&timestamp=1768420435 status=200 resp_size=5613
2026-01-15 03:53:56.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420436&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 03:54:03.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768420442 status=200 resp_size=6422
2026-01-15 03:54:03.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420443&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-15 03:54:11.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768420450 status=200 resp_size=5792
2026-01-15 03:54:11.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420451&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:54:15.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768420455 status=200 resp_size=6176
2026-01-15 03:54:15.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420455&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-15 03:54:18.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job&timestamp=1768420458 status=200 resp_size=6731
2026-01-15 03:54:18.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420458&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 03:54:20.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job&timestamp=1768420459 status=200 resp_size=5575
2026-01-15 03:54:20.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420460&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 03:54:31.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768420468 status=200 resp_size=6856
2026-01-15 03:54:31.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420471&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
2026-01-15 03:54:36.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768420476 status=200 resp_size=6768
2026-01-15 03:54:36.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420476&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:54:41.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768420481 status=200 resp_size=5731
2026-01-15 03:54:41.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420481&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-15 03:54:52.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768420491 status=200 resp_size=7075
2026-01-15 03:54:52.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420492&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 03:54:55.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768420495 status=200 resp_size=6530
2026-01-15 03:54:56.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420495&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 03:54:58.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768420498 status=200 resp_size=8973
2026-01-15 03:54:58.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420498&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
2026-01-15 03:55:00.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job&timestamp=1768420500 status=200 resp_size=6313
2026-01-15 03:55:00.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420500&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
2026-01-15 03:55:02.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768420502 status=200 resp_size=8559
2026-01-15 03:55:02.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420502&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
2026-01-15 03:55:07.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768420507 status=200 resp_size=6688
2026-01-15 03:55:08.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420507&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-15 03:55:09.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768420509 status=200 resp_size=5290
2026-01-15 03:55:09.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420509&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 03:55:16.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768420515 status=200 resp_size=5982
2026-01-15 03:55:16.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420516&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-15 03:55:19.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job&timestamp=1768420519 status=200 resp_size=7919
2026-01-15 03:55:19.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420519&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
2026-01-15 03:55:22.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job&timestamp=1768420522 status=200 resp_size=7681
2026-01-15 03:55:23.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420522&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
2026-01-15 03:55:24.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768420524 status=200 resp_size=5271
2026-01-15 03:55:24.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420524&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 03:55:24.888 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 20
2026-01-15 03:55:31.233 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 03:55:31.233 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-15 03:55:40.850 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.60 秒后继续...
2026-01-15 03:55:40.850 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-15 03:55:40.850 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:55:40.879 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:55:41.565 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:55:42.713 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:55:44.879 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:55:44.879 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:55:45.413 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420540 status=200 resp_size=135542
2026-01-15 03:55:45.413 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
2026-01-15 03:55:45.413 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:55:45.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768420545 status=200 resp_size=5686
2026-01-15 03:55:45.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420545&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
2026-01-15 03:55:52.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job&timestamp=1768420552 status=200 resp_size=6660
2026-01-15 03:55:53.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420552&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 03:55:54.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job&timestamp=1768420554 status=200 resp_size=7952
2026-01-15 03:55:54.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420554&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
2026-01-15 03:56:03.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job&timestamp=1768420562 status=200 resp_size=5414
2026-01-15 03:56:03.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420563&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 03:56:13.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768420572 status=200 resp_size=5277
2026-01-15 03:56:13.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420573&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-15 03:56:19.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768420578 status=200 resp_size=7175
2026-01-15 03:56:19.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420579&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-15 03:56:27.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768420586 status=200 resp_size=6284
2026-01-15 03:56:27.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420587&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 03:56:31.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768420591 status=200 resp_size=5673
2026-01-15 03:56:32.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420591&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-15 03:56:42.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768420601 status=200 resp_size=5924
2026-01-15 03:56:42.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420602&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-15 03:56:49.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768420608 status=200 resp_size=6003
2026-01-15 03:56:49.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420609&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-15 03:56:51.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768420610 status=200 resp_size=5378
2026-01-15 03:56:52.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420611&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-15 03:56:59.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768420617 status=200 resp_size=5084
2026-01-15 03:56:59.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420619&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 03:57:03.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768420623 status=200 resp_size=9486
2026-01-15 03:57:04.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420623&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 03:57:06.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768420626 status=200 resp_size=5363
2026-01-15 03:57:06.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420626&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-15 03:57:11.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job&timestamp=1768420631 status=200 resp_size=13285
2026-01-15 03:57:12.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420631&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 03:57:20.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768420639 status=200 resp_size=6873
2026-01-15 03:57:20.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420640&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 03:57:29.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job&timestamp=1768420648 status=200 resp_size=6041
2026-01-15 03:57:29.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420649&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
2026-01-15 03:57:33.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job&timestamp=1768420653 status=200 resp_size=6635
2026-01-15 03:57:33.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420653&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
2026-01-15 03:57:41.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768420660 status=200 resp_size=5390
2026-01-15 03:57:41.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420661&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-15 03:57:41.515 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
2026-01-15 03:57:47.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 03:57:47.338 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-15 03:57:52.077 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.73 秒后继续...
2026-01-15 03:57:52.077 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-15 03:57:52.077 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 03:57:52.096 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 03:57:52.788 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:57:53.951 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:57:56.119 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 03:57:56.119 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 03:57:56.589 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420672 status=200 resp_size=126440
2026-01-15 03:57:56.589 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 03:57:56.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job&timestamp=1768420676 status=200 resp_size=8070
2026-01-15 03:57:56.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420676&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 03:58:03.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768420682 status=200 resp_size=6588
2026-01-15 03:58:03.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420683&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 03:58:10.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job&timestamp=1768420689 status=200 resp_size=6300
2026-01-15 03:58:10.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420690&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
2026-01-15 03:58:16.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768420695 status=200 resp_size=7194
2026-01-15 03:58:16.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420696&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 03:58:25.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768420705 status=200 resp_size=6053
2026-01-15 03:58:26.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420705&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 03:58:32.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768420711 status=200 resp_size=7170
2026-01-15 03:58:32.798 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420712&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 03:58:37.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768420717 status=200 resp_size=4992
2026-01-15 03:58:37.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420717&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-15 03:58:47.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768420726 status=200 resp_size=6073
2026-01-15 03:58:47.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420727&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 03:58:49.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768420729 status=200 resp_size=7194
2026-01-15 03:58:50.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420729&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-15 03:58:56.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768420735 status=200 resp_size=5344
2026-01-15 03:58:56.798 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420736&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 03:58:59.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768420739 status=200 resp_size=5554
2026-01-15 03:59:00.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420739&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 03:59:09.725 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768420748 status=200 resp_size=5280
2026-01-15 03:59:10.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420749&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 03:59:16.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768420755 status=200 resp_size=5040
2026-01-15 03:59:16.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420756&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-15 03:59:22.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768420761 status=200 resp_size=4993
2026-01-15 03:59:23.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420762&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 03:59:26.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768420766 status=200 resp_size=6752
2026-01-15 03:59:26.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420766&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 03:59:33.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768420772 status=200 resp_size=5883
2026-01-15 03:59:33.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420773&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-15 03:59:39.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768420778 status=200 resp_size=5764
2026-01-15 03:59:39.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420779&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 03:59:50.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768420789 status=200 resp_size=5688
2026-01-15 03:59:51.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420790&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:00:01.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768420800 status=200 resp_size=6980
2026-01-15 04:00:01.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420801&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 04:00:11.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768420810 status=200 resp_size=5283
2026-01-15 04:00:11.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420811&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:00:11.867 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
2026-01-15 04:00:12.228 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:00:12.228 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-15 04:00:15.921 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.69 秒后继续...
2026-01-15 04:00:15.921 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-15 04:00:15.921 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:00:15.936 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:00:17.161 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:00:18.386 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:00:20.570 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:00:20.570 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:00:21.276 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420815 status=200 resp_size=150764
2026-01-15 04:00:21.276 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:00:21.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768420821 status=200 resp_size=5215
2026-01-15 04:00:21.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420821&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-15 04:00:27.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768420827 status=200 resp_size=5516
2026-01-15 04:00:27.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420827&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-15 04:00:38.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768420837 status=200 resp_size=6659
2026-01-15 04:00:38.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420838&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 04:00:44.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job&timestamp=1768420843 status=200 resp_size=5165
2026-01-15 04:00:44.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420844&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
2026-01-15 04:00:48.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768420847 status=200 resp_size=6856
2026-01-15 04:00:48.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420848&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 04:00:55.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job&timestamp=1768420854 status=200 resp_size=5570
2026-01-15 04:00:56.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420855&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
2026-01-15 04:01:06.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768420865 status=200 resp_size=5688
2026-01-15 04:01:06.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420866&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
2026-01-15 04:01:10.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768420870 status=200 resp_size=6380
2026-01-15 04:01:10.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420870&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 04:01:14.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job&timestamp=1768420873 status=200 resp_size=6612
2026-01-15 04:01:14.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420874&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
2026-01-15 04:01:21.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job&timestamp=1768420880 status=200 resp_size=7975
2026-01-15 04:01:22.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420881&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
2026-01-15 04:01:31.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job&timestamp=1768420890 status=200 resp_size=5984
2026-01-15 04:01:31.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420891&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 04:01:35.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768420894 status=200 resp_size=7270
2026-01-15 04:01:35.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420895&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 04:01:39.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job&timestamp=1768420899 status=200 resp_size=5582
2026-01-15 04:01:39.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420899&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 04:01:41.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job&timestamp=1768420901 status=200 resp_size=5924
2026-01-15 04:01:41.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420901&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
2026-01-15 04:01:44.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job&timestamp=1768420903 status=200 resp_size=6027
2026-01-15 04:01:44.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420904&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
2026-01-15 04:01:52.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job&timestamp=1768420911 status=200 resp_size=6028
2026-01-15 04:01:53.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420912&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 04:02:00.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768420920 status=200 resp_size=8782
2026-01-15 04:02:01.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420920&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 04:02:08.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768420927 status=200 resp_size=8655
2026-01-15 04:02:08.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420928&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-15 04:02:15.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768420934 status=200 resp_size=6935
2026-01-15 04:02:16.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420935&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-15 04:02:20.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job&timestamp=1768420940 status=200 resp_size=6440
2026-01-15 04:02:20.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420940&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
2026-01-15 04:02:20.577 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
2026-01-15 04:02:26.606 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:02:26.622 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-15 04:02:31.572 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.95 秒后继续...
2026-01-15 04:02:31.572 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-15 04:02:31.572 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:02:31.599 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:02:32.321 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:02:33.501 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:02:35.674 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:02:35.674 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:02:36.153 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768420951 status=200 resp_size=147742
2026-01-15 04:02:36.153 | WARNING | __main__:get_recommend_jobs:745 - 第 14 页发现 1 个重复职位(已跳过)
2026-01-15 04:02:36.153 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:02:36.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768420956 status=200 resp_size=7907
2026-01-15 04:02:36.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420956&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-15 04:02:47.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job&timestamp=1768420966 status=200 resp_size=4592
2026-01-15 04:02:47.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420967&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
2026-01-15 04:02:49.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768420968 status=200 resp_size=5878
2026-01-15 04:02:49.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420969&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 04:02:55.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job&timestamp=1768420975 status=200 resp_size=6437
2026-01-15 04:02:56.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420975&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 04:03:03.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768420982 status=200 resp_size=5672
2026-01-15 04:03:03.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420983&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-15 04:03:10.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768420989 status=200 resp_size=9108
2026-01-15 04:03:10.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420990&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-15 04:03:14.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768420994 status=200 resp_size=6111
2026-01-15 04:03:14.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768420994&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
2026-01-15 04:03:25.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job&timestamp=1768421003 status=200 resp_size=6958
2026-01-15 04:03:26.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421005&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
2026-01-15 04:03:37.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768421016 status=200 resp_size=7313
2026-01-15 04:03:37.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421017&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-15 04:03:44.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768421024 status=200 resp_size=6694
2026-01-15 04:03:45.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421024&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
2026-01-15 04:03:46.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768421026 status=200 resp_size=6568
2026-01-15 04:03:46.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421026&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-15 04:03:48.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768421027 status=200 resp_size=5922
2026-01-15 04:03:48.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421028&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 04:03:54.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job&timestamp=1768421033 status=200 resp_size=5499
2026-01-15 04:03:54.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421034&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
2026-01-15 04:03:59.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768421039 status=200 resp_size=6184
2026-01-15 04:03:59.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421039&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-15 04:04:03.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768421043 status=200 resp_size=5673
2026-01-15 04:04:04.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421043&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-15 04:04:06.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768421045 status=200 resp_size=7079
2026-01-15 04:04:06.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421046&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 04:04:12.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768421051 status=200 resp_size=7664
2026-01-15 04:04:12.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421052&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 04:04:14.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768421054 status=200 resp_size=6652
2026-01-15 04:04:14.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421054&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-15 04:04:22.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768421062 status=200 resp_size=4733
2026-01-15 04:04:23.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421062&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 04:04:23.060 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 19
2026-01-15 04:04:29.062 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 04:04:29.062 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-15 04:04:30.740 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.67 秒后继续...
2026-01-15 04:04:30.740 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-15 04:04:30.740 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:04:30.759 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:04:31.450 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:04:32.629 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:04:34.813 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:04:34.813 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:04:35.316 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768421070 status=200 resp_size=134779
2026-01-15 04:04:35.316 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:04:35.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768421075 status=200 resp_size=4926
2026-01-15 04:04:35.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421075&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 04:04:38.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768421078 status=200 resp_size=4906
2026-01-15 04:04:39.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421078&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 04:04:48.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job&timestamp=1768421087 status=200 resp_size=7369
2026-01-15 04:04:49.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421088&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 04:04:51.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768421091 status=200 resp_size=4834
2026-01-15 04:04:51.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421091&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 04:05:00.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768421099 status=200 resp_size=5006
2026-01-15 04:05:00.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421100&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 04:05:03.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768421103 status=200 resp_size=5363
2026-01-15 04:05:03.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421103&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-15 04:05:09.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768421108 status=200 resp_size=5232
2026-01-15 04:05:09.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421109&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-15 04:05:13.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job&timestamp=1768421113 status=200 resp_size=6946
2026-01-15 04:05:13.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421113&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
2026-01-15 04:05:16.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768421116 status=200 resp_size=4956
2026-01-15 04:05:16.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421116&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:05:26.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768421125 status=200 resp_size=7382
2026-01-15 04:05:27.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421126&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 04:05:37.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768421136 status=200 resp_size=7331
2026-01-15 04:05:38.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421137&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 04:05:43.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job&timestamp=1768421142 status=200 resp_size=5087
2026-01-15 04:05:43.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421143&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
2026-01-15 04:05:51.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job&timestamp=1768421150 status=200 resp_size=6551
2026-01-15 04:05:51.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421151&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
2026-01-15 04:06:11.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768421160 status=200 resp_size=4515
2026-01-15 04:06:14.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421171&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-15 04:06:22.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768421181 status=200 resp_size=4865
2026-01-15 04:06:23.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421182&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-15 04:06:30.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768421188 status=200 resp_size=5241
2026-01-15 04:06:30.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421190&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-15 04:06:40.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job&timestamp=1768421200 status=200 resp_size=5494
2026-01-15 04:06:41.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421200&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 04:06:47.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768421206 status=200 resp_size=6572
2026-01-15 04:06:49.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421207&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-15 04:06:56.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job&timestamp=1768421216 status=200 resp_size=6576
2026-01-15 04:06:57.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421216&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 04:07:01.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768421221 status=200 resp_size=5674
2026-01-15 04:07:01.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421221&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 04:07:01.705 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
2026-01-15 04:07:07.531 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:07:07.531 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-15 04:07:12.589 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.05 秒后继续...
2026-01-15 04:07:12.589 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 16/26 页...
2026-01-15 04:07:12.589 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:07:12.604 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:07:13.265 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:07:14.412 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:07:16.563 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:07:16.563 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:07:16.988 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768421232 status=200 resp_size=130077
2026-01-15 04:07:16.988 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:07:17.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768421237 status=200 resp_size=6303
2026-01-15 04:07:17.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421237&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 04:07:18.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768421238 status=200 resp_size=6139
2026-01-15 04:07:19.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421238&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-15 04:07:21.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768421241 status=200 resp_size=5471
2026-01-15 04:07:21.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421241&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 04:07:26.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768421246 status=200 resp_size=5725
2026-01-15 04:07:26.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421246&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-15 04:07:33.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job&timestamp=1768421252 status=200 resp_size=4737
2026-01-15 04:07:34.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421253&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 04:07:38.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job&timestamp=1768421258 status=200 resp_size=4297
2026-01-15 04:07:39.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421258&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
2026-01-15 04:07:48.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job&timestamp=1768421267 status=200 resp_size=5259
2026-01-15 04:07:48.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421268&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
2026-01-15 04:07:54.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768421273 status=200 resp_size=4786
2026-01-15 04:07:54.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421274&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 04:07:57.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768421277 status=200 resp_size=5746
2026-01-15 04:07:58.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421277&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 04:08:08.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768421287 status=200 resp_size=5466
2026-01-15 04:08:08.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421288&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 04:08:13.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job&timestamp=1768421292 status=200 resp_size=5037
2026-01-15 04:08:13.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421293&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 04:08:23.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job&timestamp=1768421302 status=200 resp_size=5631
2026-01-15 04:08:23.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421303&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 04:08:28.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job&timestamp=1768421307 status=200 resp_size=5979
2026-01-15 04:08:28.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421308&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
2026-01-15 04:08:36.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768421315 status=200 resp_size=6264
2026-01-15 04:08:36.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421316&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-15 04:08:39.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768421319 status=200 resp_size=5973
2026-01-15 04:08:40.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421319&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-15 04:08:50.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768421328 status=200 resp_size=5928
2026-01-15 04:08:51.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421330&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 04:08:58.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768421337 status=200 resp_size=4719
2026-01-15 04:09:00.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421338&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-15 04:09:10.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768421349 status=200 resp_size=6295
2026-01-15 04:09:10.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421350&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-15 04:09:12.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job&timestamp=1768421352 status=200 resp_size=5806
2026-01-15 04:09:13.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421352&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 04:09:25.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768421360 status=200 resp_size=5174
2026-01-15 04:09:26.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421365&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-15 04:09:26.211 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
2026-01-15 04:09:32.015 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:09:32.015 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-15 04:09:40.848 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.82 秒后继续...
2026-01-15 04:09:40.848 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 17/26 页...
2026-01-15 04:09:40.848 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:09:40.872 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:09:44.626 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:09:45.866 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:09:48.018 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:09:48.018 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:09:48.592 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768421380 status=200 resp_size=124077
2026-01-15 04:09:48.592 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:09:48.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768421388 status=200 resp_size=6666
2026-01-15 04:09:48.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421388&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 04:09:51.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768421391 status=200 resp_size=4654
2026-01-15 04:09:51.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421391&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-15 04:09:58.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job&timestamp=1768421397 status=200 resp_size=7057
2026-01-15 04:09:59.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421398&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
2026-01-15 04:10:07.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768421407 status=200 resp_size=7248
2026-01-15 04:10:08.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421407&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 04:10:17.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job&timestamp=1768421416 status=200 resp_size=6546
2026-01-15 04:10:17.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421417&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 04:10:24.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768421423 status=200 resp_size=6546
2026-01-15 04:10:24.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421424&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-15 04:10:33.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job&timestamp=1768421433 status=200 resp_size=4679
2026-01-15 04:10:34.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421433&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-15 04:10:41.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768421440 status=200 resp_size=4783
2026-01-15 04:10:41.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421441&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 04:10:46.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768421446 status=200 resp_size=5359
2026-01-15 04:10:46.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421446&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:10:50.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768421450 status=200 resp_size=6326
2026-01-15 04:10:51.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421450&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 04:11:00.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768421460 status=200 resp_size=5106
2026-01-15 04:11:01.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421460&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
2026-01-15 04:11:10.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job&timestamp=1768421470 status=200 resp_size=4572
2026-01-15 04:11:11.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421470&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
2026-01-15 04:11:13.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768421473 status=200 resp_size=5306
2026-01-15 04:11:13.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421473&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-15 04:11:16.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job&timestamp=1768421476 status=200 resp_size=6325
2026-01-15 04:11:17.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421476&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 04:11:21.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768421481 status=200 resp_size=6073
2026-01-15 04:11:21.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421481&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-15 04:11:27.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768421487 status=200 resp_size=5111
2026-01-15 04:11:28.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421487&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 04:11:34.270 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job&timestamp=1768421493 status=200 resp_size=5915
2026-01-15 04:11:34.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421494&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 04:11:41.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768421500 status=200 resp_size=5282
2026-01-15 04:11:41.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421501&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 04:11:49.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job&timestamp=1768421508 status=200 resp_size=7722
2026-01-15 04:11:49.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421509&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 04:11:52.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job&timestamp=1768421512 status=200 resp_size=5294
2026-01-15 04:11:53.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421512&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:11:53.008 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
2026-01-15 04:11:53.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:11:53.338 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-15 04:12:00.755 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.41 秒后继续...
2026-01-15 04:12:00.755 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 18/26 页...
2026-01-15 04:12:00.755 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:12:00.783 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:12:05.888 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:12:07.050 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:12:09.234 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:12:09.234 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:12:09.752 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768421520 status=200 resp_size=130603
2026-01-15 04:12:09.752 | WARNING | __main__:get_recommend_jobs:745 - 第 18 页发现 1 个重复职位(已跳过)
2026-01-15 04:12:09.752 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:12:09.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job&timestamp=1768421529 status=200 resp_size=5943
2026-01-15 04:12:10.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421529&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
2026-01-15 04:12:20.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job&timestamp=1768421539 status=200 resp_size=7688
2026-01-15 04:12:20.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421540&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 04:12:23.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768421543 status=200 resp_size=4757
2026-01-15 04:12:23.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421543&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-15 04:12:28.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job&timestamp=1768421547 status=200 resp_size=5693
2026-01-15 04:12:28.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421548&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:12:34.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768421554 status=200 resp_size=5853
2026-01-15 04:12:35.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421554&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 04:12:39.568 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768421559 status=200 resp_size=5360
2026-01-15 04:12:39.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421559&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-15 04:12:49.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768421568 status=200 resp_size=5666
2026-01-15 04:12:49.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421569&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 04:12:59.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768421578 status=200 resp_size=5591
2026-01-15 04:12:59.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421579&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:13:01.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job&timestamp=1768421581 status=200 resp_size=5651
2026-01-15 04:13:01.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421581&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 04:13:09.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job&timestamp=1768421588 status=200 resp_size=4864
2026-01-15 04:13:09.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421589&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 04:13:17.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768421596 status=200 resp_size=4333
2026-01-15 04:13:17.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421597&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-15 04:13:21.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job&timestamp=1768421600 status=200 resp_size=5317
2026-01-15 04:13:21.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421601&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:13:31.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768421610 status=200 resp_size=6269
2026-01-15 04:13:31.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421611&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-15 04:13:35.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768421615 status=200 resp_size=5481
2026-01-15 04:13:35.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421615&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-15 04:13:37.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768421616 status=200 resp_size=6454
2026-01-15 04:13:37.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421617&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 04:13:41.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768421620 status=200 resp_size=5510
2026-01-15 04:13:41.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421621&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:13:46.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768421625 status=200 resp_size=8675
2026-01-15 04:13:46.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421626&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-15 04:13:48.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job&timestamp=1768421628 status=200 resp_size=5938
2026-01-15 04:13:49.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421628&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-15 04:13:56.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768421635 status=200 resp_size=6458
2026-01-15 04:13:56.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421636&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 04:13:56.876 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 19
2026-01-15 04:13:57.191 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 04:13:57.191 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-15 04:14:05.999 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.80 秒后继续...
2026-01-15 04:14:05.999 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 19/26 页...
2026-01-15 04:14:06.002 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:14:06.017 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:14:07.320 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:14:09.144 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:14:11.595 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:14:11.595 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:14:12.410 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768421646 status=200 resp_size=114103
2026-01-15 04:14:12.410 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:14:12.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768421652 status=200 resp_size=8440
2026-01-15 04:14:12.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421652&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
2026-01-15 04:14:19.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job&timestamp=1768421658 status=200 resp_size=5227
2026-01-15 04:14:19.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421659&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 04:14:22.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768421661 status=200 resp_size=5162
2026-01-15 04:14:22.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421662&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-15 04:14:28.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job&timestamp=1768421667 status=200 resp_size=6414
2026-01-15 04:14:28.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421668&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
2026-01-15 04:14:35.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768421674 status=200 resp_size=6062
2026-01-15 04:14:36.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421675&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-15 04:14:42.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job&timestamp=1768421681 status=200 resp_size=5449
2026-01-15 04:14:42.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421682&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 04:14:44.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768421683 status=200 resp_size=5708
2026-01-15 04:14:44.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421684&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 04:14:51.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768421690 status=200 resp_size=6976
2026-01-15 04:14:51.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421691&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 04:14:54.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768421694 status=200 resp_size=5837
2026-01-15 04:14:54.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421694&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 04:14:58.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768421698 status=200 resp_size=5506
2026-01-15 04:14:59.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421698&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 04:15:09.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768421708 status=200 resp_size=5845
2026-01-15 04:15:09.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421709&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 04:15:11.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768421711 status=200 resp_size=6139
2026-01-15 04:15:11.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421711&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 04:15:19.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768421718 status=200 resp_size=5599
2026-01-15 04:15:19.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421719&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 04:15:24.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768421724 status=200 resp_size=5636
2026-01-15 04:15:26.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421724&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-15 04:15:32.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768421732 status=200 resp_size=6222
2026-01-15 04:15:33.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421732&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 04:15:41.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job&timestamp=1768421740 status=200 resp_size=7704
2026-01-15 04:15:41.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421741&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 04:15:43.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768421743 status=200 resp_size=5400
2026-01-15 04:15:43.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421743&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 04:15:52.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768421751 status=200 resp_size=5846
2026-01-15 04:15:52.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421752&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 04:15:56.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768421756 status=200 resp_size=4627
2026-01-15 04:15:56.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421756&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 04:16:04.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768421763 status=200 resp_size=6090
2026-01-15 04:16:05.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421764&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:16:05.144 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
2026-01-15 04:16:10.846 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:16:10.846 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-15 04:16:14.834 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.98 秒后继续...
2026-01-15 04:16:14.834 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 20/26 页...
2026-01-15 04:16:14.834 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:16:14.852 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:16:15.557 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:16:16.720 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:16:18.892 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:16:18.892 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:16:19.326 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768421774 status=200 resp_size=108282
2026-01-15 04:16:19.326 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:16:19.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768421779 status=200 resp_size=6346
2026-01-15 04:16:19.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421779&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-15 04:16:29.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768421788 status=200 resp_size=6896
2026-01-15 04:16:29.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421789&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 04:16:36.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768421795 status=200 resp_size=5290
2026-01-15 04:16:36.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421796&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 04:16:46.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768421805 status=200 resp_size=5976
2026-01-15 04:16:46.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421806&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:16:53.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768421812 status=200 resp_size=6435
2026-01-15 04:16:53.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421813&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 04:16:59.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768421819 status=200 resp_size=6490
2026-01-15 04:17:00.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421819&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-15 04:17:09.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768421828 status=200 resp_size=6194
2026-01-15 04:17:10.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421829&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-15 04:17:18.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768421837 status=200 resp_size=6078
2026-01-15 04:17:18.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421838&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:17:26.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768421845 status=200 resp_size=5526
2026-01-15 04:17:26.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421846&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-15 04:17:29.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768421849 status=200 resp_size=6819
2026-01-15 04:17:29.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421849&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-15 04:17:40.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768421859 status=200 resp_size=5830
2026-01-15 04:17:40.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421860&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 04:17:43.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768421863 status=200 resp_size=4786
2026-01-15 04:17:43.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421863&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 04:17:46.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768421865 status=200 resp_size=6984
2026-01-15 04:17:46.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421866&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-15 04:17:54.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768421874 status=200 resp_size=5432
2026-01-15 04:17:55.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421874&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 04:18:05.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768421884 status=200 resp_size=6066
2026-01-15 04:18:05.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421885&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 04:18:13.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768421892 status=200 resp_size=5541
2026-01-15 04:18:13.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421893&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 04:18:17.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768421897 status=200 resp_size=6058
2026-01-15 04:18:17.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421897&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-15 04:18:23.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job&timestamp=1768421903 status=200 resp_size=5879
2026-01-15 04:18:24.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421903&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 04:18:26.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768421906 status=200 resp_size=5379
2026-01-15 04:18:26.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421906&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 04:18:35.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768421914 status=200 resp_size=5655
2026-01-15 04:18:35.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421915&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 04:18:35.376 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
2026-01-15 04:18:35.658 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:18:35.658 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-15 04:18:37.385 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.72 秒后继续...
2026-01-15 04:18:37.385 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 21/26 页...
2026-01-15 04:18:37.385 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:18:37.416 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:18:38.122 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:18:39.321 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:18:41.483 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:18:41.483 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:18:42.048 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768421917 status=200 resp_size=113762
2026-01-15 04:18:42.048 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:18:42.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768421922 status=200 resp_size=6286
2026-01-15 04:18:42.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421922&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 04:18:51.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job&timestamp=1768421930 status=200 resp_size=5496
2026-01-15 04:18:51.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421931&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 04:18:54.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job&timestamp=1768421934 status=200 resp_size=6106
2026-01-15 04:18:55.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421934&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-15 04:19:00.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768421940 status=200 resp_size=6326
2026-01-15 04:19:01.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421940&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-15 04:19:11.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768421950 status=200 resp_size=5398
2026-01-15 04:19:12.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421951&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 04:19:15.786 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768421955 status=200 resp_size=5294
2026-01-15 04:19:15.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421955&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:19:26.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768421965 status=200 resp_size=5984
2026-01-15 04:19:26.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421966&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-15 04:19:31.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768421970 status=200 resp_size=5662
2026-01-15 04:19:31.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421971&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
2026-01-15 04:19:40.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job&timestamp=1768421979 status=200 resp_size=5835
2026-01-15 04:19:40.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421980&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
2026-01-15 04:19:43.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768421983 status=200 resp_size=6131
2026-01-15 04:19:43.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421983&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-15 04:19:53.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768421992 status=200 resp_size=6112
2026-01-15 04:19:53.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421993&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:19:55.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job&timestamp=1768421995 status=200 resp_size=5951
2026-01-15 04:19:55.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768421995&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 04:20:01.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768422001 status=200 resp_size=6219
2026-01-15 04:20:02.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422001&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-15 04:20:05.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768422005 status=200 resp_size=6039
2026-01-15 04:20:05.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422005&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 04:20:14.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768422013 status=200 resp_size=5675
2026-01-15 04:20:14.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422014&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:20:18.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768422017 status=200 resp_size=5849
2026-01-15 04:20:18.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422018&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 04:20:29.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768422028 status=200 resp_size=5335
2026-01-15 04:20:29.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422029&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:20:32.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768422031 status=200 resp_size=6351
2026-01-15 04:20:32.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422032&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-15 04:20:42.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768422041 status=200 resp_size=6113
2026-01-15 04:20:42.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422042&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 04:20:46.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768422046 status=200 resp_size=5829
2026-01-15 04:20:46.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422046&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 04:20:46.783 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
2026-01-15 04:20:52.388 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:20:52.388 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-15 04:21:00.231 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.83 秒后继续...
2026-01-15 04:21:00.231 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 22/26 页...
2026-01-15 04:21:00.231 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:21:00.257 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:21:01.340 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:21:02.518 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:21:04.669 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:21:04.669 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:21:05.235 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422060 status=200 resp_size=140524
2026-01-15 04:21:05.235 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:21:05.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768422065 status=200 resp_size=6321
2026-01-15 04:21:05.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422065&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:21:10.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768422070 status=200 resp_size=5095
2026-01-15 04:21:10.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422070&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-15 04:21:21.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768422080 status=200 resp_size=6385
2026-01-15 04:21:21.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422081&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 04:21:28.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768422087 status=200 resp_size=5107
2026-01-15 04:21:29.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422088&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-15 04:21:35.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768422094 status=200 resp_size=6497
2026-01-15 04:21:35.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422095&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:21:37.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job&timestamp=1768422096 status=200 resp_size=4774
2026-01-15 04:21:37.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422097&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
2026-01-15 04:21:41.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768422101 status=200 resp_size=6963
2026-01-15 04:21:41.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422101&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 04:21:48.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job&timestamp=1768422107 status=200 resp_size=5463
2026-01-15 04:21:48.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422108&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 04:21:57.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768422117 status=200 resp_size=5473
2026-01-15 04:21:57.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422117&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:22:08.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768422127 status=200 resp_size=5448
2026-01-15 04:22:08.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422128&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 04:22:15.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768422134 status=200 resp_size=7079
2026-01-15 04:22:15.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422135&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 04:22:22.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768422141 status=200 resp_size=6053
2026-01-15 04:22:22.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422142&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 04:22:27.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768422147 status=200 resp_size=6074
2026-01-15 04:22:27.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422147&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:22:31.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job&timestamp=1768422151 status=200 resp_size=5197
2026-01-15 04:22:31.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422151&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:22:35.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768422155 status=200 resp_size=7337
2026-01-15 04:22:35.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422155&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 04:22:38.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768422158 status=200 resp_size=6216
2026-01-15 04:22:38.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422158&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 04:22:42.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job&timestamp=1768422162 status=200 resp_size=5503
2026-01-15 04:22:42.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422162&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:22:44.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768422164 status=200 resp_size=5703
2026-01-15 04:22:44.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422164&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:22:51.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job&timestamp=1768422170 status=200 resp_size=5924
2026-01-15 04:22:51.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422171&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 04:22:56.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768422175 status=200 resp_size=6275
2026-01-15 04:22:56.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422176&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-15 04:22:56.395 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
2026-01-15 04:23:02.507 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:23:02.507 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-15 04:23:11.590 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.08 秒后继续...
2026-01-15 04:23:11.590 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 23/26 页...
2026-01-15 04:23:11.590 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:23:11.617 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:23:12.403 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:23:13.598 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:23:15.769 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:23:15.782 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:23:16.252 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422191 status=200 resp_size=138359
2026-01-15 04:23:16.252 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:23:16.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768422196 status=200 resp_size=5236
2026-01-15 04:23:16.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422196&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:23:27.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768422205 status=200 resp_size=4841
2026-01-15 04:23:27.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422207&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:23:34.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768422214 status=200 resp_size=6316
2026-01-15 04:23:35.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422214&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 04:23:43.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job&timestamp=1768422223 status=200 resp_size=6215
2026-01-15 04:23:44.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422223&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
2026-01-15 04:23:45.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768422225 status=200 resp_size=5321
2026-01-15 04:23:46.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422225&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:23:54.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768422233 status=200 resp_size=5112
2026-01-15 04:23:54.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422234&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:24:01.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768422240 status=200 resp_size=6150
2026-01-15 04:24:01.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422241&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 04:24:11.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768422250 status=200 resp_size=5188
2026-01-15 04:24:11.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422251&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:24:14.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job&timestamp=1768422254 status=200 resp_size=5166
2026-01-15 04:24:14.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422254&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:24:23.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768422262 status=200 resp_size=5373
2026-01-15 04:24:23.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422263&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:24:25.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job&timestamp=1768422265 status=200 resp_size=5148
2026-01-15 04:24:26.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422265&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:24:27.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768422267 status=200 resp_size=4861
2026-01-15 04:24:27.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422267&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:24:35.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768422274 status=200 resp_size=5055
2026-01-15 04:24:35.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422275&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:24:42.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768422281 status=200 resp_size=4962
2026-01-15 04:24:42.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422282&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:24:53.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768422292 status=200 resp_size=4847
2026-01-15 04:24:53.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422293&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:25:01.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768422300 status=200 resp_size=5409
2026-01-15 04:25:01.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422301&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:25:05.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job&timestamp=1768422304 status=200 resp_size=5600
2026-01-15 04:25:05.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422305&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:25:15.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768422314 status=200 resp_size=5570
2026-01-15 04:25:15.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422315&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:25:26.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768422325 status=200 resp_size=5032
2026-01-15 04:25:26.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422326&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:25:28.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768422328 status=200 resp_size=5461
2026-01-15 04:25:28.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422328&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:25:28.923 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
2026-01-15 04:25:29.284 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:25:29.284 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-15 04:25:33.260 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.96 秒后继续...
2026-01-15 04:25:33.260 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 24/26 页...
2026-01-15 04:25:33.260 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:25:33.288 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:25:34.152 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:25:35.362 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:25:37.562 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:25:37.562 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:25:38.080 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422333 status=200 resp_size=131472
2026-01-15 04:25:38.080 | WARNING | __main__:get_recommend_jobs:745 - 第 24 页发现 2 个重复职位(已跳过)
2026-01-15 04:25:38.080 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 18 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:25:38.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768422338 status=200 resp_size=5182
2026-01-15 04:25:38.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422338&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:25:46.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768422345 status=200 resp_size=5200
2026-01-15 04:25:46.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422346&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:25:57.397 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
2026-01-15 04:25:57.397 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
2026-01-15 04:25:57.397 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:25:57.397 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
2026-01-15 04:25:57.397 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:25:58.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768422352 status=200 resp_size=5552
2026-01-15 04:25:58.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422358&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:26:08.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768422368 status=200 resp_size=5207
2026-01-15 04:26:09.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422368&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:26:13.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job&timestamp=1768422373 status=200 resp_size=5489
2026-01-15 04:26:14.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422373&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:26:18.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768422378 status=200 resp_size=5173
2026-01-15 04:26:18.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422378&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:26:23.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768422383 status=200 resp_size=5295
2026-01-15 04:26:24.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422383&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:26:28.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job&timestamp=1768422388 status=200 resp_size=4383
2026-01-15 04:26:28.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422388&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
2026-01-15 04:26:38.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768422397 status=200 resp_size=10634
2026-01-15 04:26:38.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422398&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 04:26:47.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768422406 status=200 resp_size=4990
2026-01-15 04:26:48.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422407&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-15 04:26:50.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768422410 status=200 resp_size=4985
2026-01-15 04:26:50.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422410&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:26:57.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job&timestamp=1768422416 status=200 resp_size=5236
2026-01-15 04:26:57.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422417&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 04:26:58.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768422418 status=200 resp_size=4315
2026-01-15 04:26:58.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422418&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-15 04:27:07.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768422427 status=200 resp_size=7628
2026-01-15 04:27:08.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422427&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 04:27:16.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768422435 status=200 resp_size=4972
2026-01-15 04:27:16.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422436&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:27:21.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768422441 status=200 resp_size=6095
2026-01-15 04:27:21.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422441&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:27:25.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768422445 status=200 resp_size=5147
2026-01-15 04:27:25.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422445&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-15 04:27:30.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768422449 status=200 resp_size=6401
2026-01-15 04:27:30.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422450&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 04:27:30.240 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 18
2026-01-15 04:27:30.492 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-15 04:27:30.492 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-15 04:27:32.246 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.75 秒后继续...
2026-01-15 04:27:32.246 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 25/26 页...
2026-01-15 04:27:32.246 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:27:32.267 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:27:33.051 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:27:34.246 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:27:36.429 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:27:36.429 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:27:36.916 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422452 status=200 resp_size=134250
2026-01-15 04:27:36.947 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:27:37.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768422456 status=200 resp_size=5158
2026-01-15 04:27:37.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422457&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:27:39.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768422459 status=200 resp_size=6101
2026-01-15 04:27:40.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422459&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:27:43.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768422463 status=200 resp_size=4991
2026-01-15 04:27:43.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422463&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-15 04:27:53.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768422472 status=200 resp_size=6793
2026-01-15 04:27:53.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422473&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 04:28:03.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768422482 status=200 resp_size=4978
2026-01-15 04:28:03.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422483&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:28:04.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768422484 status=200 resp_size=6117
2026-01-15 04:28:05.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422484&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:28:06.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job&timestamp=1768422486 status=200 resp_size=5111
2026-01-15 04:28:07.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422486&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:28:11.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job&timestamp=1768422491 status=200 resp_size=4835
2026-01-15 04:28:11.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422491&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 04:28:20.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768422499 status=200 resp_size=5026
2026-01-15 04:28:20.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422500&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:28:29.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768422509 status=200 resp_size=6108
2026-01-15 04:28:30.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422509&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:28:31.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768422511 status=200 resp_size=7131
2026-01-15 04:28:32.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422511&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-15 04:28:38.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768422518 status=200 resp_size=6794
2026-01-15 04:28:39.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422518&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 04:28:43.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768422523 status=200 resp_size=4859
2026-01-15 04:28:43.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422523&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:28:46.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job&timestamp=1768422526 status=200 resp_size=6109
2026-01-15 04:28:47.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422526&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:28:53.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job&timestamp=1768422532 status=200 resp_size=6749
2026-01-15 04:28:53.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422533&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
2026-01-15 04:29:03.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job&timestamp=1768422542 status=200 resp_size=5992
2026-01-15 04:29:03.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422543&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 04:29:06.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768422546 status=200 resp_size=6115
2026-01-15 04:29:06.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422546&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:29:14.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768422554 status=200 resp_size=6544
2026-01-15 04:29:15.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422554&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 04:29:22.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768422562 status=200 resp_size=7105
2026-01-15 04:29:23.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422562&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-15 04:29:29.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768422569 status=200 resp_size=6044
2026-01-15 04:29:30.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422569&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:29:30.143 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
2026-01-15 04:29:36.220 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:29:36.220 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-15 04:29:42.793 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.56 秒后继续...
2026-01-15 04:29:42.793 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 26/26 页...
2026-01-15 04:29:42.793 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:29:42.814 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=惠州, 工作类型=3335
2026-01-15 04:29:43.489 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:29:44.636 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:29:46.805 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:29:46.805 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:29:47.292 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422582 status=200 resp_size=112427
2026-01-15 04:29:47.292 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17 | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
2026-01-15 04:29:47.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768422587 status=200 resp_size=6531
2026-01-15 04:29:47.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422587&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-15 04:29:55.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768422594 status=200 resp_size=4704
2026-01-15 04:29:55.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422595&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-15 04:30:03.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768422602 status=200 resp_size=6427
2026-01-15 04:30:03.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422603&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 04:30:11.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768422610 status=200 resp_size=6107
2026-01-15 04:30:11.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422611&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:30:14.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job&timestamp=1768422613 status=200 resp_size=5737
2026-01-15 04:30:14.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422614&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 04:30:22.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768422621 status=200 resp_size=5499
2026-01-15 04:30:22.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422622&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-15 04:30:24.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768422624 status=200 resp_size=6113
2026-01-15 04:30:24.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422624&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:30:31.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768422631 status=200 resp_size=5880
2026-01-15 04:30:32.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422631&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 04:30:36.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768422636 status=200 resp_size=5139
2026-01-15 04:30:36.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422636&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:30:44.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768422643 status=200 resp_size=5903
2026-01-15 04:30:44.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422644&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-15 04:30:52.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768422652 status=200 resp_size=6107
2026-01-15 04:30:53.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422652&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:31:02.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768422661 status=200 resp_size=5129
2026-01-15 04:31:02.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422662&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 04:31:04.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768422664 status=200 resp_size=5241
2026-01-15 04:31:05.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422664&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:31:11.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768422670 status=200 resp_size=6109
2026-01-15 04:31:11.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422671&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:31:21.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768422681 status=200 resp_size=6111
2026-01-15 04:31:21.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422681&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:31:29.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768422687 status=200 resp_size=6122
2026-01-15 04:31:29.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422689&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 04:31:36.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768422696 status=200 resp_size=5151
2026-01-15 04:31:37.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422696&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:31:37.678 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
2026-01-15 04:31:42.734 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 510 条
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 7 条
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 惠州(惠州)
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 互联网金融(3335)
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 98.65% (510/517)
2026-01-15 04:31:42.734 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(510) < API返回总数(517),可能存在分页问题或数据过滤
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-15 04:31:42.734 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 510 条记录)
2026-01-15 04:31:42.734 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 510 个职位
2026-01-15 04:31:42.734 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-15 04:31:45.196 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:31:45.200 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:31:45.467 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-15 04:31:45.467 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:31:45.499 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:31:46.142 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:31:47.289 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:31:49.645 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:31:49.645 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:31:50.163 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422705 status=200 resp_size=114384
2026-01-15 04:31:50.163 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:31:50.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768422710 status=200 resp_size=5029
2026-01-15 04:31:50.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422710&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 04:31:57.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768422716 status=200 resp_size=5184
2026-01-15 04:31:57.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422717&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 04:32:00.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768422719 status=200 resp_size=5579
2026-01-15 04:32:00.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422720&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 04:32:08.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768422727 status=200 resp_size=5000
2026-01-15 04:32:08.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422728&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-15 04:32:20.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768422738 status=200 resp_size=4954
2026-01-15 04:32:20.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422740&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 04:32:24.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768422743 status=200 resp_size=5630
2026-01-15 04:32:24.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422744&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 04:32:28.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768422748 status=200 resp_size=5546
2026-01-15 04:32:29.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422748&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 04:32:35.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768422754 status=200 resp_size=6579
2026-01-15 04:32:35.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422755&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-15 04:32:37.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job&timestamp=1768422756 status=200 resp_size=5976
2026-01-15 04:32:37.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422757&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 04:32:47.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768422767 status=200 resp_size=5739
2026-01-15 04:32:47.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422767&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-15 04:32:50.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768422770 status=200 resp_size=6192
2026-01-15 04:32:51.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422770&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 04:32:55.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job&timestamp=1768422774 status=200 resp_size=6139
2026-01-15 04:32:55.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422775&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 04:33:05.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768422784 status=200 resp_size=6399
2026-01-15 04:33:05.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422785&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:33:16.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768422795 status=200 resp_size=5813
2026-01-15 04:33:16.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422796&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 04:33:20.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768422799 status=200 resp_size=5890
2026-01-15 04:33:20.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422800&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 04:33:22.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768422802 status=200 resp_size=4892
2026-01-15 04:33:22.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422802&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 04:33:28.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job&timestamp=1768422807 status=200 resp_size=6179
2026-01-15 04:33:28.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422808&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 04:33:29.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768422809 status=200 resp_size=5431
2026-01-15 04:33:30.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422809&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-15 04:33:40.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768422819 status=200 resp_size=6023
2026-01-15 04:33:40.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422820&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 04:33:50.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768422829 status=200 resp_size=6048
2026-01-15 04:33:51.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422830&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 04:33:51.125 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
2026-01-15 04:33:51.388 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:33:51.404 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-15 04:33:51.404 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-15 04:33:54.631 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.23 秒后继续...
2026-01-15 04:33:54.631 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-15 04:33:54.631 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:33:54.657 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:33:55.442 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:33:56.651 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:33:58.850 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:33:58.850 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:33:59.398 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422834 status=200 resp_size=108574
2026-01-15 04:33:59.398 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:33:59.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job&timestamp=1768422839 status=200 resp_size=6137
2026-01-15 04:33:59.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422839&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
2026-01-15 04:34:09.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job&timestamp=1768422847 status=200 resp_size=6192
2026-01-15 04:34:09.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422849&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
2026-01-15 04:34:17.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job&timestamp=1768422856 status=200 resp_size=5754
2026-01-15 04:34:17.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422857&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 04:34:24.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768422863 status=200 resp_size=5721
2026-01-15 04:34:24.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422864&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-15 04:34:29.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768422869 status=200 resp_size=6366
2026-01-15 04:34:30.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422869&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-15 04:34:36.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job&timestamp=1768422875 status=200 resp_size=7534
2026-01-15 04:34:36.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422876&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
2026-01-15 04:34:46.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job&timestamp=1768422886 status=200 resp_size=6787
2026-01-15 04:34:47.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422886&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
2026-01-15 04:34:50.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768422890 status=200 resp_size=5476
2026-01-15 04:34:51.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422890&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-15 04:34:54.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768422894 status=200 resp_size=6423
2026-01-15 04:34:54.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422894&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:35:04.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768422903 status=200 resp_size=5190
2026-01-15 04:35:04.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422904&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-15 04:35:13.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768422912 status=200 resp_size=6134
2026-01-15 04:35:13.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422913&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-15 04:35:17.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768422917 status=200 resp_size=5591
2026-01-15 04:35:17.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422917&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-15 04:35:22.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job&timestamp=1768422922 status=200 resp_size=4321
2026-01-15 04:35:22.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422922&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
2026-01-15 04:35:26.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768422926 status=200 resp_size=5110
2026-01-15 04:35:26.732 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422926&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-15 04:35:36.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768422935 status=200 resp_size=5960
2026-01-15 04:35:36.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422936&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-15 04:35:39.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768422939 status=200 resp_size=5613
2026-01-15 04:35:39.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422939&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:35:42.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job&timestamp=1768422942 status=200 resp_size=5845
2026-01-15 04:36:12.292 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-15 04:36:14.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422942&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:36:17.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768422977 status=200 resp_size=5374
2026-01-15 04:36:18.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422977&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 04:36:22.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768422982 status=200 resp_size=5478
2026-01-15 04:36:22.568 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422982&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 04:36:30.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768422989 status=200 resp_size=5603
2026-01-15 04:36:30.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768422990&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 04:36:30.235 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
2026-01-15 04:36:30.501 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:36:30.501 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-15 04:36:39.953 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.45 秒后继续...
2026-01-15 04:36:39.953 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-15 04:36:39.953 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:36:39.972 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:36:40.648 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:36:41.825 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:36:44.010 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:36:44.010 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:36:44.623 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768422999 status=200 resp_size=113748
2026-01-15 04:36:44.623 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:36:44.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job&timestamp=1768423004 status=200 resp_size=5677
2026-01-15 04:36:45.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423004&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
2026-01-15 04:36:51.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768423011 status=200 resp_size=5694
2026-01-15 04:36:52.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423011&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:36:56.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768423016 status=200 resp_size=5506
2026-01-15 04:36:57.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423016&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 04:37:04.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job&timestamp=1768423022 status=200 resp_size=6076
2026-01-15 04:37:05.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423024&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 04:37:06.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768423026 status=200 resp_size=7499
2026-01-15 04:37:06.908 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423026&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 04:37:17.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768423036 status=200 resp_size=5653
2026-01-15 04:37:17.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423037&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-15 04:37:19.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768423039 status=200 resp_size=5513
2026-01-15 04:37:19.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423039&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-15 04:37:29.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768423048 status=200 resp_size=6285
2026-01-15 04:37:29.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423049&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-15 04:37:35.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768423054 status=200 resp_size=8364
2026-01-15 04:37:35.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423055&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-15 04:37:43.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768423062 status=200 resp_size=5127
2026-01-15 04:37:43.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423063&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-15 04:37:49.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768423069 status=200 resp_size=5182
2026-01-15 04:37:49.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423069&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-15 04:37:56.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768423075 status=200 resp_size=5988
2026-01-15 04:37:56.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423076&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-15 04:37:58.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job&timestamp=1768423078 status=200 resp_size=5632
2026-01-15 04:37:58.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423078&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
2026-01-15 04:38:06.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768423085 status=200 resp_size=5333
2026-01-15 04:38:06.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423086&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:38:14.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768423094 status=200 resp_size=5725
2026-01-15 04:38:15.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423094&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 04:38:22.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768423101 status=200 resp_size=5729
2026-01-15 04:38:22.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423102&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 04:38:24.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768423104 status=200 resp_size=6473
2026-01-15 04:38:24.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423104&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:38:27.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job&timestamp=1768423107 status=200 resp_size=5222
2026-01-15 04:38:27.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423107&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 04:38:30.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768423109 status=200 resp_size=5723
2026-01-15 04:38:30.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423110&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 04:38:37.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768423116 status=200 resp_size=6035
2026-01-15 04:38:37.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423117&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-15 04:38:37.556 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
2026-01-15 04:38:43.236 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:38:43.236 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-15 04:38:45.675 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.43 秒后继续...
2026-01-15 04:38:45.675 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-15 04:38:45.675 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:38:45.703 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:38:46.429 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:38:47.588 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:38:49.788 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:38:49.788 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:38:50.321 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768423125 status=200 resp_size=124670
2026-01-15 04:38:50.321 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:38:50.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768423130 status=200 resp_size=6718
2026-01-15 04:38:50.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423130&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-15 04:38:52.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768423132 status=200 resp_size=5245
2026-01-15 04:38:52.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423132&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 04:39:02.005 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768423141 status=200 resp_size=6651
2026-01-15 04:39:02.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423142&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 04:39:03.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768423143 status=200 resp_size=5833
2026-01-15 04:39:04.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423143&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:39:10.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768423149 status=200 resp_size=6573
2026-01-15 04:39:10.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423150&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 04:39:18.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768423157 status=200 resp_size=6448
2026-01-15 04:39:18.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423158&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 04:39:21.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768423161 status=200 resp_size=6466
2026-01-15 04:39:22.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423161&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 04:39:24.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768423164 status=200 resp_size=5793
2026-01-15 04:39:24.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423164&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:39:28.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768423167 status=200 resp_size=6715
2026-01-15 04:39:28.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423168&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-15 04:39:34.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768423173 status=200 resp_size=5803
2026-01-15 04:39:34.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423174&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 04:39:45.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768423184 status=200 resp_size=5961
2026-01-15 04:39:45.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423185&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:39:53.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768423192 status=200 resp_size=6392
2026-01-15 04:39:53.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423193&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 04:40:01.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job&timestamp=1768423200 status=200 resp_size=6024
2026-01-15 04:40:01.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423201&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:40:11.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768423211 status=200 resp_size=6049
2026-01-15 04:40:11.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423211&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:40:20.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768423220 status=200 resp_size=6511
2026-01-15 04:40:21.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423220&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 04:40:23.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768423222 status=200 resp_size=5940
2026-01-15 04:40:23.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423223&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:40:31.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768423231 status=200 resp_size=5699
2026-01-15 04:40:32.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423231&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 04:40:38.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768423237 status=200 resp_size=4058
2026-01-15 04:40:38.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423238&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-15 04:40:47.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768423246 status=200 resp_size=5232
2026-01-15 04:40:47.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423247&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:40:49.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768423249 status=200 resp_size=6177
2026-01-15 04:40:49.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423249&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 04:40:49.903 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
2026-01-15 04:40:50.313 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:40:50.313 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-15 04:40:53.495 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.17 秒后继续...
2026-01-15 04:40:53.495 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-15 04:40:53.495 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:40:53.517 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:40:54.167 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:40:55.329 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:40:57.474 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:40:57.474 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:40:57.977 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768423253 status=200 resp_size=127911
2026-01-15 04:40:57.992 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:40:58.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job&timestamp=1768423257 status=200 resp_size=5857
2026-01-15 04:40:58.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423258&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
2026-01-15 04:41:07.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768423266 status=200 resp_size=5634
2026-01-15 04:41:07.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423267&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:41:16.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768423276 status=200 resp_size=6125
2026-01-15 04:41:17.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423276&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 04:41:24.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768423283 status=200 resp_size=5888
2026-01-15 04:41:24.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423284&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 04:41:27.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768423287 status=200 resp_size=5942
2026-01-15 04:41:27.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423287&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 04:41:33.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768423293 status=200 resp_size=6055
2026-01-15 04:41:33.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423293&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 04:41:40.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768423299 status=200 resp_size=5455
2026-01-15 04:41:40.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423300&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 04:41:42.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768423302 status=200 resp_size=6314
2026-01-15 04:41:42.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423302&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
2026-01-15 04:41:46.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768423306 status=200 resp_size=5687
2026-01-15 04:41:47.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423306&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:41:57.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768423316 status=200 resp_size=5638
2026-01-15 04:41:57.453 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423317&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 04:42:00.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job&timestamp=1768423319 status=200 resp_size=8574
2026-01-15 04:42:00.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423320&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 04:42:10.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768423329 status=200 resp_size=7551
2026-01-15 04:42:10.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423330&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-15 04:42:12.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768423331 status=200 resp_size=5784
2026-01-15 04:42:12.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423332&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 04:42:22.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768423341 status=200 resp_size=6552
2026-01-15 04:42:22.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423342&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:42:26.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768423346 status=200 resp_size=5306
2026-01-15 04:42:26.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423346&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-15 04:42:31.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768423351 status=200 resp_size=7182
2026-01-15 04:42:31.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423351&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-15 04:42:33.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job&timestamp=1768423352 status=200 resp_size=5407
2026-01-15 04:42:33.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423353&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
2026-01-15 04:42:35.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768423354 status=200 resp_size=5497
2026-01-15 04:42:35.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423355&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:42:42.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job&timestamp=1768423361 status=200 resp_size=6343
2026-01-15 04:42:42.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423362&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
2026-01-15 04:42:50.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768423369 status=200 resp_size=5655
2026-01-15 04:42:50.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423370&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 04:42:50.646 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
2026-01-15 04:42:56.865 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:42:56.865 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-15 04:43:03.393 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.52 秒后继续...
2026-01-15 04:43:03.393 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-15 04:43:03.393 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:43:03.413 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:43:04.167 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:43:05.346 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:43:07.514 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:43:07.514 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:43:08.032 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768423383 status=200 resp_size=146035
2026-01-15 04:43:08.032 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:43:08.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768423388 status=200 resp_size=8235
2026-01-15 04:43:08.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423388&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-15 04:43:10.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768423390 status=200 resp_size=6689
2026-01-15 04:43:11.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423390&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:43:15.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768423395 status=200 resp_size=7119
2026-01-15 04:43:16.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423395&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 04:43:24.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768423403 status=200 resp_size=5615
2026-01-15 04:43:24.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423404&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 04:43:34.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768423413 status=200 resp_size=6714
2026-01-15 04:43:34.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423414&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 04:43:39.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job&timestamp=1768423419 status=200 resp_size=6390
2026-01-15 04:43:40.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423419&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:43:46.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768423425 status=200 resp_size=5775
2026-01-15 04:43:47.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423426&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-15 04:43:49.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768423429 status=200 resp_size=6696
2026-01-15 04:43:49.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423429&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-15 04:43:55.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768423434 status=200 resp_size=13102
2026-01-15 04:43:55.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423435&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 04:44:01.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768423440 status=200 resp_size=6230
2026-01-15 04:44:01.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423441&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:44:09.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768423448 status=200 resp_size=5128
2026-01-15 04:44:09.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423449&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 04:44:19.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job&timestamp=1768423458 status=200 resp_size=6362
2026-01-15 04:44:19.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423459&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 04:44:27.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768423466 status=200 resp_size=6527
2026-01-15 04:44:27.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423467&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 04:44:32.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768423471 status=200 resp_size=8808
2026-01-15 04:44:32.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423472&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:44:38.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job&timestamp=1768423478 status=200 resp_size=7130
2026-01-15 04:44:38.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423478&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 04:44:48.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768423487 status=200 resp_size=7415
2026-01-15 04:44:48.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423488&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
2026-01-15 04:44:50.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job&timestamp=1768423490 status=200 resp_size=5152
2026-01-15 04:44:50.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423490&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
2026-01-15 04:44:59.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job&timestamp=1768423498 status=200 resp_size=5920
2026-01-15 04:44:59.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423499&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:45:02.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768423502 status=200 resp_size=5877
2026-01-15 04:45:02.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423502&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
2026-01-15 04:45:05.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768423505 status=200 resp_size=5098
2026-01-15 04:45:05.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423505&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 04:45:05.586 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
2026-01-15 04:45:12.154 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:45:12.154 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-15 04:45:16.957 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.79 秒后继续...
2026-01-15 04:45:16.957 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-15 04:45:16.957 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:45:16.976 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:45:17.730 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:45:18.907 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:45:21.088 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:45:21.088 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:45:21.638 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768423516 status=200 resp_size=147497
2026-01-15 04:45:21.638 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:45:21.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768423521 status=200 resp_size=6970
2026-01-15 04:45:22.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423521&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 04:45:30.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768423529 status=200 resp_size=6445
2026-01-15 04:45:31.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423530&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:45:34.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job&timestamp=1768423534 status=200 resp_size=7717
2026-01-15 04:45:35.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423534&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
2026-01-15 04:45:42.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768423541 status=200 resp_size=5109
2026-01-15 04:45:42.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423542&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 04:45:51.773 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job&timestamp=1768423550 status=200 resp_size=8734
2026-01-15 04:45:51.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423551&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
2026-01-15 04:45:54.773 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768423554 status=200 resp_size=6501
2026-01-15 04:45:54.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423554&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:45:56.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job&timestamp=1768423556 status=200 resp_size=5533
2026-01-15 04:45:56.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423556&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
2026-01-15 04:46:04.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job&timestamp=1768423563 status=200 resp_size=5524
2026-01-15 04:46:04.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423564&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
2026-01-15 04:46:07.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768423567 status=200 resp_size=6522
2026-01-15 04:46:08.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423567&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 04:46:16.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768423575 status=200 resp_size=5756
2026-01-15 04:46:16.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423576&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:46:26.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768423585 status=200 resp_size=7756
2026-01-15 04:46:26.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423586&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 04:46:32.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768423591 status=200 resp_size=6318
2026-01-15 04:46:32.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423592&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-15 04:46:41.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job&timestamp=1768423600 status=200 resp_size=7311
2026-01-15 04:46:41.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423601&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
2026-01-15 04:46:48.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job&timestamp=1768423607 status=200 resp_size=5678
2026-01-15 04:46:48.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423608&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:46:51.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job&timestamp=1768423611 status=200 resp_size=5458
2026-01-15 04:46:51.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423611&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
2026-01-15 04:47:00.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job&timestamp=1768423619 status=200 resp_size=7237
2026-01-15 04:47:00.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423620&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
2026-01-15 04:47:03.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768423623 status=200 resp_size=5342
2026-01-15 04:47:04.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423623&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-15 04:47:14.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768423633 status=200 resp_size=8457
2026-01-15 04:47:14.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423634&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:47:22.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job&timestamp=1768423641 status=200 resp_size=6431
2026-01-15 04:47:22.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423642&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
2026-01-15 04:47:30.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job&timestamp=1768423650 status=200 resp_size=6416
2026-01-15 04:47:30.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423650&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 04:47:30.994 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
2026-01-15 04:47:37.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:47:37.354 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-15 04:47:43.671 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.31 秒后继续...
2026-01-15 04:47:43.671 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-15 04:47:43.671 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:47:43.698 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:47:44.491 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:47:45.678 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:47:47.876 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:47:47.876 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:47:48.425 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768423663 status=200 resp_size=151950
2026-01-15 04:47:48.425 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:47:48.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job&timestamp=1768423668 status=200 resp_size=5876
2026-01-15 04:47:48.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423668&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 04:47:52.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768423672 status=200 resp_size=5974
2026-01-15 04:47:52.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423672&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:48:03.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job&timestamp=1768423682 status=200 resp_size=6646
2026-01-15 04:48:03.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423683&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
2026-01-15 04:48:11.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768423690 status=200 resp_size=6958
2026-01-15 04:48:11.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423691&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:48:13.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768423693 status=200 resp_size=5506
2026-01-15 04:48:13.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423693&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-15 04:48:18.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768423698 status=200 resp_size=6449
2026-01-15 04:48:18.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423698&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-15 04:48:26.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768423705 status=200 resp_size=6015
2026-01-15 04:48:26.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423706&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-15 04:48:29.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768423709 status=200 resp_size=6511
2026-01-15 04:48:29.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423709&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:48:38.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768423717 status=200 resp_size=5925
2026-01-15 04:48:38.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423718&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
2026-01-15 04:48:44.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768423724 status=200 resp_size=7750
2026-01-15 04:48:45.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423724&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 04:48:55.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768423734 status=200 resp_size=7971
2026-01-15 04:48:55.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423735&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 04:49:02.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768423741 status=200 resp_size=6119
2026-01-15 04:49:02.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423742&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:49:03.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768423743 status=200 resp_size=8313
2026-01-15 04:49:04.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423743&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-15 04:49:09.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job&timestamp=1768423748 status=200 resp_size=5424
2026-01-15 04:49:09.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423749&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
2026-01-15 04:49:10.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job&timestamp=1768423750 status=200 resp_size=8274
2026-01-15 04:49:10.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423750&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
2026-01-15 04:49:21.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768423760 status=200 resp_size=6058
2026-01-15 04:49:21.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423761&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:49:26.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768423766 status=200 resp_size=8701
2026-01-15 04:49:26.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423766&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-15 04:49:32.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768423771 status=200 resp_size=5211
2026-01-15 04:49:33.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423772&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
2026-01-15 04:49:41.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job&timestamp=1768423780 status=200 resp_size=5378
2026-01-15 04:49:41.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423781&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
2026-01-15 04:49:46.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768423785 status=200 resp_size=6284
2026-01-15 04:49:46.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423786&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:49:46.488 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
2026-01-15 04:49:53.183 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:49:53.183 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-15 04:49:55.924 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.73 秒后继续...
2026-01-15 04:49:55.924 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-15 04:49:55.924 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:49:55.945 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:49:56.683 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:49:57.860 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:50:00.043 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:50:00.043 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:50:00.546 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768423795 status=200 resp_size=150966
2026-01-15 04:50:00.546 | WARNING | __main__:get_recommend_jobs:745 - 第 9 页发现 1 个重复职位(已跳过)
2026-01-15 04:50:00.546 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:50:00.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768423800 status=200 resp_size=7299
2026-01-15 04:50:00.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423800&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-15 04:50:10.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job&timestamp=1768423809 status=200 resp_size=7262
2026-01-15 04:50:10.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423810&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 04:50:14.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768423813 status=200 resp_size=6254
2026-01-15 04:50:14.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423814&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:50:16.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job&timestamp=1768423815 status=200 resp_size=7967
2026-01-15 04:50:16.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423816&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
2026-01-15 04:50:18.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768423817 status=200 resp_size=5253
2026-01-15 04:50:18.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423818&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 04:50:22.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768423821 status=200 resp_size=5431
2026-01-15 04:50:22.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423822&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 04:50:26.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768423825 status=200 resp_size=4995
2026-01-15 04:50:26.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423826&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:50:32.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768423831 status=200 resp_size=6080
2026-01-15 04:50:32.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423832&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 04:50:37.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768423837 status=200 resp_size=5936
2026-01-15 04:50:37.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423837&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-15 04:50:40.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768423839 status=200 resp_size=6041
2026-01-15 04:50:40.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423840&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-15 04:50:46.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768423845 status=200 resp_size=4916
2026-01-15 04:50:47.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423846&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 04:50:53.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768423852 status=200 resp_size=5446
2026-01-15 04:50:53.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423853&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-15 04:50:55.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768423855 status=200 resp_size=6494
2026-01-15 04:50:55.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423855&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
2026-01-15 04:51:03.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768423862 status=200 resp_size=5860
2026-01-15 04:51:04.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423863&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:51:13.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768423872 status=200 resp_size=6226
2026-01-15 04:51:13.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423873&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-15 04:51:18.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job&timestamp=1768423878 status=200 resp_size=5613
2026-01-15 04:51:19.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423878&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 04:51:21.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768423881 status=200 resp_size=6422
2026-01-15 04:51:22.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423881&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-15 04:51:30.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768423889 status=200 resp_size=5792
2026-01-15 04:51:30.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423890&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:51:37.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768423896 status=200 resp_size=6176
2026-01-15 04:51:37.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423897&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-15 04:51:37.393 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 19
2026-01-15 04:51:43.581 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 04:51:43.581 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-15 04:51:46.974 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.39 秒后继续...
2026-01-15 04:51:46.974 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-15 04:51:46.974 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:51:46.989 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:51:47.633 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:51:48.779 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:51:50.915 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:51:50.915 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:51:51.465 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768423906 status=200 resp_size=147503
2026-01-15 04:51:51.465 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 1 个重复职位(已跳过)
2026-01-15 04:51:51.465 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:51:51.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job&timestamp=1768423911 status=200 resp_size=7607
2026-01-15 04:51:51.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423911&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 04:52:00.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job&timestamp=1768423919 status=200 resp_size=6731
2026-01-15 04:52:00.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423920&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 04:52:07.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job&timestamp=1768423926 status=200 resp_size=5575
2026-01-15 04:52:07.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423927&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 04:52:15.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768423934 status=200 resp_size=5711
2026-01-15 04:52:16.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423935&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 04:52:21.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768423940 status=200 resp_size=6856
2026-01-15 04:52:21.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423941&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
2026-01-15 04:52:27.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768423946 status=200 resp_size=5731
2026-01-15 04:52:27.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423947&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-15 04:52:33.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768423953 status=200 resp_size=7075
2026-01-15 04:52:33.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423953&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 04:52:36.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768423956 status=200 resp_size=6768
2026-01-15 04:52:36.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423956&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:52:41.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768423961 status=200 resp_size=6530
2026-01-15 04:52:41.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423961&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:52:46.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768423966 status=200 resp_size=8973
2026-01-15 04:52:46.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423966&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
2026-01-15 04:52:48.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job&timestamp=1768423968 status=200 resp_size=6315
2026-01-15 04:52:48.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423968&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
2026-01-15 04:52:56.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768423975 status=200 resp_size=8559
2026-01-15 04:52:56.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423976&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
2026-01-15 04:53:03.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768423983 status=200 resp_size=6688
2026-01-15 04:53:04.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423983&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-15 04:53:12.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768423991 status=200 resp_size=5290
2026-01-15 04:53:12.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423992&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 04:53:16.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768423996 status=200 resp_size=5982
2026-01-15 04:53:16.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423996&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-15 04:53:19.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job&timestamp=1768423999 status=200 resp_size=7919
2026-01-15 04:53:19.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768423999&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
2026-01-15 04:53:24.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job&timestamp=1768424004 status=200 resp_size=7681
2026-01-15 04:53:24.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424004&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
2026-01-15 04:53:33.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768424013 status=200 resp_size=5271
2026-01-15 04:53:33.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424013&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 04:53:41.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job&timestamp=1768424021 status=200 resp_size=7124
2026-01-15 04:53:42.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424021&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:53:42.136 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 19
2026-01-15 04:53:48.119 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 04:53:48.119 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-15 04:53:51.245 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.12 秒后继续...
2026-01-15 04:53:51.245 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-15 04:53:51.245 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:53:51.261 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:53:53.285 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:53:54.448 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:53:56.615 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:53:56.615 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:53:57.144 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424031 status=200 resp_size=129568
2026-01-15 04:53:57.144 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:53:57.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768424037 status=200 resp_size=5686
2026-01-15 04:53:57.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424037&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
2026-01-15 04:54:04.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job&timestamp=1768424043 status=200 resp_size=6660
2026-01-15 04:54:04.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424044&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 04:54:08.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job&timestamp=1768424048 status=200 resp_size=7952
2026-01-15 04:54:08.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424048&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
2026-01-15 04:54:11.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job&timestamp=1768424051 status=200 resp_size=5414
2026-01-15 04:54:11.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424051&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:54:19.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768424058 status=200 resp_size=5277
2026-01-15 04:54:19.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424059&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-15 04:54:29.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768424068 status=200 resp_size=7175
2026-01-15 04:54:29.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424069&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-15 04:54:39.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768424078 status=200 resp_size=6284
2026-01-15 04:54:39.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424079&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:54:48.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768424087 status=200 resp_size=5673
2026-01-15 04:54:48.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424088&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-15 04:54:52.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768424091 status=200 resp_size=6168
2026-01-15 04:54:52.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424092&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 04:54:59.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job&timestamp=1768424098 status=200 resp_size=5943
2026-01-15 04:54:59.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424099&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
2026-01-15 04:55:05.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768424104 status=200 resp_size=5924
2026-01-15 04:55:05.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424105&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-15 04:55:13.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768424112 status=200 resp_size=6003
2026-01-15 04:55:13.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424113&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-15 04:55:15.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768424115 status=200 resp_size=5378
2026-01-15 04:55:15.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424115&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-15 04:55:18.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768424118 status=200 resp_size=5084
2026-01-15 04:55:19.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424118&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 04:55:21.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768424121 status=200 resp_size=4913
2026-01-15 04:55:21.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424121&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 04:55:26.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768424125 status=200 resp_size=9486
2026-01-15 04:55:26.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424126&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 04:55:30.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768424130 status=200 resp_size=5363
2026-01-15 04:55:30.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424130&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-15 04:55:38.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job&timestamp=1768424137 status=200 resp_size=13285
2026-01-15 04:55:38.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424138&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 04:55:46.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768424146 status=200 resp_size=6873
2026-01-15 04:55:46.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424146&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:55:56.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job&timestamp=1768424155 status=200 resp_size=6041
2026-01-15 04:55:56.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424156&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
2026-01-15 04:55:56.508 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 20
2026-01-15 04:55:56.913 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:55:56.913 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-15 04:56:02.849 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.93 秒后继续...
2026-01-15 04:56:02.850 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-15 04:56:02.850 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:56:02.866 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:56:03.368 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:56:04.533 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:56:06.667 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:56:06.667 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:56:07.107 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424162 status=200 resp_size=129499
2026-01-15 04:56:07.122 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:56:07.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job&timestamp=1768424167 status=200 resp_size=6635
2026-01-15 04:56:07.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424167&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
2026-01-15 04:56:11.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job&timestamp=1768424171 status=200 resp_size=6205
2026-01-15 04:56:13.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424171&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
2026-01-15 04:56:22.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768424181 status=200 resp_size=5390
2026-01-15 04:56:22.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424182&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-15 04:56:31.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job&timestamp=1768424190 status=200 resp_size=8070
2026-01-15 04:56:31.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424191&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 04:56:40.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768424199 status=200 resp_size=6588
2026-01-15 04:56:40.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424200&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 04:56:45.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job&timestamp=1768424205 status=200 resp_size=6300
2026-01-15 04:56:45.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424205&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
2026-01-15 04:56:51.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768424210 status=200 resp_size=7194
2026-01-15 04:56:51.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424211&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 04:56:55.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768424215 status=200 resp_size=6053
2026-01-15 04:56:55.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424215&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 04:57:03.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768424223 status=200 resp_size=7170
2026-01-15 04:57:04.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424223&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 04:57:11.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768424230 status=200 resp_size=4992
2026-01-15 04:57:11.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424231&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-15 04:57:20.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768424239 status=200 resp_size=6073
2026-01-15 04:57:20.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424240&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:57:28.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768424248 status=200 resp_size=7194
2026-01-15 04:57:29.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424248&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-15 04:57:31.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768424251 status=200 resp_size=6770
2026-01-15 04:57:31.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424251&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 04:57:34.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768424254 status=200 resp_size=5344
2026-01-15 04:57:34.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424254&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 04:57:42.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768424261 status=200 resp_size=5554
2026-01-15 04:57:42.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424262&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:57:52.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768424272 status=200 resp_size=5280
2026-01-15 04:57:53.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424272&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 04:57:54.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768424274 status=200 resp_size=5040
2026-01-15 04:57:54.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424274&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-15 04:57:57.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768424277 status=200 resp_size=4993
2026-01-15 04:57:57.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424277&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 04:57:59.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768424279 status=200 resp_size=6752
2026-01-15 04:58:00.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424279&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:58:03.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768424283 status=200 resp_size=5883
2026-01-15 04:58:03.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424283&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-15 04:58:03.914 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
2026-01-15 04:58:09.917 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 04:58:09.917 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-15 04:58:16.853 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.92 秒后继续...
2026-01-15 04:58:16.853 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-15 04:58:16.853 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 04:58:16.876 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 04:58:17.442 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:58:18.573 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:58:20.756 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 04:58:20.756 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 04:58:21.337 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424296 status=200 resp_size=142962
2026-01-15 04:58:21.337 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 04:58:21.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768424301 status=200 resp_size=5688
2026-01-15 04:58:21.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424301&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 04:58:23.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768424303 status=200 resp_size=6980
2026-01-15 04:58:23.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424303&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 04:58:30.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768424310 status=200 resp_size=6794
2026-01-15 04:58:31.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424310&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 04:58:32.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768424312 status=200 resp_size=5283
2026-01-15 04:58:32.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424312&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 04:58:37.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768424317 status=200 resp_size=5215
2026-01-15 04:58:37.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424317&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-15 04:58:44.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768424323 status=200 resp_size=5764
2026-01-15 04:58:44.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424324&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 04:58:51.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768424330 status=200 resp_size=5516
2026-01-15 04:58:51.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424331&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-15 04:58:59.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768424338 status=200 resp_size=6659
2026-01-15 04:58:59.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424339&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 04:59:10.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job&timestamp=1768424349 status=200 resp_size=5165
2026-01-15 04:59:10.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424350&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
2026-01-15 04:59:16.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768424356 status=200 resp_size=6856
2026-01-15 04:59:17.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424356&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 04:59:21.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job&timestamp=1768424361 status=200 resp_size=5570
2026-01-15 04:59:21.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424361&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
2026-01-15 04:59:26.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job&timestamp=1768424366 status=200 resp_size=6749
2026-01-15 04:59:26.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424366&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
2026-01-15 04:59:29.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768424369 status=200 resp_size=5688
2026-01-15 04:59:30.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424369&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
2026-01-15 04:59:32.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768424372 status=200 resp_size=6380
2026-01-15 04:59:32.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424372&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 04:59:36.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job&timestamp=1768424376 status=200 resp_size=7975
2026-01-15 04:59:36.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424376&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
2026-01-15 04:59:46.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job&timestamp=1768424385 status=200 resp_size=5984
2026-01-15 04:59:46.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424386&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 04:59:57.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768424395 status=200 resp_size=7270
2026-01-15 04:59:57.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424397&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 05:00:00.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job&timestamp=1768424400 status=200 resp_size=5582
2026-01-15 05:00:00.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424400&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 05:00:09.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job&timestamp=1768424408 status=200 resp_size=5924
2026-01-15 05:00:09.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424409&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
2026-01-15 05:00:12.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job&timestamp=1768424410 status=200 resp_size=6027
2026-01-15 05:00:12.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424412&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
2026-01-15 05:00:12.258 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
2026-01-15 05:00:22.618 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:00:22.618 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-15 05:00:28.554 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.93 秒后继续...
2026-01-15 05:00:28.554 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-15 05:00:28.554 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:00:28.577 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:00:29.127 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:00:30.260 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:00:32.382 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:00:32.382 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:00:32.853 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424428 status=200 resp_size=163507
2026-01-15 05:00:32.853 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:00:33.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job&timestamp=1768424432 status=200 resp_size=6028
2026-01-15 05:00:33.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424433&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 05:00:39.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job&timestamp=1768424438 status=200 resp_size=4774
2026-01-15 05:00:39.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424439&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
2026-01-15 05:00:47.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768424444 status=200 resp_size=8782
2026-01-15 05:00:49.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424447&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 05:00:51.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768424451 status=200 resp_size=8655
2026-01-15 05:00:51.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424451&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-15 05:00:52.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768424452 status=200 resp_size=6935
2026-01-15 05:00:52.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424452&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-15 05:00:55.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job&timestamp=1768424455 status=200 resp_size=6440
2026-01-15 05:00:55.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424455&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
2026-01-15 05:01:04.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768424463 status=200 resp_size=7907
2026-01-15 05:01:04.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424464&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-15 05:01:07.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job&timestamp=1768424467 status=200 resp_size=4592
2026-01-15 05:01:07.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424467&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
2026-01-15 05:01:10.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768424470 status=200 resp_size=5878
2026-01-15 05:01:11.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424470&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 05:01:17.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job&timestamp=1768424476 status=200 resp_size=6437
2026-01-15 05:01:18.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424477&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 05:01:26.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768424486 status=200 resp_size=5672
2026-01-15 05:01:26.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424486&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-15 05:01:30.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job&timestamp=1768424489 status=200 resp_size=5463
2026-01-15 05:01:30.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424490&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 05:01:37.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768424497 status=200 resp_size=5448
2026-01-15 05:01:37.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424497&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 05:01:46.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768424505 status=200 resp_size=9108
2026-01-15 05:01:46.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424506&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-15 05:01:55.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768424513 status=200 resp_size=6111
2026-01-15 05:01:55.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424515&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
2026-01-15 05:02:03.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job&timestamp=1768424523 status=200 resp_size=6612
2026-01-15 05:02:04.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424523&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
2026-01-15 05:02:11.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768424529 status=200 resp_size=7313
2026-01-15 05:02:12.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424531&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-15 05:02:21.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job&timestamp=1768424540 status=200 resp_size=6958
2026-01-15 05:02:21.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424541&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
2026-01-15 05:02:29.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768424548 status=200 resp_size=6694
2026-01-15 05:02:32.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424549&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
2026-01-15 05:02:40.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768424559 status=200 resp_size=6568
2026-01-15 05:02:40.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424560&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-15 05:02:40.541 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
2026-01-15 05:02:47.074 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:02:47.074 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-15 05:02:52.120 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.03 秒后继续...
2026-01-15 05:02:52.120 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-15 05:02:52.120 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:02:52.147 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:02:52.696 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:02:53.828 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:02:55.948 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:02:55.948 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:02:56.403 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424572 status=200 resp_size=128123
2026-01-15 05:02:56.403 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:02:56.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768424576 status=200 resp_size=5922
2026-01-15 05:02:56.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424576&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 05:03:03.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job&timestamp=1768424582 status=200 resp_size=5499
2026-01-15 05:03:03.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424583&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
2026-01-15 05:03:10.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768424589 status=200 resp_size=6184
2026-01-15 05:03:10.568 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424590&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-15 05:03:15.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768424594 status=200 resp_size=5673
2026-01-15 05:03:15.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424595&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-15 05:03:18.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768424598 status=200 resp_size=7081
2026-01-15 05:03:18.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424598&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 05:03:26.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768424605 status=200 resp_size=7664
2026-01-15 05:03:26.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424606&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 05:03:28.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768424608 status=200 resp_size=6652
2026-01-15 05:03:28.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424608&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-15 05:03:33.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768424613 status=200 resp_size=4733
2026-01-15 05:03:34.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424613&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 05:03:45.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768424623 status=200 resp_size=4926
2026-01-15 05:03:45.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424625&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 05:03:51.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768424631 status=200 resp_size=4906
2026-01-15 05:03:51.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424631&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 05:03:56.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job&timestamp=1768424636 status=200 resp_size=7369
2026-01-15 05:03:56.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424636&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 05:04:00.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768424640 status=200 resp_size=4834
2026-01-15 05:04:00.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424640&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 05:04:05.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768424645 status=200 resp_size=5006
2026-01-15 05:04:05.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424645&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-15 05:04:09.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768424647 status=200 resp_size=5363
2026-01-15 05:04:09.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424649&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-15 05:04:16.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768424656 status=200 resp_size=5232
2026-01-15 05:04:17.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424656&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-15 05:04:21.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job&timestamp=1768424661 status=200 resp_size=6946
2026-01-15 05:04:21.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424661&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
2026-01-15 05:04:26.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768424666 status=200 resp_size=4956
2026-01-15 05:04:26.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424666&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:04:30.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768424669 status=200 resp_size=7382
2026-01-15 05:04:30.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424670&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 05:04:33.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768424673 status=200 resp_size=7331
2026-01-15 05:04:33.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424673&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 05:04:37.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job&timestamp=1768424677 status=200 resp_size=6551
2026-01-15 05:04:37.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424677&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
2026-01-15 05:04:37.977 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
2026-01-15 05:04:43.770 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:04:43.770 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-15 05:04:47.917 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.13 秒后继续...
2026-01-15 05:04:47.917 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 16/26 页...
2026-01-15 05:04:47.917 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:04:47.948 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:04:48.528 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:04:49.674 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:04:51.810 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:04:51.810 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:04:52.336 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424687 status=200 resp_size=136175
2026-01-15 05:04:52.336 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:04:52.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768424692 status=200 resp_size=4515
2026-01-15 05:04:52.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424692&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-15 05:05:01.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768424699 status=200 resp_size=4865
2026-01-15 05:05:02.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424701&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-15 05:05:11.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768424710 status=200 resp_size=5241
2026-01-15 05:05:11.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424711&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-15 05:05:15.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job&timestamp=1768424714 status=200 resp_size=5494
2026-01-15 05:05:15.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424715&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 05:05:16.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job&timestamp=1768424716 status=200 resp_size=5087
2026-01-15 05:05:17.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424716&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
2026-01-15 05:05:21.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768424720 status=200 resp_size=6572
2026-01-15 05:05:21.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424721&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-15 05:05:24.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job&timestamp=1768424724 status=200 resp_size=6576
2026-01-15 05:05:25.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424724&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 05:05:28.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768424728 status=200 resp_size=5674
2026-01-15 05:05:28.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424728&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 05:05:35.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768424734 status=200 resp_size=6139
2026-01-15 05:05:35.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424735&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-15 05:05:40.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768424740 status=200 resp_size=5471
2026-01-15 05:05:40.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424740&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 05:05:50.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768424750 status=200 resp_size=5725
2026-01-15 05:05:51.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424750&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-15 05:05:56.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job&timestamp=1768424756 status=200 resp_size=4737
2026-01-15 05:05:56.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424756&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 05:06:06.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job&timestamp=1768424766 status=200 resp_size=4297
2026-01-15 05:06:06.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424766&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
2026-01-15 05:06:15.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job&timestamp=1768424774 status=200 resp_size=5259
2026-01-15 05:06:15.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424775&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
2026-01-15 05:06:21.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768424781 status=200 resp_size=4786
2026-01-15 05:06:21.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424781&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 05:06:30.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768424789 status=200 resp_size=5746
2026-01-15 05:06:30.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424790&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 05:06:36.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768424795 status=200 resp_size=5466
2026-01-15 05:06:36.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424796&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 05:06:46.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job&timestamp=1768424805 status=200 resp_size=5037
2026-01-15 05:06:46.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424806&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 05:06:53.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job&timestamp=1768424811 status=200 resp_size=5631
2026-01-15 05:06:54.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424813&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 05:06:59.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job&timestamp=1768424819 status=200 resp_size=5979
2026-01-15 05:07:00.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424819&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
2026-01-15 05:07:00.138 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
2026-01-15 05:07:06.013 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:07:06.028 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-15 05:07:07.657 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.63 秒后继续...
2026-01-15 05:07:07.657 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 17/26 页...
2026-01-15 05:07:07.657 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:07:07.676 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:07:08.304 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:07:09.767 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:07:11.980 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:07:11.980 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:07:12.577 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424827 status=200 resp_size=132460
2026-01-15 05:07:12.577 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:07:12.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768424832 status=200 resp_size=6291
2026-01-15 05:07:13.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424832&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-15 05:07:18.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job&timestamp=1768424837 status=200 resp_size=4425
2026-01-15 05:07:18.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424838&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 05:07:25.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768424844 status=200 resp_size=5928
2026-01-15 05:07:25.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424845&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 05:07:28.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768424847 status=200 resp_size=5973
2026-01-15 05:07:28.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424848&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-15 05:07:37.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768424856 status=200 resp_size=4719
2026-01-15 05:07:37.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424857&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-15 05:07:39.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768424859 status=200 resp_size=6295
2026-01-15 05:07:40.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424859&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-15 05:07:42.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job&timestamp=1768424861 status=200 resp_size=5806
2026-01-15 05:07:42.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424862&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 05:07:52.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768424872 status=200 resp_size=5174
2026-01-15 05:07:52.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424872&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-15 05:07:59.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768424878 status=200 resp_size=6666
2026-01-15 05:07:59.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424879&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 05:08:02.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768424882 status=200 resp_size=4654
2026-01-15 05:08:02.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424882&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-15 05:08:12.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768424891 status=200 resp_size=7248
2026-01-15 05:08:12.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424892&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 05:08:21.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job&timestamp=1768424901 status=200 resp_size=6546
2026-01-15 05:08:22.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424901&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
2026-01-15 05:08:25.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768424905 status=200 resp_size=6546
2026-01-15 05:08:25.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424905&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-15 05:08:33.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job&timestamp=1768424912 status=200 resp_size=4679
2026-01-15 05:08:33.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424913&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-15 05:08:36.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768424915 status=200 resp_size=4783
2026-01-15 05:08:36.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424916&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-15 05:08:41.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768424921 status=200 resp_size=5359
2026-01-15 05:08:42.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424921&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:08:46.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768424926 status=200 resp_size=6326
2026-01-15 05:08:47.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424926&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 05:08:57.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job&timestamp=1768424936 status=200 resp_size=5325
2026-01-15 05:08:57.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424937&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
2026-01-15 05:09:04.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768424943 status=200 resp_size=5106
2026-01-15 05:09:05.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424944&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
2026-01-15 05:09:11.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job&timestamp=1768424949 status=200 resp_size=4572
2026-01-15 05:09:11.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424951&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
2026-01-15 05:09:11.482 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
2026-01-15 05:09:21.300 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:09:21.316 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-15 05:09:27.357 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.04 秒后继续...
2026-01-15 05:09:27.357 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 18/26 页...
2026-01-15 05:09:27.357 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:09:27.386 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:09:27.959 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:09:29.105 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:09:31.224 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:09:31.224 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:09:31.679 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768424967 status=200 resp_size=127562
2026-01-15 05:09:31.679 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:09:31.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job&timestamp=1768424971 status=200 resp_size=6325
2026-01-15 05:09:32.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424971&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 05:09:41.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768424981 status=200 resp_size=6303
2026-01-15 05:09:42.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424981&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-15 05:09:46.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768424985 status=200 resp_size=5306
2026-01-15 05:09:46.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424986&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-15 05:09:53.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768424992 status=200 resp_size=6073
2026-01-15 05:09:53.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768424993&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-15 05:10:04.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768425003 status=200 resp_size=5111
2026-01-15 05:10:04.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425004&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 05:10:13.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job&timestamp=1768425013 status=200 resp_size=5915
2026-01-15 05:10:14.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425013&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 05:10:20.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768425019 status=200 resp_size=5282
2026-01-15 05:10:20.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425020&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 05:10:22.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job&timestamp=1768425022 status=200 resp_size=7778
2026-01-15 05:10:22.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425022&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 05:10:30.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job&timestamp=1768425030 status=200 resp_size=5294
2026-01-15 05:10:32.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425030&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:10:38.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job&timestamp=1768425037 status=200 resp_size=7744
2026-01-15 05:10:38.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425038&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 05:10:49.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768425048 status=200 resp_size=4757
2026-01-15 05:10:49.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425049&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-15 05:10:50.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job&timestamp=1768425050 status=200 resp_size=5693
2026-01-15 05:10:51.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425050&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:10:54.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768425054 status=200 resp_size=5853
2026-01-15 05:10:54.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425054&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 05:11:02.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768425062 status=200 resp_size=5360
2026-01-15 05:11:03.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425062&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-15 05:11:04.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768425064 status=200 resp_size=5666
2026-01-15 05:11:04.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425064&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 05:11:06.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768425066 status=200 resp_size=5591
2026-01-15 05:11:07.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425066&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:11:16.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job&timestamp=1768425075 status=200 resp_size=5651
2026-01-15 05:11:16.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425076&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 05:11:19.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job&timestamp=1768425079 status=200 resp_size=4864
2026-01-15 05:11:19.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425079&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 05:11:21.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768425080 status=200 resp_size=4333
2026-01-15 05:11:21.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425081&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-15 05:11:29.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job&timestamp=1768425088 status=200 resp_size=5317
2026-01-15 05:11:29.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425089&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:11:29.243 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
2026-01-15 05:11:34.960 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:11:34.960 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-15 05:11:42.628 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.66 秒后继续...
2026-01-15 05:11:42.628 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 19/26 页...
2026-01-15 05:11:42.628 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:11:42.653 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:11:43.233 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:11:44.380 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:11:46.516 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:11:46.516 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:11:46.955 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768425102 status=200 resp_size=121995
2026-01-15 05:11:46.955 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:11:47.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768425106 status=200 resp_size=6269
2026-01-15 05:11:47.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425107&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-15 05:11:52.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768425112 status=200 resp_size=5481
2026-01-15 05:11:52.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425112&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-15 05:12:01.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768425121 status=200 resp_size=6454
2026-01-15 05:12:02.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425121&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 05:12:05.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768425125 status=200 resp_size=8675
2026-01-15 05:12:05.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425125&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-15 05:12:08.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job&timestamp=1768425128 status=200 resp_size=5938
2026-01-15 05:12:08.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425128&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-15 05:12:16.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768425135 status=200 resp_size=8440
2026-01-15 05:12:16.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425136&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
2026-01-15 05:12:17.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768425137 status=200 resp_size=6458
2026-01-15 05:12:18.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425137&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 05:12:26.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job&timestamp=1768425146 status=200 resp_size=5227
2026-01-15 05:12:26.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425146&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 05:12:31.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768425150 status=200 resp_size=5162
2026-01-15 05:12:31.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425151&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-15 05:12:35.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job&timestamp=1768425155 status=200 resp_size=6414
2026-01-15 05:12:35.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425155&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
2026-01-15 05:12:42.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768425161 status=200 resp_size=6062
2026-01-15 05:12:42.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425162&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-15 05:12:50.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job&timestamp=1768425169 status=200 resp_size=5449
2026-01-15 05:12:50.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425170&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 05:12:55.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768425174 status=200 resp_size=5714
2026-01-15 05:12:55.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425175&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 05:13:01.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768425181 status=200 resp_size=6976
2026-01-15 05:13:01.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425181&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 05:13:04.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768425184 status=200 resp_size=5837
2026-01-15 05:13:04.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425184&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 05:13:09.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768425188 status=200 resp_size=5506
2026-01-15 05:13:09.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425189&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 05:13:17.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768425196 status=200 resp_size=5845
2026-01-15 05:13:17.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425197&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 05:13:19.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768425199 status=200 resp_size=6139
2026-01-15 05:13:19.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425199&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 05:13:23.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768425203 status=200 resp_size=5605
2026-01-15 05:13:23.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425203&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-15 05:13:28.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768425208 status=200 resp_size=5636
2026-01-15 05:13:29.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425208&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-15 05:13:29.139 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
2026-01-15 05:13:34.804 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:13:34.804 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-15 05:13:37.554 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.74 秒后继续...
2026-01-15 05:13:37.554 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 20/26 页...
2026-01-15 05:13:37.554 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:13:37.585 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:13:38.182 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:13:39.329 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:13:41.480 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:13:41.480 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:13:42.139 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768425217 status=200 resp_size=109410
2026-01-15 05:13:42.139 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:13:42.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768425222 status=200 resp_size=6222
2026-01-15 05:13:42.563 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425222&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 05:13:43.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job&timestamp=1768425223 status=200 resp_size=7746
2026-01-15 05:13:43.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425223&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 05:13:46.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768425225 status=200 resp_size=5400
2026-01-15 05:13:46.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425226&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 05:13:52.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768425232 status=200 resp_size=5846
2026-01-15 05:13:53.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425232&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 05:14:02.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768425241 status=200 resp_size=4627
2026-01-15 05:14:02.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425242&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 05:14:03.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768425243 status=200 resp_size=6088
2026-01-15 05:14:03.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425243&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:14:07.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768425247 status=200 resp_size=6341
2026-01-15 05:14:07.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425247&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-15 05:14:17.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768425257 status=200 resp_size=6896
2026-01-15 05:14:18.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425257&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-15 05:14:23.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768425263 status=200 resp_size=5290
2026-01-15 05:14:24.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425263&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 05:14:29.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768425268 status=200 resp_size=5974
2026-01-15 05:14:29.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425269&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:14:33.384 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768425272 status=200 resp_size=6435
2026-01-15 05:14:33.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425273&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-15 05:14:41.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768425281 status=200 resp_size=6490
2026-01-15 05:14:41.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425281&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-15 05:14:48.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768425288 status=200 resp_size=6194
2026-01-15 05:14:48.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425288&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-15 05:14:54.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768425293 status=200 resp_size=6076
2026-01-15 05:14:54.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425294&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:14:58.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768425298 status=200 resp_size=5526
2026-01-15 05:14:58.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425298&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-15 05:15:01.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768425301 status=200 resp_size=6819
2026-01-15 05:15:01.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425301&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-15 05:15:10.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768425310 status=200 resp_size=5832
2026-01-15 05:15:11.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425310&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 05:15:16.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768425315 status=200 resp_size=4786
2026-01-15 05:15:16.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425316&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 05:15:25.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768425325 status=200 resp_size=6984
2026-01-15 05:15:25.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425325&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-15 05:15:36.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768425335 status=200 resp_size=5434
2026-01-15 05:15:36.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425336&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-15 05:15:36.465 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
2026-01-15 05:15:42.057 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:15:42.057 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-15 05:15:43.245 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.18 秒后继续...
2026-01-15 05:15:43.245 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 21/26 页...
2026-01-15 05:15:43.245 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:15:43.266 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:15:43.816 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:15:44.947 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:15:47.053 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:15:47.053 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:15:47.477 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768425343 status=200 resp_size=106372
2026-01-15 05:15:47.477 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:15:47.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768425347 status=200 resp_size=6066
2026-01-15 05:15:47.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425347&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-15 05:15:52.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768425352 status=200 resp_size=5541
2026-01-15 05:15:53.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425352&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-15 05:15:57.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768425356 status=200 resp_size=6058
2026-01-15 05:15:57.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425357&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-15 05:15:59.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job&timestamp=1768425359 status=200 resp_size=5879
2026-01-15 05:16:00.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425359&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 05:16:01.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768425361 status=200 resp_size=5379
2026-01-15 05:16:01.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425361&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 05:16:03.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768425362 status=200 resp_size=5655
2026-01-15 05:16:03.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425363&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 05:16:10.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768425370 status=200 resp_size=6286
2026-01-15 05:16:11.142 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425370&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-15 05:16:19.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job&timestamp=1768425378 status=200 resp_size=5496
2026-01-15 05:16:19.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425379&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 05:16:26.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job&timestamp=1768425386 status=200 resp_size=6106
2026-01-15 05:16:27.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425386&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-15 05:16:34.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768425393 status=200 resp_size=6326
2026-01-15 05:16:34.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425394&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-15 05:16:41.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768425401 status=200 resp_size=5398
2026-01-15 05:16:42.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425401&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-15 05:16:46.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768425406 status=200 resp_size=5294
2026-01-15 05:16:46.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425406&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:16:53.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768425413 status=200 resp_size=5984
2026-01-15 05:16:54.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425413&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-15 05:16:57.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768425417 status=200 resp_size=5662
2026-01-15 05:16:57.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425417&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
2026-01-15 05:16:59.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job&timestamp=1768425418 status=200 resp_size=5835
2026-01-15 05:16:59.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425419&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
2026-01-15 05:17:01.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768425421 status=200 resp_size=6131
2026-01-15 05:17:02.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425421&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-15 05:17:10.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768425429 status=200 resp_size=6106
2026-01-15 05:17:10.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425430&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:17:14.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job&timestamp=1768425434 status=200 resp_size=5951
2026-01-15 05:17:14.848 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425434&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-15 05:17:23.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768425442 status=200 resp_size=6219
2026-01-15 05:17:23.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425443&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-15 05:17:31.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768425450 status=200 resp_size=6041
2026-01-15 05:17:31.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425451&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-15 05:17:31.716 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
2026-01-15 05:17:37.228 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:17:37.228 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-15 05:17:42.362 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.13 秒后继续...
2026-01-15 05:17:42.362 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 22/26 页...
2026-01-15 05:17:42.362 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:17:42.392 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:17:43.004 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:17:44.135 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:17:46.287 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:17:46.287 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:17:46.727 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768425462 status=200 resp_size=132711
2026-01-15 05:17:46.727 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:17:46.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768425466 status=200 resp_size=5675
2026-01-15 05:17:47.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425466&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:17:52.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768425472 status=200 resp_size=5849
2026-01-15 05:17:52.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425472&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 05:17:55.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768425475 status=200 resp_size=5335
2026-01-15 05:17:55.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425475&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:18:05.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768425484 status=200 resp_size=6351
2026-01-15 05:18:05.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425485&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-15 05:18:13.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768425492 status=200 resp_size=6113
2026-01-15 05:18:13.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425493&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 05:18:20.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768425499 status=200 resp_size=5829
2026-01-15 05:18:20.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425500&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-15 05:18:29.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768425508 status=200 resp_size=6321
2026-01-15 05:18:30.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425509&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:18:39.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768425518 status=200 resp_size=5095
2026-01-15 05:18:39.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425519&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-15 05:18:47.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768425526 status=200 resp_size=6385
2026-01-15 05:18:47.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425527&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 05:18:56.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768425536 status=200 resp_size=5107
2026-01-15 05:18:57.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425536&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-15 05:19:00.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768425540 status=200 resp_size=6497
2026-01-15 05:19:00.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425540&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:19:07.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768425546 status=200 resp_size=6053
2026-01-15 05:19:07.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425547&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 05:19:16.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768425556 status=200 resp_size=6963
2026-01-15 05:19:16.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425556&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 05:19:26.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job&timestamp=1768425565 status=200 resp_size=5197
2026-01-15 05:19:26.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425566&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:19:31.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768425571 status=200 resp_size=5473
2026-01-15 05:19:32.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425571&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:19:35.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768425575 status=200 resp_size=7337
2026-01-15 05:19:35.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425575&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-15 05:19:44.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768425583 status=200 resp_size=7079
2026-01-15 05:19:44.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425584&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-15 05:19:49.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768425589 status=200 resp_size=5703
2026-01-15 05:19:49.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425589&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:19:56.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768425596 status=200 resp_size=6074
2026-01-15 05:19:57.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425596&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:20:07.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768425606 status=200 resp_size=6216
2026-01-15 05:20:07.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425607&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 05:20:07.257 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
2026-01-15 05:20:07.555 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:20:07.555 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-15 05:20:12.249 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.69 秒后继续...
2026-01-15 05:20:12.249 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 23/26 页...
2026-01-15 05:20:12.251 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:20:12.267 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:20:12.895 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:20:14.120 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:20:16.277 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:20:16.277 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:20:16.759 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768425612 status=200 resp_size=133854
2026-01-15 05:20:16.759 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:20:18.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job&timestamp=1768425616 status=200 resp_size=5924
2026-01-15 05:20:18.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425618&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
2026-01-15 05:20:28.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768425627 status=200 resp_size=4841
2026-01-15 05:20:28.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425628&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:20:35.087 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768425634 status=200 resp_size=5236
2026-01-15 05:20:35.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425635&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:20:43.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768425643 status=200 resp_size=6275
2026-01-15 05:20:44.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425643&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-15 05:20:49.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768425648 status=200 resp_size=6316
2026-01-15 05:20:49.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425649&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 05:21:01.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768425657 status=200 resp_size=5112
2026-01-15 05:21:01.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425661&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:21:09.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768425668 status=200 resp_size=5510
2026-01-15 05:21:09.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425669&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:21:13.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job&timestamp=1768425672 status=200 resp_size=6215
2026-01-15 05:21:14.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425673&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
2026-01-15 05:21:16.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768425676 status=200 resp_size=6150
2026-01-15 05:21:17.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425676&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-15 05:21:23.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job&timestamp=1768425683 status=200 resp_size=5166
2026-01-15 05:21:24.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425683&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:21:27.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768425687 status=200 resp_size=5321
2026-01-15 05:21:28.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425687&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:21:32.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job&timestamp=1768425691 status=200 resp_size=5148
2026-01-15 05:21:32.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425692&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:21:35.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768425695 status=200 resp_size=5188
2026-01-15 05:21:36.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425695&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:21:41.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768425701 status=200 resp_size=5055
2026-01-15 05:21:42.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425701&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:21:44.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768425704 status=200 resp_size=5373
2026-01-15 05:21:44.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425704&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:21:52.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768425711 status=200 resp_size=4847
2026-01-15 05:21:52.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425712&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:21:59.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768425718 status=200 resp_size=4861
2026-01-15 05:21:59.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425719&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:22:05.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job&timestamp=1768425725 status=200 resp_size=5600
2026-01-15 05:22:05.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425725&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:22:17.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768425735 status=200 resp_size=4962
2026-01-15 05:22:18.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425737&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:22:19.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768425739 status=200 resp_size=5032
2026-01-15 05:22:20.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425739&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:22:20.338 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
2026-01-15 05:22:26.411 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:22:26.427 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-15 05:22:33.451 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.02 秒后继续...
2026-01-15 05:22:33.451 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 24/26 页...
2026-01-15 05:22:33.451 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:22:33.478 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:22:34.090 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:22:35.222 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:22:37.419 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:22:37.419 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:22:38.214 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768425753 status=200 resp_size=138702
2026-01-15 05:22:38.214 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:22:38.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768425758 status=200 resp_size=5409
2026-01-15 05:22:38.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425758&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:22:46.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768425765 status=200 resp_size=5182
2026-01-15 05:22:46.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425766&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:22:49.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768425769 status=200 resp_size=5570
2026-01-15 05:22:49.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425769&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:22:53.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768425772 status=200 resp_size=5552
2026-01-15 05:22:53.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425773&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:23:01.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job&timestamp=1768425781 status=200 resp_size=5503
2026-01-15 05:23:02.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425781&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:23:10.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job&timestamp=1768425789 status=200 resp_size=5489
2026-01-15 05:23:10.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425790&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:23:14.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768425794 status=200 resp_size=5461
2026-01-15 05:23:14.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425794&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:23:18.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768425797 status=200 resp_size=5295
2026-01-15 05:23:18.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425798&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:23:21.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768425801 status=200 resp_size=5200
2026-01-15 05:23:21.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425801&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:23:27.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job&timestamp=1768425807 status=200 resp_size=4383
2026-01-15 05:23:27.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425807&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
2026-01-15 05:23:38.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768425817 status=200 resp_size=4985
2026-01-15 05:23:39.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425818&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:23:40.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768425820 status=200 resp_size=5207
2026-01-15 05:23:40.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425820&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:23:45.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768425825 status=200 resp_size=10634
2026-01-15 05:23:46.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425825&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-15 05:23:51.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768425831 status=200 resp_size=4990
2026-01-15 05:23:52.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425831&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-15 05:23:58.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768425838 status=200 resp_size=4972
2026-01-15 05:23:59.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425838&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:24:09.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768425848 status=200 resp_size=5173
2026-01-15 05:24:09.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425849&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:24:20.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job&timestamp=1768425859 status=200 resp_size=5236
2026-01-15 05:24:20.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425860&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 05:24:30.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768425870 status=200 resp_size=4315
2026-01-15 05:24:31.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425870&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-15 05:24:38.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768425877 status=200 resp_size=5158
2026-01-15 05:24:38.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425878&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:24:40.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768425880 status=200 resp_size=7684
2026-01-15 05:24:41.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425880&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-15 05:24:41.610 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
2026-01-15 05:24:47.719 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:24:47.719 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-15 05:24:56.019 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.29 秒后继续...
2026-01-15 05:24:56.019 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 25/26 页...
2026-01-15 05:24:56.019 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:24:56.045 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:24:56.877 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:24:58.025 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:25:00.176 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:25:00.176 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:25:00.631 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768425896 status=200 resp_size=126461
2026-01-15 05:25:00.631 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:25:00.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768425900 status=200 resp_size=6095
2026-01-15 05:25:01.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425900&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:25:11.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768425910 status=200 resp_size=5147
2026-01-15 05:25:11.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425911&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-15 05:25:18.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768425917 status=200 resp_size=4978
2026-01-15 05:25:18.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425918&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:25:26.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768425925 status=200 resp_size=6401
2026-01-15 05:25:26.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425926&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 05:25:36.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768425935 status=200 resp_size=6101
2026-01-15 05:25:36.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425936&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:25:45.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768425944 status=200 resp_size=4991
2026-01-15 05:25:45.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425945&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-15 05:25:50.606 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768425950 status=200 resp_size=5026
2026-01-15 05:25:50.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425950&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:25:52.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768425952 status=200 resp_size=6793
2026-01-15 05:25:52.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425952&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 05:26:01.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768425960 status=200 resp_size=6117
2026-01-15 05:26:01.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425961&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:26:11.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job&timestamp=1768425970 status=200 resp_size=5111
2026-01-15 05:26:11.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425971&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:26:14.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768425973 status=200 resp_size=4859
2026-01-15 05:26:14.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425974&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:26:20.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job&timestamp=1768425979 status=200 resp_size=4835
2026-01-15 05:26:20.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425980&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
2026-01-15 05:26:27.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768425987 status=200 resp_size=6108
2026-01-15 05:26:27.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425987&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:26:32.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768425992 status=200 resp_size=7131
2026-01-15 05:26:32.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768425992&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-15 05:26:42.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job&timestamp=1768426001 status=200 resp_size=5992
2026-01-15 05:26:42.773 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426002&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-15 05:26:44.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job&timestamp=1768426004 status=200 resp_size=6109
2026-01-15 05:26:44.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426004&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:26:53.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768426012 status=200 resp_size=6544
2026-01-15 05:26:53.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426013&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 05:26:57.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768426017 status=200 resp_size=7105
2026-01-15 05:26:57.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426017&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-15 05:27:04.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768426023 status=200 resp_size=6531
2026-01-15 05:27:04.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426024&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-15 05:27:08.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768426028 status=200 resp_size=6115
2026-01-15 05:27:08.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426028&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:27:08.895 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
2026-01-15 05:27:14.848 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:27:14.861 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-15 05:27:23.849 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.99 秒后继续...
2026-01-15 05:27:23.849 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 26/26 页...
2026-01-15 05:27:23.849 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:27:23.868 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=锦州, 工作类型=0154
2026-01-15 05:27:24.450 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:27:25.581 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:27:27.720 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:27:27.720 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:27:28.128 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426043 status=200 resp_size=111752
2026-01-15 05:27:28.128 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17 | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
2026-01-15 05:27:28.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768426048 status=200 resp_size=4704
2026-01-15 05:27:28.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426048&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-15 05:27:38.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768426058 status=200 resp_size=6427
2026-01-15 05:27:39.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426058&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-15 05:27:42.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job&timestamp=1768426062 status=200 resp_size=5737
2026-01-15 05:27:42.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426062&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 05:27:44.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768426063 status=200 resp_size=6044
2026-01-15 05:27:44.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426064&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:27:47.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768426067 status=200 resp_size=5499
2026-01-15 05:27:47.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426067&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-15 05:27:54.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768426073 status=200 resp_size=6107
2026-01-15 05:27:55.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426074&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:28:02.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768426081 status=200 resp_size=5880
2026-01-15 05:28:02.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426082&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 05:28:07.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768426086 status=200 resp_size=5139
2026-01-15 05:28:07.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426087&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:28:10.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768426090 status=200 resp_size=5903
2026-01-15 05:28:10.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426090&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-15 05:28:17.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768426096 status=200 resp_size=6113
2026-01-15 05:28:17.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426097&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:28:20.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768426100 status=200 resp_size=5129
2026-01-15 05:28:20.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426100&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-15 05:28:28.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768426108 status=200 resp_size=5241
2026-01-15 05:28:29.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426108&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:28:35.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768426115 status=200 resp_size=6107
2026-01-15 05:28:36.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426115&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:28:43.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768426123 status=200 resp_size=6109
2026-01-15 05:28:44.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426123&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:28:47.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768426126 status=200 resp_size=6111
2026-01-15 05:28:48.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426127&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:28:50.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768426130 status=200 resp_size=5151
2026-01-15 05:28:50.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426130&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:28:53.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768426132 status=200 resp_size=6122
2026-01-15 05:28:53.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426133&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-15 05:28:53.782 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
2026-01-15 05:28:54.067 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 515 条
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 2 条
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 锦州(锦州)
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 全栈工程师(0154)
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 99.61% (515/517)
2026-01-15 05:28:54.067 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(515) < API返回总数(517),可能存在分页问题或数据过滤
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-15 05:28:54.067 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 515 条记录)
2026-01-15 05:28:54.067 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 515 个职位
2026-01-15 05:28:54.067 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-15 05:28:59.382 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:28:59.390 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:28:59.767 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-15 05:28:59.767 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:28:59.798 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:29:00.379 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:29:01.525 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:29:03.677 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:29:03.677 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:29:04.117 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426139 status=200 resp_size=108815
2026-01-15 05:29:04.117 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:29:04.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768426144 status=200 resp_size=8244
2026-01-15 05:29:04.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426144&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-15 05:29:15.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768426152 status=200 resp_size=5184
2026-01-15 05:29:15.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426155&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 05:29:19.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768426159 status=200 resp_size=5579
2026-01-15 05:29:19.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426159&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 05:29:22.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768426161 status=200 resp_size=5000
2026-01-15 05:29:22.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426162&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-15 05:29:24.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768426164 status=200 resp_size=5029
2026-01-15 05:29:24.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426164&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 05:29:30.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768426169 status=200 resp_size=5630
2026-01-15 05:29:31.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426170&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 05:29:33.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768426172 status=200 resp_size=5546
2026-01-15 05:29:33.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426173&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-15 05:29:42.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768426181 status=200 resp_size=6579
2026-01-15 05:29:42.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426182&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-15 05:29:48.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768426188 status=200 resp_size=4913
2026-01-15 05:29:48.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426188&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 05:29:56.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768426196 status=200 resp_size=5739
2026-01-15 05:29:56.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426196&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-15 05:30:00.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768426200 status=200 resp_size=6192
2026-01-15 05:30:00.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426200&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 05:30:04.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job&timestamp=1768426204 status=200 resp_size=6139
2026-01-15 05:30:04.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426204&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 05:30:08.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768426208 status=200 resp_size=4954
2026-01-15 05:30:09.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426208&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-15 05:30:17.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768426216 status=200 resp_size=5813
2026-01-15 05:30:18.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426217&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 05:30:28.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768426227 status=200 resp_size=5890
2026-01-15 05:30:29.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426228&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 05:30:36.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768426235 status=200 resp_size=4892
2026-01-15 05:30:36.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426236&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-15 05:30:46.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job&timestamp=1768426246 status=200 resp_size=5976
2026-01-15 05:30:47.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426246&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 05:30:48.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768426248 status=200 resp_size=5431
2026-01-15 05:30:49.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426248&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-15 05:30:56.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768426255 status=200 resp_size=6023
2026-01-15 05:30:56.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426256&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 05:31:04.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768426263 status=200 resp_size=6048
2026-01-15 05:31:05.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426264&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 05:31:05.379 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
2026-01-15 05:31:11.144 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:31:11.144 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-15 05:31:11.144 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-15 05:31:18.216 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.06 秒后继续...
2026-01-15 05:31:18.216 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-15 05:31:18.216 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:31:18.243 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:31:18.761 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:31:19.876 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:31:21.997 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:31:21.997 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:31:22.421 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426278 status=200 resp_size=108122
2026-01-15 05:31:22.421 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:31:22.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768426282 status=200 resp_size=5280
2026-01-15 05:31:22.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426282&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-15 05:31:32.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job&timestamp=1768426292 status=200 resp_size=6192
2026-01-15 05:31:33.161 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426292&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
2026-01-15 05:31:37.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job&timestamp=1768426297 status=200 resp_size=5754
2026-01-15 05:31:37.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426297&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 05:31:44.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job&timestamp=1768426304 status=200 resp_size=7534
2026-01-15 05:31:45.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426304&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
2026-01-15 05:31:55.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768426314 status=200 resp_size=6399
2026-01-15 05:31:56.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426315&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:32:02.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job&timestamp=1768426322 status=200 resp_size=6787
2026-01-15 05:32:03.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426322&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
2026-01-15 05:32:13.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768426331 status=200 resp_size=5480
2026-01-15 05:32:13.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426333&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-15 05:32:17.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768426336 status=200 resp_size=5190
2026-01-15 05:32:17.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426337&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-15 05:32:26.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job&timestamp=1768426345 status=200 resp_size=6137
2026-01-15 05:32:26.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426346&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
2026-01-15 05:32:29.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768426349 status=200 resp_size=6134
2026-01-15 05:32:29.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426349&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-15 05:32:35.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768426354 status=200 resp_size=5591
2026-01-15 05:32:35.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426355&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-15 05:32:46.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768426365 status=200 resp_size=5110
2026-01-15 05:32:46.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426366&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-15 05:32:55.602 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768426373 status=200 resp_size=6366
2026-01-15 05:32:55.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426375&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-15 05:33:01.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768426380 status=200 resp_size=5960
2026-01-15 05:33:01.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426381&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-15 05:33:11.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768426390 status=200 resp_size=5613
2026-01-15 05:33:11.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426391&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:33:14.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768426394 status=200 resp_size=5374
2026-01-15 05:33:15.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426394&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 05:33:21.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768426400 status=200 resp_size=6423
2026-01-15 05:33:21.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426401&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 05:33:23.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768426403 status=200 resp_size=5484
2026-01-15 05:33:23.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426403&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 05:33:33.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768426412 status=200 resp_size=5603
2026-01-15 05:33:33.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426413&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 05:33:38.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768426417 status=200 resp_size=5694
2026-01-15 05:33:38.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426418&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:33:38.796 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
2026-01-15 05:33:44.527 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:33:44.543 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-15 05:33:50.276 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.73 秒后继续...
2026-01-15 05:33:50.276 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-15 05:33:50.276 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:33:50.307 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:33:50.872 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:33:52.081 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:33:54.216 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:33:54.216 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:33:54.765 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426430 status=200 resp_size=115509
2026-01-15 05:33:54.765 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:33:55.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job&timestamp=1768426434 status=200 resp_size=6179
2026-01-15 05:33:55.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426435&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 05:33:59.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768426439 status=200 resp_size=5513
2026-01-15 05:33:59.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426439&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 05:34:05.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job&timestamp=1768426444 status=200 resp_size=6076
2026-01-15 05:34:05.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426445&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-15 05:34:08.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768426448 status=200 resp_size=5661
2026-01-15 05:34:08.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426448&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-15 05:34:16.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job&timestamp=1768426456 status=200 resp_size=5845
2026-01-15 05:34:17.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426456&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:34:27.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768426466 status=200 resp_size=5513
2026-01-15 05:34:27.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426467&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-15 05:34:36.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768426476 status=200 resp_size=6285
2026-01-15 05:34:36.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426476&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-15 05:34:39.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768426479 status=200 resp_size=5127
2026-01-15 05:34:40.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426479&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-15 05:34:49.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768426488 status=200 resp_size=7499
2026-01-15 05:34:49.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426489&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 05:34:55.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768426494 status=200 resp_size=5182
2026-01-15 05:34:56.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426495&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-15 05:34:58.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768426498 status=200 resp_size=5988
2026-01-15 05:34:58.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426498&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-15 05:35:06.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768426506 status=200 resp_size=5333
2026-01-15 05:35:06.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426506&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:35:13.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768426511 status=200 resp_size=8364
2026-01-15 05:35:13.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426513&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-15 05:35:18.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768426518 status=200 resp_size=5725
2026-01-15 05:35:19.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426518&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-15 05:35:27.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768426526 status=200 resp_size=5729
2026-01-15 05:35:27.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426527&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 05:35:29.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job&timestamp=1768426529 status=200 resp_size=5229
2026-01-15 05:35:29.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426529&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 05:35:36.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job&timestamp=1768426535 status=200 resp_size=5632
2026-01-15 05:35:36.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426536&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
2026-01-15 05:35:46.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768426545 status=200 resp_size=5723
2026-01-15 05:35:46.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426546&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-15 05:35:53.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768426551 status=200 resp_size=6030
2026-01-15 05:35:53.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426553&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-15 05:35:57.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768426557 status=200 resp_size=5245
2026-01-15 05:35:57.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426557&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-15 05:35:57.880 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
2026-01-15 05:35:58.131 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:35:58.131 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-15 05:36:06.897 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.76 秒后继续...
2026-01-15 05:36:06.897 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-15 05:36:06.897 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:36:06.922 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:36:07.786 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:36:09.184 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:36:11.496 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:36:11.496 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:36:12.216 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426566 status=200 resp_size=117007
2026-01-15 05:36:12.216 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:36:12.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job&timestamp=1768426572 status=200 resp_size=6024
2026-01-15 05:36:13.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426572&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:36:17.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768426576 status=200 resp_size=6651
2026-01-15 05:36:17.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426577&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 05:36:25.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768426584 status=200 resp_size=5833
2026-01-15 05:36:25.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426585&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:36:28.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768426588 status=200 resp_size=6448
2026-01-15 05:36:28.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426588&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 05:36:34.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768426593 status=200 resp_size=6718
2026-01-15 05:36:34.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426594&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-15 05:36:44.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768426604 status=200 resp_size=6466
2026-01-15 05:36:44.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426604&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 05:36:47.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768426607 status=200 resp_size=5793
2026-01-15 05:36:47.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426607&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:36:53.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768426613 status=200 resp_size=5803
2026-01-15 05:36:53.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426613&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 05:36:55.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768426615 status=200 resp_size=6573
2026-01-15 05:36:55.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426615&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 05:37:05.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768426625 status=200 resp_size=5961
2026-01-15 05:37:05.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426625&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:37:15.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768426635 status=200 resp_size=6392
2026-01-15 05:37:15.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426635&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 05:37:27.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768426645 status=200 resp_size=6049
2026-01-15 05:37:27.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426647&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:37:34.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768426653 status=200 resp_size=6715
2026-01-15 05:37:34.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426654&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-15 05:37:40.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768426659 status=200 resp_size=6511
2026-01-15 05:37:40.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426660&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
2026-01-15 05:37:49.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768426669 status=200 resp_size=5940
2026-01-15 05:37:49.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426669&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:37:54.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768426674 status=200 resp_size=4058
2026-01-15 05:37:55.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426674&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-15 05:37:59.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768426678 status=200 resp_size=5421
2026-01-15 05:37:59.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426679&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:38:09.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768426688 status=200 resp_size=5232
2026-01-15 05:38:09.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426689&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:38:19.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768426698 status=200 resp_size=6177
2026-01-15 05:38:19.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426699&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 05:38:26.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768426705 status=200 resp_size=5634
2026-01-15 05:38:26.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426706&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:38:26.596 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
2026-01-15 05:38:26.973 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:38:26.973 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-15 05:38:28.641 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.66 秒后继续...
2026-01-15 05:38:28.641 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-15 05:38:28.641 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:38:28.669 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:38:30.366 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:38:32.580 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:38:34.858 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:38:34.858 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:38:35.392 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426708 status=200 resp_size=129793
2026-01-15 05:38:35.392 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:38:36.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768426715 status=200 resp_size=5699
2026-01-15 05:38:36.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426716&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-15 05:38:46.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768426725 status=200 resp_size=6125
2026-01-15 05:38:46.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426726&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 05:38:53.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768426733 status=200 resp_size=5888
2026-01-15 05:38:53.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426733&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-15 05:38:59.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768426738 status=200 resp_size=6055
2026-01-15 05:39:00.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426739&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-15 05:39:07.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job&timestamp=1768426746 status=200 resp_size=5857
2026-01-15 05:39:07.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426747&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
2026-01-15 05:39:11.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768426751 status=200 resp_size=5455
2026-01-15 05:39:11.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426751&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-15 05:39:20.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768426759 status=200 resp_size=6314
2026-01-15 05:39:20.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426760&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
2026-01-15 05:39:28.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768426768 status=200 resp_size=5721
2026-01-15 05:39:29.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426768&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-15 05:39:34.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768426773 status=200 resp_size=5942
2026-01-15 05:39:34.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426774&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 05:39:43.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768426782 status=200 resp_size=5638
2026-01-15 05:39:43.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426783&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-15 05:39:46.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768426786 status=200 resp_size=5687
2026-01-15 05:39:46.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426786&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:39:52.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job&timestamp=1768426791 status=200 resp_size=8574
2026-01-15 05:39:52.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426792&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 05:39:56.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768426796 status=200 resp_size=7551
2026-01-15 05:39:56.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426796&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-15 05:40:00.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768426800 status=200 resp_size=5784
2026-01-15 05:40:00.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426800&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-15 05:40:09.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768426808 status=200 resp_size=6552
2026-01-15 05:40:09.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426809&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:40:17.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768426816 status=200 resp_size=5306
2026-01-15 05:40:17.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426817&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-15 05:40:22.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768426822 status=200 resp_size=7182
2026-01-15 05:40:23.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426822&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-15 05:40:33.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job&timestamp=1768426831 status=200 resp_size=5407
2026-01-15 05:40:33.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426833&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
2026-01-15 05:40:39.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768426838 status=200 resp_size=5497
2026-01-15 05:40:39.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426839&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:40:41.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768426840 status=200 resp_size=5655
2026-01-15 05:40:41.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426841&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 05:40:41.223 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
2026-01-15 05:40:47.485 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:40:47.485 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-15 05:40:50.671 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.17 秒后继续...
2026-01-15 05:40:50.671 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-15 05:40:50.671 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:40:50.706 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:40:51.868 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:40:53.203 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:40:55.767 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:40:55.767 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:40:56.595 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426850 status=200 resp_size=139890
2026-01-15 05:40:56.595 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:40:56.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768426856 status=200 resp_size=6714
2026-01-15 05:40:57.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426856&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-15 05:41:07.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768426866 status=200 resp_size=6689
2026-01-15 05:41:07.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426867&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:41:17.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768426877 status=200 resp_size=5615
2026-01-15 05:41:17.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426877&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
2026-01-15 05:41:22.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768426882 status=200 resp_size=5775
2026-01-15 05:41:23.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426882&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-15 05:41:26.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768426886 status=200 resp_size=6696
2026-01-15 05:41:27.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426886&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-15 05:41:30.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job&timestamp=1768426890 status=200 resp_size=6390
2026-01-15 05:41:30.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426890&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:41:40.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768426899 status=200 resp_size=13102
2026-01-15 05:41:41.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426900&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 05:41:44.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768426904 status=200 resp_size=5128
2026-01-15 05:41:44.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426904&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-15 05:41:50.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job&timestamp=1768426909 status=200 resp_size=6362
2026-01-15 05:41:50.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426910&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 05:41:59.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768426918 status=200 resp_size=6230
2026-01-15 05:41:59.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426919&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:42:07.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768426926 status=200 resp_size=6529
2026-01-15 05:42:07.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426927&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-15 05:42:08.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job&timestamp=1768426928 status=200 resp_size=7130
2026-01-15 05:42:09.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426928&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
2026-01-15 05:42:19.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768426937 status=200 resp_size=7415
2026-01-15 05:42:20.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426939&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
2026-01-15 05:42:28.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768426947 status=200 resp_size=8808
2026-01-15 05:42:28.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426948&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:42:36.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job&timestamp=1768426955 status=200 resp_size=5152
2026-01-15 05:42:36.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426956&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
2026-01-15 05:42:41.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768426960 status=200 resp_size=5877
2026-01-15 05:42:41.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426961&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
2026-01-15 05:42:47.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768426966 status=200 resp_size=5098
2026-01-15 05:42:47.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426967&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 05:42:58.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job&timestamp=1768426977 status=200 resp_size=5920
2026-01-15 05:42:58.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426978&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:43:00.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768426980 status=200 resp_size=6970
2026-01-15 05:43:00.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426980&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 05:43:02.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job&timestamp=1768426981 status=200 resp_size=7057
2026-01-15 05:43:02.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768426982&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
2026-01-15 05:43:02.430 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
2026-01-15 05:43:08.774 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:43:08.774 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-15 05:43:18.246 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.47 秒后继续...
2026-01-15 05:43:18.246 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-15 05:43:18.246 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:43:18.273 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:43:18.934 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:43:20.128 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:43:22.317 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:43:22.317 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:43:22.938 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768426998 status=200 resp_size=141798
2026-01-15 05:43:22.938 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:43:24.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768427002 status=200 resp_size=5109
2026-01-15 05:43:24.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427004&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-15 05:43:32.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768427012 status=200 resp_size=6445
2026-01-15 05:43:33.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427012&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:43:35.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job&timestamp=1768427015 status=200 resp_size=7717
2026-01-15 05:43:35.786 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427015&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
2026-01-15 05:43:43.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job&timestamp=1768427022 status=200 resp_size=4321
2026-01-15 05:43:43.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427023&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
2026-01-15 05:43:52.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job&timestamp=1768427031 status=200 resp_size=5533
2026-01-15 05:43:52.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427032&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
2026-01-15 05:43:54.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768427034 status=200 resp_size=6501
2026-01-15 05:43:54.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427034&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:43:58.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job&timestamp=1768427038 status=200 resp_size=5524
2026-01-15 05:43:59.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427038&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
2026-01-15 05:44:04.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768427044 status=200 resp_size=6522
2026-01-15 05:44:04.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427044&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
2026-01-15 05:44:10.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768427049 status=200 resp_size=7756
2026-01-15 05:44:10.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427050&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 05:44:13.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768427052 status=200 resp_size=5756
2026-01-15 05:44:13.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427053&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:44:20.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768427060 status=200 resp_size=6318
2026-01-15 05:44:20.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427060&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-15 05:44:23.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job&timestamp=1768427063 status=200 resp_size=7311
2026-01-15 05:44:23.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427063&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
2026-01-15 05:44:29.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job&timestamp=1768427069 status=200 resp_size=5458
2026-01-15 05:44:29.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427069&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
2026-01-15 05:44:41.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job&timestamp=1768427079 status=200 resp_size=5678
2026-01-15 05:44:41.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427081&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:44:52.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job&timestamp=1768427091 status=200 resp_size=7237
2026-01-15 05:44:52.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427092&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
2026-01-15 05:44:58.612 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768427097 status=200 resp_size=5342
2026-01-15 05:44:58.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427098&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-15 05:45:02.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job&timestamp=1768427102 status=200 resp_size=6431
2026-01-15 05:45:03.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427102&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
2026-01-15 05:45:05.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768427105 status=200 resp_size=8457
2026-01-15 05:45:06.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427105&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:45:15.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job&timestamp=1768427114 status=200 resp_size=6416
2026-01-15 05:45:15.718 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427115&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 05:45:19.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job&timestamp=1768427118 status=200 resp_size=5876
2026-01-15 05:45:19.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427119&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 05:45:19.206 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
2026-01-15 05:45:25.535 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:45:25.535 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-15 05:45:33.385 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.84 秒后继续...
2026-01-15 05:45:33.385 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-15 05:45:33.385 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:45:33.403 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:45:33.999 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:45:35.132 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:45:37.283 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:45:37.283 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:45:37.754 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768427133 status=200 resp_size=155521
2026-01-15 05:45:37.754 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:45:38.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768427137 status=200 resp_size=5974
2026-01-15 05:45:38.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427138&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:45:39.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job&timestamp=1768427139 status=200 resp_size=6646
2026-01-15 05:45:40.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427139&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
2026-01-15 05:45:45.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768427145 status=200 resp_size=5489
2026-01-15 05:45:45.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427145&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-15 05:45:46.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768427146 status=200 resp_size=6958
2026-01-15 05:45:47.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427146&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:45:56.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768427155 status=200 resp_size=6449
2026-01-15 05:45:56.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427156&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-15 05:46:05.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768427164 status=200 resp_size=6015
2026-01-15 05:46:05.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427165&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-15 05:46:15.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768427174 status=200 resp_size=5925
2026-01-15 05:46:15.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427175&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
2026-01-15 05:46:19.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768427179 status=200 resp_size=6511
2026-01-15 05:46:19.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427179&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:46:23.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768427183 status=200 resp_size=7750
2026-01-15 05:46:23.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427183&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
2026-01-15 05:46:26.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768427185 status=200 resp_size=7971
2026-01-15 05:46:26.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427186&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
2026-01-15 05:46:29.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768427188 status=200 resp_size=8313
2026-01-15 05:46:29.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427189&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-15 05:46:39.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768427198 status=200 resp_size=6119
2026-01-15 05:46:39.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427199&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:46:43.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job&timestamp=1768427203 status=200 resp_size=5424
2026-01-15 05:46:44.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427203&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
2026-01-15 05:46:45.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job&timestamp=1768427205 status=200 resp_size=8274
2026-01-15 05:46:45.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427205&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
2026-01-15 05:46:54.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768427213 status=200 resp_size=8701
2026-01-15 05:46:54.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427214&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-15 05:46:56.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768427216 status=200 resp_size=6058
2026-01-15 05:46:56.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427216&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:46:58.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768427218 status=200 resp_size=5211
2026-01-15 05:46:58.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427218&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
2026-01-15 05:47:07.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job&timestamp=1768427226 status=200 resp_size=5378
2026-01-15 05:47:07.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427227&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
2026-01-15 05:47:09.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768427229 status=200 resp_size=7299
2026-01-15 05:47:09.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427229&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-15 05:47:18.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768427238 status=200 resp_size=6284
2026-01-15 05:47:19.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427238&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:47:19.145 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
2026-01-15 05:47:25.746 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:47:25.761 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-15 05:47:27.257 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.49 秒后继续...
2026-01-15 05:47:27.257 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-15 05:47:27.257 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:47:27.286 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:47:27.913 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:47:29.059 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:47:31.196 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:47:31.196 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:47:31.746 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768427247 status=200 resp_size=148203
2026-01-15 05:47:31.746 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:47:31.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job&timestamp=1768427251 status=200 resp_size=7262
2026-01-15 05:47:32.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427251&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 05:47:39.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job&timestamp=1768427258 status=200 resp_size=6343
2026-01-15 05:47:39.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427259&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
2026-01-15 05:47:47.165 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job&timestamp=1768427266 status=200 resp_size=7967
2026-01-15 05:47:47.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427267&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
2026-01-15 05:47:54.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768427273 status=200 resp_size=6254
2026-01-15 05:47:54.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427274&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:48:02.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768427281 status=200 resp_size=5253
2026-01-15 05:48:02.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427282&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 05:48:09.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768427288 status=200 resp_size=5431
2026-01-15 05:48:09.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427289&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 05:48:18.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768427297 status=200 resp_size=6080
2026-01-15 05:48:18.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427298&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 05:48:21.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768427301 status=200 resp_size=4995
2026-01-15 05:48:22.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427301&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:48:32.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768427311 status=200 resp_size=5936
2026-01-15 05:48:32.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427312&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-15 05:48:34.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768427314 status=200 resp_size=6041
2026-01-15 05:48:35.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427314&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-15 05:48:45.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768427323 status=200 resp_size=4916
2026-01-15 05:48:45.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427325&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-15 05:48:47.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768427327 status=200 resp_size=5446
2026-01-15 05:48:48.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427327&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-15 05:48:56.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768427335 status=200 resp_size=6494
2026-01-15 05:48:56.829 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427336&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
2026-01-15 05:49:05.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768427344 status=200 resp_size=5860
2026-01-15 05:49:05.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427345&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:49:13.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job&timestamp=1768427352 status=200 resp_size=5677
2026-01-15 05:49:13.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427353&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
2026-01-15 05:49:16.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768427355 status=200 resp_size=6226
2026-01-15 05:49:16.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427356&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-15 05:49:25.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job&timestamp=1768427364 status=200 resp_size=5613
2026-01-15 05:49:25.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427365&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 05:49:28.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768427368 status=200 resp_size=5792
2026-01-15 05:49:28.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427368&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:49:32.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768427371 status=200 resp_size=6422
2026-01-15 05:49:32.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427372&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-15 05:49:39.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768427379 status=200 resp_size=6176
2026-01-15 05:49:40.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427379&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-15 05:49:40.145 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
2026-01-15 05:49:46.333 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:49:46.333 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-15 05:49:49.619 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.27 秒后继续...
2026-01-15 05:49:49.619 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-15 05:49:49.619 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:49:49.632 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:49:50.434 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:49:51.549 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:49:53.638 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:49:53.638 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:49:54.172 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768427389 status=200 resp_size=147507
2026-01-15 05:49:54.172 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:49:54.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job&timestamp=1768427394 status=200 resp_size=7607
2026-01-15 05:49:54.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427394&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
2026-01-15 05:50:02.606 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job&timestamp=1768427401 status=200 resp_size=6731
2026-01-15 05:50:02.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427402&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
2026-01-15 05:50:06.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job&timestamp=1768427405 status=200 resp_size=5575
2026-01-15 05:50:07.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427406&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
2026-01-15 05:50:16.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768427415 status=200 resp_size=5711
2026-01-15 05:50:16.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427416&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
2026-01-15 05:50:20.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768427420 status=200 resp_size=6473
2026-01-15 05:50:20.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427420&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:50:29.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768427427 status=200 resp_size=6856
2026-01-15 05:50:29.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427429&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
2026-01-15 05:50:34.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768427434 status=200 resp_size=5731
2026-01-15 05:50:34.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427434&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-15 05:50:37.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768427436 status=200 resp_size=7075
2026-01-15 05:50:37.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427437&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-15 05:50:41.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768427440 status=200 resp_size=6768
2026-01-15 05:50:41.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427441&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:50:50.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768427448 status=200 resp_size=6530
2026-01-15 05:50:50.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427450&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 05:51:00.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768427459 status=200 resp_size=8973
2026-01-15 05:51:00.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427460&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
2026-01-15 05:51:04.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job&timestamp=1768427464 status=200 resp_size=6315
2026-01-15 05:51:04.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427464&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
2026-01-15 05:51:13.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768427469 status=200 resp_size=8559
2026-01-15 05:51:14.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427473&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
2026-01-15 05:51:24.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768427483 status=200 resp_size=6688
2026-01-15 05:51:24.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427484&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-15 05:51:25.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768427485 status=200 resp_size=5290
2026-01-15 05:51:26.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427485&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-15 05:51:36.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768427495 status=200 resp_size=5982
2026-01-15 05:51:36.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427496&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-15 05:51:38.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job&timestamp=1768427498 status=200 resp_size=7919
2026-01-15 05:51:38.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427498&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
2026-01-15 05:51:43.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job&timestamp=1768427502 status=200 resp_size=7691
2026-01-15 05:51:43.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427503&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
2026-01-15 05:51:44.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768427504 status=200 resp_size=5271
2026-01-15 05:51:44.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427504&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 05:51:48.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job&timestamp=1768427508 status=200 resp_size=7124
2026-01-15 05:51:48.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427508&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:51:48.845 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 20
2026-01-15 05:51:55.080 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:51:55.080 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-15 05:52:03.299 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.21 秒后继续...
2026-01-15 05:52:03.299 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-15 05:52:03.299 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:52:03.313 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:52:03.878 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:52:04.996 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:52:07.139 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:52:07.139 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:52:07.641 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768427523 status=200 resp_size=134766
2026-01-15 05:52:07.641 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:52:07.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768427527 status=200 resp_size=5686
2026-01-15 05:52:08.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427527&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
2026-01-15 05:52:13.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job&timestamp=1768427533 status=200 resp_size=6660
2026-01-15 05:52:14.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427533&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-15 05:52:19.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job&timestamp=1768427539 status=200 resp_size=7952
2026-01-15 05:52:19.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427539&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
2026-01-15 05:52:30.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job&timestamp=1768427549 status=200 resp_size=5414
2026-01-15 05:52:30.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427550&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:52:32.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768427551 status=200 resp_size=5277
2026-01-15 05:52:32.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427552&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-15 05:52:40.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768427560 status=200 resp_size=7175
2026-01-15 05:52:40.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427560&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-15 05:52:49.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768427568 status=200 resp_size=6284
2026-01-15 05:52:49.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427569&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 05:52:54.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768427573 status=200 resp_size=5672
2026-01-15 05:52:54.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427574&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-15 05:53:01.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768427580 status=200 resp_size=6168
2026-01-15 05:53:01.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427581&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
2026-01-15 05:53:04.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job&timestamp=1768427584 status=200 resp_size=5943
2026-01-15 05:53:05.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427584&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
2026-01-15 05:53:08.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768427588 status=200 resp_size=5924
2026-01-15 05:53:09.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427588&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-15 05:53:13.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768427593 status=200 resp_size=6003
2026-01-15 05:53:13.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427593&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-15 05:53:17.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768427597 status=200 resp_size=5378
2026-01-15 05:53:17.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427597&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-15 05:53:26.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768427606 status=200 resp_size=5084
2026-01-15 05:53:27.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427606&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 05:53:28.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768427608 status=200 resp_size=9486
2026-01-15 05:53:29.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427608&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-15 05:53:30.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768427610 status=200 resp_size=5363
2026-01-15 05:53:31.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427610&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-15 05:53:38.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job&timestamp=1768427617 status=200 resp_size=13285
2026-01-15 05:53:38.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427618&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 05:53:49.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768427628 status=200 resp_size=6873
2026-01-15 05:53:49.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427629&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 05:53:50.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job&timestamp=1768427630 status=200 resp_size=6041
2026-01-15 05:53:50.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427630&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
2026-01-15 05:53:53.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job&timestamp=1768427632 status=200 resp_size=8734
2026-01-15 05:53:53.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427633&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
2026-01-15 05:53:53.344 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 20
2026-01-15 05:53:59.436 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:53:59.436 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-15 05:54:07.716 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.28 秒后继续...
2026-01-15 05:54:07.716 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-15 05:54:07.716 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:54:07.743 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:54:08.183 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:54:09.299 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:54:11.389 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:54:11.389 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:54:11.797 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768427647 status=200 resp_size=129499
2026-01-15 05:54:11.797 | WARNING | __main__:get_recommend_jobs:745 - 第 12 页发现 1 个重复职位(已跳过)
2026-01-15 05:54:11.797 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 19 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:54:11.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job&timestamp=1768427651 status=200 resp_size=6635
2026-01-15 05:54:12.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427651&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
2026-01-15 05:54:20.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job&timestamp=1768427659 status=200 resp_size=6205
2026-01-15 05:54:20.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427660&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
2026-01-15 05:54:24.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768427664 status=200 resp_size=5390
2026-01-15 05:54:24.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427664&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-15 05:54:32.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job&timestamp=1768427671 status=200 resp_size=8070
2026-01-15 05:54:32.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427672&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 05:54:36.848 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768427676 status=200 resp_size=6588
2026-01-15 05:54:37.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427676&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-15 05:54:44.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job&timestamp=1768427684 status=200 resp_size=6300
2026-01-15 05:54:44.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427684&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
2026-01-15 05:54:48.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768427688 status=200 resp_size=7194
2026-01-15 05:54:49.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427688&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
2026-01-15 05:54:58.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768427698 status=200 resp_size=6053
2026-01-15 05:54:59.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427698&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-15 05:55:07.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768427707 status=200 resp_size=7170
2026-01-15 05:55:08.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427707&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 05:55:17.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768427716 status=200 resp_size=4992
2026-01-15 05:55:17.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427717&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-15 05:55:24.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768427723 status=200 resp_size=6073
2026-01-15 05:55:24.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427724&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 05:55:32.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768427731 status=200 resp_size=7194
2026-01-15 05:55:32.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427732&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-15 05:55:40.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768427739 status=200 resp_size=6770
2026-01-15 05:55:40.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427740&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 05:55:43.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768427743 status=200 resp_size=5344
2026-01-15 05:55:43.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427743&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-15 05:55:53.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768427752 status=200 resp_size=5554
2026-01-15 05:55:53.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427753&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:55:56.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768427756 status=200 resp_size=5040
2026-01-15 05:55:56.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427756&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-15 05:56:03.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768427763 status=200 resp_size=4993
2026-01-15 05:56:04.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427763&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-15 05:56:07.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768427767 status=200 resp_size=6752
2026-01-15 05:56:07.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427767&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 05:56:14.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768427773 status=200 resp_size=5883
2026-01-15 05:56:14.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427774&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-15 05:56:14.856 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 19
2026-01-15 05:56:20.401 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-15 05:56:20.401 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-15 05:56:23.520 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.11 秒后继续...
2026-01-15 05:56:23.520 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-15 05:56:23.522 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:56:23.545 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:56:24.094 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:56:25.241 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:56:27.363 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:56:27.363 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:56:27.849 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768427783 status=200 resp_size=142964
2026-01-15 05:56:27.849 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:56:28.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768427787 status=200 resp_size=5688
2026-01-15 05:56:28.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427788&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-15 05:56:36.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768427795 status=200 resp_size=6980
2026-01-15 05:56:36.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427796&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-15 05:56:39.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768427799 status=200 resp_size=6794
2026-01-15 05:56:39.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427799&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-15 05:56:47.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768427806 status=200 resp_size=5283
2026-01-15 05:56:47.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427807&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-15 05:56:49.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768427809 status=200 resp_size=5215
2026-01-15 05:56:50.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427809&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-15 05:56:53.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768427813 status=200 resp_size=5764
2026-01-15 05:56:53.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427813&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 05:56:56.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768427816 status=200 resp_size=5514
2026-01-15 05:56:56.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427816&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-15 05:57:01.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768427821 status=200 resp_size=6659
2026-01-15 05:57:01.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427821&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 05:57:09.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job&timestamp=1768427828 status=200 resp_size=5165
2026-01-15 05:57:09.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427829&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
2026-01-15 05:57:15.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768427834 status=200 resp_size=6856
2026-01-15 05:57:15.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427835&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-15 05:57:23.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job&timestamp=1768427842 status=200 resp_size=5570
2026-01-15 05:57:23.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427843&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
2026-01-15 05:57:32.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job&timestamp=1768427851 status=200 resp_size=6749
2026-01-15 05:57:32.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427852&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
2026-01-15 05:57:41.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768427860 status=200 resp_size=5688
2026-01-15 05:57:41.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427861&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
2026-01-15 05:57:48.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768427868 status=200 resp_size=6380
2026-01-15 05:57:49.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427868&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-15 05:57:55.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job&timestamp=1768427874 status=200 resp_size=7975
2026-01-15 05:57:55.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427875&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
2026-01-15 05:57:59.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job&timestamp=1768427879 status=200 resp_size=5984
2026-01-15 05:57:59.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427879&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-15 05:58:05.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768427885 status=200 resp_size=7274
2026-01-15 05:58:06.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427885&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-15 05:58:11.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job&timestamp=1768427891 status=200 resp_size=5582
2026-01-15 05:58:12.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427891&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
2026-01-15 05:58:14.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job&timestamp=1768427894 status=200 resp_size=5924
2026-01-15 05:58:14.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427894&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
2026-01-15 05:58:24.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job&timestamp=1768427903 status=200 resp_size=6027
2026-01-15 05:58:24.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427904&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
2026-01-15 05:58:24.443 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
2026-01-15 05:58:30.508 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 05:58:30.508 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-15 05:58:38.599 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.08 秒后继续...
2026-01-15 05:58:38.599 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-15 05:58:38.599 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 05:58:38.629 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 05:58:39.209 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:58:40.354 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:58:42.490 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 05:58:42.490 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 05:58:42.993 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768427918 status=200 resp_size=163509
2026-01-15 05:58:42.993 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 05:58:43.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job&timestamp=1768427923 status=200 resp_size=6028
2026-01-15 05:58:43.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427923&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 05:58:46.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job&timestamp=1768427926 status=200 resp_size=4774
2026-01-15 05:58:47.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427926&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
2026-01-15 05:58:51.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768427931 status=200 resp_size=8782
2026-01-15 05:58:51.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427931&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-15 05:58:55.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768427935 status=200 resp_size=8655
2026-01-15 05:58:55.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427935&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-15 05:58:59.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768427939 status=200 resp_size=6935
2026-01-15 05:58:59.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427939&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-15 05:59:07.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job&timestamp=1768427946 status=200 resp_size=6440
2026-01-15 05:59:07.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427947&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
2026-01-15 05:59:14.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768427953 status=200 resp_size=7907
2026-01-15 05:59:14.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427954&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-15 05:59:23.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job&timestamp=1768427962 status=200 resp_size=4592
2026-01-15 05:59:23.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427963&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
2026-01-15 05:59:27.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768427967 status=200 resp_size=5878
2026-01-15 05:59:27.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427967&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-15 05:59:33.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job&timestamp=1768427973 status=200 resp_size=6437
2026-01-15 05:59:33.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427973&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-15 05:59:41.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768427981 status=200 resp_size=5672
2026-01-15 05:59:41.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427981&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-15 05:59:49.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job&timestamp=1768427989 status=200 resp_size=5463
2026-01-15 05:59:50.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427989&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
2026-01-15 05:59:56.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768427995 status=200 resp_size=5448
2026-01-15 05:59:56.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768427996&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-15 06:00:02.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768428002 status=200 resp_size=9108
2026-01-15 06:00:03.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428002&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-15 06:00:12.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768428011 status=200 resp_size=6111
2026-01-15 06:00:12.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428012&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
2026-01-15 06:00:15.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job&timestamp=1768428014 status=200 resp_size=6617
2026-01-15 06:00:15.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428015&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
2026-01-15 06:00:22.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768428021 status=200 resp_size=7313
2026-01-15 06:00:23.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428022&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-15 06:00:26.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job&timestamp=1768428026 status=200 resp_size=6958
2026-01-15 06:00:26.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428026&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
2026-01-15 06:00:29.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768428029 status=200 resp_size=6694
2026-01-15 06:00:29.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428029&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
2026-01-15 06:00:38.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768428037 status=200 resp_size=6568
2026-01-15 06:00:38.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428038&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-15 06:00:38.558 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
2026-01-15 06:00:45.090 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-15 06:00:45.091 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-15 06:00:52.330 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.24 秒后继续...
2026-01-15 06:00:52.331 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-15 06:00:52.331 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-15 06:00:52.355 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=沈阳, 工作类型=1332
2026-01-15 06:00:52.950 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 06:00:54.085 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 06:00:56.247 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
2026-01-15 06:00:56.247 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
2026-01-15 06:00:56.805 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768428052 status=200 resp_size=128123
2026-01-15 06:00:56.806 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20 | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
2026-01-15 06:00:57.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768428056 status=200 resp_size=5922
2026-01-15 06:00:57.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768428057&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-15 06:00:58.834 | INFO | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-15 06:00:58.836 | INFO | __main__:close:1137 - httpx客户端已关闭